00000001:00080000:1.0F:1783951792.410264:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411433 is committed 00000100:00100000:3.0F:1783951792.410958:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83350:x1870605465340416:12345-0@lo:1000:osp_up1-0.0 Request processed in 6692us (9769us total) trans 77309411433 rc 0/0 00000100:00100000:3.0:1783951792.410983:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000004:00080000:2.0F:1783951792.411193:0:83350:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 77309411433 committed transno 77309411433 00000100:00100000:2.0:1783951792.411205:0:83350:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411433 gen 2 00000100:00100000:2.0:1783951792.411224:0:83350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:83350:1870605465340416:0@lo:1000:osp_up1-0.0 00000400:00080000:2.0:1783951792.458915:0:83768:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1783951792.83367 00010000:02000000:3.0:1783951792.459110:0:83367:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:06, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:3.0:1783951792.504963:0:83367:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa80a47f73e10 00100000:10000000:3.0:1783951792.505032:0:83367:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1783951792.526073:0:83355:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x47c:0x0] 00000100:00100000:3.0:1783951792.526130:0:83355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83355:1870605465340544:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783951792.526203:0:83355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951792.526247:0:83355:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b153094000 going to sleep for 20 seconds 00000100:00100000:1.0:1783951792.526621:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465340544 00000100:00100000:1.0:1783951792.526630:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465340544 00000100:00100000:1.0:1783951792.526686:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4878 00000100:00100000:1.0:1783951792.526697:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:83355:x1870605465340544:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:1.0:1783951792.526705:0:26203:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1783951792.526732:0:26203:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -581 00002000:02000040:1.0:1783951792.526739:0:26203:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1149 to 0x2c0000401:1729) 00000004:00080000:2.0:1783951792.533919:0:83353:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6a2:0x0] 00000100:00100000:2.0:1783951792.534000:0:83353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83353:1870605465340672:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783951792.534080:0:83353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951792.534165:0:83353:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d9b40 going to sleep for 20 seconds 00000100:00100000:0.0F:1783951792.542217:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465340672 00000100:00100000:0.0:1783951792.542256:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465340672 00000100:00100000:0.0:1783951792.542326:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4879 00000100:00100000:0.0:1783951792.542339:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:83353:x1870605465340672:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1783951792.542347:0:8433:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1783951792.542380:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -31 00002000:02000040:0.0:1783951792.542385:0:8433:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1699 to 0x280000401:1729) 00002000:00010000:1.0:1783951792.543642:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.543653:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb3c15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.543671:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.543675:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.543681:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb3c15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.543697:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb3c15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.543706:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb3c15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.543714:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb3c15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.543739:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951792.543846:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.543862:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb3c1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.543870:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.543873:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.543877:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb3c1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.543886:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb3c1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.543894:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb3c1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.543900:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb3c1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.543918:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951792.545108:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951792.545118:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb3c15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.545131:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.545136:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb3c15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.545146:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb3c15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.545164:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb3c15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.545172:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb3c15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.545196:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.545211:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb3c1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.545218:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.545221:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb3c1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.545228:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb3c1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.545238:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb3c1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.545245:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb3c1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.545258:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.545259:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.545261:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.548481:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.548502:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb3c23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548614:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.548619:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.548625:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb3c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548641:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb3c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548666:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb3c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548674:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb3c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548701:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951792.548885:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.548891:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb3c2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548900:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.548903:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.548907:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb3c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548915:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb3c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548934:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb3c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548941:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb3c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548968:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951792.548977:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951792.548983:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb3c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.548991:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ae00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.548995:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb3c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549004:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb3c23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549020:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb3c23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549028:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb3c23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549044:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951792.549048:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb3c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549053:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.549056:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb3c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549075:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb3c2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549085:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb3c2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549092:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb3c2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549103:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.549105:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.549106:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.549167:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.549173:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb3c31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549181:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.549185:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.549188:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb3c31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549197:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb3c31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549205:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb3c31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549218:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb3c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549231:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951792.549238:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951792.549242:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb3c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.549249:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.549249:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.549252:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb3c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549260:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb3c31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549270:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb3c31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.549273:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.549278:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb3c31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.549290:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.549292:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.549293:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.550433:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.550456:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb3c38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550469:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.550474:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.550477:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb3c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550488:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb3c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550625:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb3c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550635:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb3c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550651:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951792.550738:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.550743:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d48a24/0x22c73c7857bb3c3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550752:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.550755:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.550759:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d48a24/0x22c73c7857bb3c3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550768:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012d48a24/0x22c73c7857bb3c3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550786:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d48a24/0x22c73c7857bb3c3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550793:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012d48a24/0x22c73c7857bb3c3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550812:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783951792.550854:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.550858:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fa47902/0x22c73c7857bb3c46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550866:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.550869:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.550872:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fa47902/0x22c73c7857bb3c46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550881:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fa47902/0x22c73c7857bb3c46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550887:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fa47902/0x22c73c7857bb3c46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550893:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fa47902/0x22c73c7857bb3c46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550934:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783951792.550945:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783951792.550950:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb3c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550959:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86be00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.550962:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb3c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550970:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb3c38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550985:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb3c38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.550993:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb3c38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551011:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951792.551015:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012d48a24/0x22c73c7857bb3c3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551022:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86bc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.551025:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d48a24/0x22c73c7857bb3c3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551046:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d48a24/0x22c73c7857bb3c3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551057:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012d48a24/0x22c73c7857bb3c3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551064:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012d48a24/0x22c73c7857bb3c3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551077:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951792.551081:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fa47902/0x22c73c7857bb3c46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551088:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.551091:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fa47902/0x22c73c7857bb3c46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551099:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fa47902/0x22c73c7857bb3c46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551107:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fa47902/0x22c73c7857bb3c46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551115:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fa47902/0x22c73c7857bb3c46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551138:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551140:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551142:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.551188:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.551193:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb3c4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551202:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.551205:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.551209:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb3c4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551219:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb3c4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551226:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb3c4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551233:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb3c4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551246:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951792.551253:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951792.551256:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb3c4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551274:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ac00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.551278:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb3c4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551285:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb3c4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551296:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb3c4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551303:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb3c4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551317:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551319:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551321:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.551447:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.551454:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d902c3d/0x22c73c7857bb3c54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551462:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.551465:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.551469:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d902c3d/0x22c73c7857bb3c54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551478:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d902c3d/0x22c73c7857bb3c54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551494:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d902c3d/0x22c73c7857bb3c54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551501:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d902c3d/0x22c73c7857bb3c54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551528:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951792.551536:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951792.551539:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d902c3d/0x22c73c7857bb3c54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551546:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aae00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.551549:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d902c3d/0x22c73c7857bb3c54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551556:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d902c3d/0x22c73c7857bb3c54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551565:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d902c3d/0x22c73c7857bb3c54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551571:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d902c3d/0x22c73c7857bb3c54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551585:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551614:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551616:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.551659:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.551664:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1ba720d/0x22c73c7857bb3c5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551672:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.551675:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.551678:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1ba720d/0x22c73c7857bb3c5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551686:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1ba720d/0x22c73c7857bb3c5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551693:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1ba720d/0x22c73c7857bb3c5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551700:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1ba720d/0x22c73c7857bb3c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551713:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951792.551720:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951792.551723:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1ba720d/0x22c73c7857bb3c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551730:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413ab200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.551733:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1ba720d/0x22c73c7857bb3c5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551750:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1ba720d/0x22c73c7857bb3c5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.551756:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551761:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1ba720d/0x22c73c7857bb3c5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551768:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1ba720d/0x22c73c7857bb3c5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551782:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551784:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551786:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.551828:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.551833:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a85283c7/0x22c73c7857bb3c62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.551837:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551840:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.551844:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.551847:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a85283c7/0x22c73c7857bb3c62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551856:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a85283c7/0x22c73c7857bb3c62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551864:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a85283c7/0x22c73c7857bb3c62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551877:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a85283c7/0x22c73c7857bb3c62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551897:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951792.551917:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.551936:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a85283c7/0x22c73c7857bb3c62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.551945:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413abe00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.551948:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a85283c7/0x22c73c7857bb3c62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951792.551954:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783951792.551956:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a85283c7/0x22c73c7857bb3c62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551958:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4d7503/0x22c73c7857bb3c69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.551967:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a85283c7/0x22c73c7857bb3c62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551967:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.551970:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.551974:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4d7503/0x22c73c7857bb3c69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.551975:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a85283c7/0x22c73c7857bb3c62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.551983:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa4d7503/0x22c73c7857bb3c69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.551991:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551991:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4d7503/0x22c73c7857bb3c69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.551998:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.551998:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4d7503/0x22c73c7857bb3c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.552000:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.552017:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951792.552033:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.552039:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa4d7503/0x22c73c7857bb3c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552046:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aa600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.552049:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4d7503/0x22c73c7857bb3c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951792.552053:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.552058:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049f56acd/0x22c73c7857bb3c70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552063:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4d7503/0x22c73c7857bb3c69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552070:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.552073:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951792.552074:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa4d7503/0x22c73c7857bb3c69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552078:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049f56acd/0x22c73c7857bb3c70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552082:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa4d7503/0x22c73c7857bb3c69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552087:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049f56acd/0x22c73c7857bb3c70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552095:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049f56acd/0x22c73c7857bb3c70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552096:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.552098:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.552099:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.552103:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049f56acd/0x22c73c7857bb3c70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552125:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951792.552168:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.552173:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f2bcc3/0x22c73c7857bb3c77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552181:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.552183:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.552187:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090f2bcc3/0x22c73c7857bb3c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552195:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090f2bcc3/0x22c73c7857bb3c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552212:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f2bcc3/0x22c73c7857bb3c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552218:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090f2bcc3/0x22c73c7857bb3c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552239:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951792.552263:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951792.552267:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049f56acd/0x22c73c7857bb3c70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552274:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413ab400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.552278:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f56acd/0x22c73c7857bb3c70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951792.552278:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.552283:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb3c7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552286:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f56acd/0x22c73c7857bb3c70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552291:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.552294:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951792.552297:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049f56acd/0x22c73c7857bb3c70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552298:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb3c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552308:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb3c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552316:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049f56acd/0x22c73c7857bb3c70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552316:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb3c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.552324:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb3c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552330:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.552333:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090f2bcc3/0x22c73c7857bb3c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552339:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aac00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.552343:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f2bcc3/0x22c73c7857bb3c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552350:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f2bcc3/0x22c73c7857bb3c77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552361:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090f2bcc3/0x22c73c7857bb3c77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552369:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090f2bcc3/0x22c73c7857bb3c77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.552380:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.552381:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.552383:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.552787:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.552957:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951792.553004:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.553010:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923f140f/0x22c73c7857bb3c85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553019:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.553022:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.553026:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000923f140f/0x22c73c7857bb3c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553035:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000923f140f/0x22c73c7857bb3c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553042:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923f140f/0x22c73c7857bb3c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553049:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000923f140f/0x22c73c7857bb3c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553068:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783951792.553104:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.553109:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b60f6ae/0x22c73c7857bb3c8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553117:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.553129:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951792.553132:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951792.553133:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b60f6ae/0x22c73c7857bb3c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553137:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb3c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553142:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b60f6ae/0x22c73c7857bb3c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553150:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413ab000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.553151:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b60f6ae/0x22c73c7857bb3c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553154:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb3c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553160:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b60f6ae/0x22c73c7857bb3c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553163:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb3c7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553174:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb3c7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553174:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951792.553181:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb3c7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553181:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951792.553184:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000923f140f/0x22c73c7857bb3c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553190:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aa200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.553193:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000923f140f/0x22c73c7857bb3c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553197:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.553200:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b60f6ae/0x22c73c7857bb3c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553201:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000923f140f/0x22c73c7857bb3c85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553208:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413ab600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.553211:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b60f6ae/0x22c73c7857bb3c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553212:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000923f140f/0x22c73c7857bb3c85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553219:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b60f6ae/0x22c73c7857bb3c8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553227:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b60f6ae/0x22c73c7857bb3c8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553229:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000923f140f/0x22c73c7857bb3c85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553238:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b60f6ae/0x22c73c7857bb3c8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553241:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.553243:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.553245:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.553249:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.553251:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.553252:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.553288:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.553288:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.553293:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f19b33/0x22c73c7857bb3c93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553301:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.553304:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.553308:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016f19b33/0x22c73c7857bb3c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553316:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016f19b33/0x22c73c7857bb3c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553323:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f19b33/0x22c73c7857bb3c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553330:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016f19b33/0x22c73c7857bb3c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553626:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951792.553676:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.553681:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cdbf17b/0x22c73c7857bb3c9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553689:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.553692:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.553696:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cdbf17b/0x22c73c7857bb3c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553704:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cdbf17b/0x22c73c7857bb3c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553711:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cdbf17b/0x22c73c7857bb3c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.553764:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.553769:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016f19b33/0x22c73c7857bb3c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.553777:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aa400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.553780:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f19b33/0x22c73c7857bb3c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.553789:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f19b33/0x22c73c7857bb3c93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553793:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cdbf17b/0x22c73c7857bb3c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.553800:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016f19b33/0x22c73c7857bb3c93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.553806:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016f19b33/0x22c73c7857bb3c93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553808:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951792.553820:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.553824:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cdbf17b/0x22c73c7857bb3c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.553830:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e5800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.553833:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cdbf17b/0x22c73c7857bb3c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951792.553845:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.553850:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb7b584f/0x22c73c7857bb3ca1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.553851:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cdbf17b/0x22c73c7857bb3c9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553858:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.553861:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951792.553862:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cdbf17b/0x22c73c7857bb3c9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553866:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7b584f/0x22c73c7857bb3ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.553870:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cdbf17b/0x22c73c7857bb3c9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.553881:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.553883:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.553883:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb7b584f/0x22c73c7857bb3ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.553884:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.553891:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb7b584f/0x22c73c7857bb3ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553898:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7b584f/0x22c73c7857bb3ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.553918:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951792.553943:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.553949:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb7b584f/0x22c73c7857bb3ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553955:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.553958:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb7b584f/0x22c73c7857bb3ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553965:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb7b584f/0x22c73c7857bb3ca1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553974:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb7b584f/0x22c73c7857bb3ca1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553980:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb7b584f/0x22c73c7857bb3ca1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.553991:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.553993:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.554000:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.554016:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.554021:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a920008/0x22c73c7857bb3ca8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554030:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1783951792.554033:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.554033:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.554037:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a920008/0x22c73c7857bb3ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554046:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a920008/0x22c73c7857bb3ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554053:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a920008/0x22c73c7857bb3ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554071:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a920008/0x22c73c7857bb3ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554092:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951792.554131:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.554135:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003996caad/0x22c73c7857bb3caf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554143:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.554145:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.554150:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003996caad/0x22c73c7857bb3caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.554152:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.554156:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a920008/0x22c73c7857bb3ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554159:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003996caad/0x22c73c7857bb3caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.554163:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.554168:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a920008/0x22c73c7857bb3ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554168:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003996caad/0x22c73c7857bb3caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554176:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003996caad/0x22c73c7857bb3caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.554177:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a920008/0x22c73c7857bb3ca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.554188:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a920008/0x22c73c7857bb3ca8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554198:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951792.554200:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a920008/0x22c73c7857bb3ca8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.554213:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.554216:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003996caad/0x22c73c7857bb3caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.554223:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.554226:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003996caad/0x22c73c7857bb3caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.554233:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003996caad/0x22c73c7857bb3caf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951792.554233:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.554238:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c52563f7/0x22c73c7857bb3cb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.554244:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003996caad/0x22c73c7857bb3caf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.554251:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003996caad/0x22c73c7857bb3caf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554251:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.554254:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.554258:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c52563f7/0x22c73c7857bb3cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.554262:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.554264:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.554266:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.554267:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c52563f7/0x22c73c7857bb3cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554275:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c52563f7/0x22c73c7857bb3cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554282:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c52563f7/0x22c73c7857bb3cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.554300:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951792.554301:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.554305:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c52563f7/0x22c73c7857bb3cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.554312:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.554316:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c52563f7/0x22c73c7857bb3cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.554323:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c52563f7/0x22c73c7857bb3cb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.554334:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c52563f7/0x22c73c7857bb3cb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.554341:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c52563f7/0x22c73c7857bb3cb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.554354:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.554356:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.554357:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.554390:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.556901:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.556914:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ae2c81/0x22c73c7857bb3cbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.556941:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.556946:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.556952:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ae2c81/0x22c73c7857bb3cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.556968:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5ae2c81/0x22c73c7857bb3cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.556996:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ae2c81/0x22c73c7857bb3cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557005:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ae2c81/0x22c73c7857bb3cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557028:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951792.557099:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.557104:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1ad5188/0x22c73c7857bb3cc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557113:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.557117:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.557121:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1ad5188/0x22c73c7857bb3cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557130:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1ad5188/0x22c73c7857bb3cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557138:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1ad5188/0x22c73c7857bb3cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557146:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1ad5188/0x22c73c7857bb3cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557171:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783951792.557212:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.557217:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef0938d3/0x22c73c7857bb3ccb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557225:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.557228:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.557232:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0938d3/0x22c73c7857bb3ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557241:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef0938d3/0x22c73c7857bb3ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557248:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef0938d3/0x22c73c7857bb3ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557256:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0938d3/0x22c73c7857bb3ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557269:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783951792.557303:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.557308:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001448e476/0x22c73c7857bb3cd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.557316:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.557324:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.557329:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001448e476/0x22c73c7857bb3cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560243:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783951792.560259:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5ae2c81/0x22c73c7857bb3cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560275:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.560280:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ae2c81/0x22c73c7857bb3cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560314:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ae2c81/0x22c73c7857bb3cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560337:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5ae2c81/0x22c73c7857bb3cbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560345:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5ae2c81/0x22c73c7857bb3cbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560374:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951792.560378:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1ad5188/0x22c73c7857bb3cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560386:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e5a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.560389:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1ad5188/0x22c73c7857bb3cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560397:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1ad5188/0x22c73c7857bb3cc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560408:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1ad5188/0x22c73c7857bb3cc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560415:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1ad5188/0x22c73c7857bb3cc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.560429:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001448e476/0x22c73c7857bb3cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560437:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.560441:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef0938d3/0x22c73c7857bb3ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.560442:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001448e476/0x22c73c7857bb3cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560448:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e5c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.560451:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef0938d3/0x22c73c7857bb3ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.560451:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001448e476/0x22c73c7857bb3cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560459:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef0938d3/0x22c73c7857bb3ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560467:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef0938d3/0x22c73c7857bb3ccb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.560467:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951792.560473:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef0938d3/0x22c73c7857bb3ccb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560483:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.560486:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001448e476/0x22c73c7857bb3cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560504:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.560507:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001448e476/0x22c73c7857bb3cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560524:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001448e476/0x22c73c7857bb3cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560533:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001448e476/0x22c73c7857bb3cd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560539:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001448e476/0x22c73c7857bb3cd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.560552:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.560554:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.560555:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.560579:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.560886:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.560899:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951792.561868:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.561876:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015844237/0x22c73c7857bb3cd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.561891:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.561896:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.561913:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015844237/0x22c73c7857bb3cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.561934:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015844237/0x22c73c7857bb3cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.561943:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015844237/0x22c73c7857bb3cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.561960:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015844237/0x22c73c7857bb3cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.561982:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951792.562033:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.562038:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3ce0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562046:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.562049:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.562053:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562062:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562070:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562076:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562102:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783951792.562143:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.562148:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d7a9b8b/0x22c73c7857bb3ce7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562163:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.562165:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.562170:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d7a9b8b/0x22c73c7857bb3ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562179:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d7a9b8b/0x22c73c7857bb3ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562188:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d7a9b8b/0x22c73c7857bb3ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562195:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d7a9b8b/0x22c73c7857bb3ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562209:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783951792.562300:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951792.562305:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0afd76b/0x22c73c7857bb3cee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562313:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1783951792.562316:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951792.562320:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0afd76b/0x22c73c7857bb3cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.562327:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0afd76b/0x22c73c7857bb3cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562614:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951792.562624:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015844237/0x22c73c7857bb3cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562632:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e5e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.562636:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015844237/0x22c73c7857bb3cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562644:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015844237/0x22c73c7857bb3cd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562658:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015844237/0x22c73c7857bb3cd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562665:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015844237/0x22c73c7857bb3cd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562683:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951792.562686:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562692:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.562694:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562701:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3ce0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562717:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3ce0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562724:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3ce0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562737:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.562739:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d7a9b8b/0x22c73c7857bb3ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562745:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e5400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.562749:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d7a9b8b/0x22c73c7857bb3ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562755:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d7a9b8b/0x22c73c7857bb3ce7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562764:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d7a9b8b/0x22c73c7857bb3ce7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562771:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d7a9b8b/0x22c73c7857bb3ce7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.562782:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.562784:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.562791:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.562798:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.563716:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.564047:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0afd76b/0x22c73c7857bb3cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.564054:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0afd76b/0x22c73c7857bb3cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.564078:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951792.564169:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.564175:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0afd76b/0x22c73c7857bb3cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.564183:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e5000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.564187:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0afd76b/0x22c73c7857bb3cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.564196:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0afd76b/0x22c73c7857bb3cee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.564211:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0afd76b/0x22c73c7857bb3cee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.564219:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0afd76b/0x22c73c7857bb3cee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.564238:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.564240:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.564242:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951792.567908:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.567920:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af50c71a/0x22c73c7857bb3cf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.567947:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.567952:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.567958:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af50c71a/0x22c73c7857bb3cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.567975:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af50c71a/0x22c73c7857bb3cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.567985:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af50c71a/0x22c73c7857bb3cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568379:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af50c71a/0x22c73c7857bb3cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568408:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951792.568575:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.568581:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc6f6b2/0x22c73c7857bb3cfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568669:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.568672:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.568677:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc6f6b2/0x22c73c7857bb3cfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568686:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc6f6b2/0x22c73c7857bb3cfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568694:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc6f6b2/0x22c73c7857bb3cfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568701:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc6f6b2/0x22c73c7857bb3cfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568713:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951792.568754:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.568759:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb3d03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568767:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.568770:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.568773:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb3d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568782:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb3d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568801:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb3d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568807:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb3d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568819:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783951792.568858:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.568862:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c54519/0x22c73c7857bb3d0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568870:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.568873:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.568877:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042c54519/0x22c73c7857bb3d0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568886:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042c54519/0x22c73c7857bb3d0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568893:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c54519/0x22c73c7857bb3d0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568900:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042c54519/0x22c73c7857bb3d0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568935:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1783951792.568977:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.568982:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c59e9f5/0x22c73c7857bb3d11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.568990:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.569005:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.569009:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c59e9f5/0x22c73c7857bb3d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569017:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c59e9f5/0x22c73c7857bb3d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569024:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c59e9f5/0x22c73c7857bb3d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569031:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c59e9f5/0x22c73c7857bb3d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569041:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1783951792.569076:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.569081:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f28b7785/0x22c73c7857bb3d18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569089:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.569097:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.569101:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f28b7785/0x22c73c7857bb3d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569109:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f28b7785/0x22c73c7857bb3d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569116:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f28b7785/0x22c73c7857bb3d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569121:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f28b7785/0x22c73c7857bb3d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569129:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1783951792.569164:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.569168:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372728ee/0x22c73c7857bb3d1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569175:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.569178:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.569181:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372728ee/0x22c73c7857bb3d1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569189:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372728ee/0x22c73c7857bb3d1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569196:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372728ee/0x22c73c7857bb3d1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569207:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372728ee/0x22c73c7857bb3d1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569216:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1783951792.569254:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.569259:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4389df3/0x22c73c7857bb3d26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569266:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.569268:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.569272:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4389df3/0x22c73c7857bb3d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569279:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4389df3/0x22c73c7857bb3d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569286:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4389df3/0x22c73c7857bb3d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569293:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4389df3/0x22c73c7857bb3d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569301:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1783951792.569334:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.569339:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb3d2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569351:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.569354:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.569358:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb3d2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569366:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb3d2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569374:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb3d2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569381:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb3d2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569390:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1783951792.569426:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.569431:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003c63f06/0x22c73c7857bb3d34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569437:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.569440:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.569444:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003c63f06/0x22c73c7857bb3d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569452:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003c63f06/0x22c73c7857bb3d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569470:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003c63f06/0x22c73c7857bb3d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569477:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003c63f06/0x22c73c7857bb3d34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569485:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1783951792.569518:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.569523:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb3d3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569530:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.569533:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.569536:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb3d3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569544:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb3d3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569552:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb3d3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569559:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb3d3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569577:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1783951792.569636:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.569640:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb3d42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569648:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.569650:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.569654:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb3d42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569668:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb3d42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569676:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb3d42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569682:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb3d42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569691:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1783951792.569726:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.569731:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb3d49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569738:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.569747:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.569751:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb3d49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569759:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb3d49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569767:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb3d49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569774:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb3d49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569782:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:0.0:1783951792.569820:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.569825:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb3d50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569833:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.569835:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.569840:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb3d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569848:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb3d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569856:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb3d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569870:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb3d50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.569878:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:0.0:1783951792.569912:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.569918:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb3d57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570015:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1783951792.570024:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af50c71a/0x22c73c7857bb3cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570033:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570037:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af50c71a/0x22c73c7857bb3cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570046:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af50c71a/0x22c73c7857bb3cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570064:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af50c71a/0x22c73c7857bb3cf5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570078:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af50c71a/0x22c73c7857bb3cf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570100:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1783951792.570103:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc6f6b2/0x22c73c7857bb3cfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570109:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ffe00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570112:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc6f6b2/0x22c73c7857bb3cfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570119:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc6f6b2/0x22c73c7857bb3cfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570129:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc6f6b2/0x22c73c7857bb3cfc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570136:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc6f6b2/0x22c73c7857bb3cfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570148:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1783951792.570152:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb3d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570159:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ffa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570169:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb3d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570178:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb3d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570188:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb3d03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570195:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb3d03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570207:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1783951792.570211:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042c54519/0x22c73c7857bb3d0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570218:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570221:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c54519/0x22c73c7857bb3d0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570229:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c54519/0x22c73c7857bb3d0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570238:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042c54519/0x22c73c7857bb3d0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570246:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042c54519/0x22c73c7857bb3d0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570264:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1783951792.570268:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c59e9f5/0x22c73c7857bb3d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570275:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570278:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c59e9f5/0x22c73c7857bb3d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570286:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c59e9f5/0x22c73c7857bb3d11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570297:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c59e9f5/0x22c73c7857bb3d11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570305:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c59e9f5/0x22c73c7857bb3d11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570316:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1783951792.570320:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f28b7785/0x22c73c7857bb3d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570326:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570330:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f28b7785/0x22c73c7857bb3d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570347:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f28b7785/0x22c73c7857bb3d18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570357:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f28b7785/0x22c73c7857bb3d18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570364:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f28b7785/0x22c73c7857bb3d18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570390:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1783951792.570394:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372728ee/0x22c73c7857bb3d1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570401:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fee00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570403:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372728ee/0x22c73c7857bb3d1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570410:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372728ee/0x22c73c7857bb3d1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570419:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372728ee/0x22c73c7857bb3d1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570425:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372728ee/0x22c73c7857bb3d1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570447:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1783951792.570450:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4389df3/0x22c73c7857bb3d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570455:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fec00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570458:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4389df3/0x22c73c7857bb3d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570465:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4389df3/0x22c73c7857bb3d26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570474:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4389df3/0x22c73c7857bb3d26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570479:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4389df3/0x22c73c7857bb3d26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570488:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783951792.570491:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb3d2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570496:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570499:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb3d2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570516:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb3d2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570526:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb3d2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570533:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb3d2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570544:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783951792.570547:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003c63f06/0x22c73c7857bb3d34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570553:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fea00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570556:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003c63f06/0x22c73c7857bb3d34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570564:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003c63f06/0x22c73c7857bb3d34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570574:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003c63f06/0x22c73c7857bb3d34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570582:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003c63f06/0x22c73c7857bb3d34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570627:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783951792.570630:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb3d3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570636:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570638:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb3d3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570645:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb3d3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570653:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb3d3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570660:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb3d3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570669:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783951792.570673:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb3d42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570679:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570682:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb3d42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570698:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb3d42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570707:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb3d42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570713:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb3d42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570726:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951792.570729:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb3d49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570735:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ffc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570738:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb3d49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570744:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb3d49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570753:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb3d49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570759:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb3d49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570782:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.570786:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb3d50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570792:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.570795:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb3d50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570802:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb3d50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570811:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb3d50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570818:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb3d50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.570828:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.570830:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.570832:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.571332:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.571339:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.571344:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951792.572388:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.572393:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.572400:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb3d57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.572414:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb3d57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.572423:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb3d57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.572431:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb3d57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.572456:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951792.572551:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.572557:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009af16ec7/0x22c73c7857bb3d5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.572576:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.572579:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.572583:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009af16ec7/0x22c73c7857bb3d5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.572807:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.572814:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb3d57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.572823:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.572833:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb3d57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.572843:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb3d57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.572859:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb3d57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.572866:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb3d57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.572884:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.572886:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.572888:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951792.572943:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009af16ec7/0x22c73c7857bb3d5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.572951:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009af16ec7/0x22c73c7857bb3d5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.572958:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009af16ec7/0x22c73c7857bb3d5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.572977:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951792.573068:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.573074:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009af16ec7/0x22c73c7857bb3d5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573090:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.573093:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009af16ec7/0x22c73c7857bb3d5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573101:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009af16ec7/0x22c73c7857bb3d5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573111:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009af16ec7/0x22c73c7857bb3d5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573118:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009af16ec7/0x22c73c7857bb3d5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573132:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.573134:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.573135:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951792.573196:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.573201:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9ebdd04/0x22c73c7857bb3d65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573209:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.573212:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.573228:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ebdd04/0x22c73c7857bb3d65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573239:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9ebdd04/0x22c73c7857bb3d65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573256:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9ebdd04/0x22c73c7857bb3d65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573263:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ebdd04/0x22c73c7857bb3d65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573279:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951792.573317:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.573321:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000193396ab/0x22c73c7857bb3d6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573329:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.573332:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.573336:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000193396ab/0x22c73c7857bb3d6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573344:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000193396ab/0x22c73c7857bb3d6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573352:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000193396ab/0x22c73c7857bb3d6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573358:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000193396ab/0x22c73c7857bb3d6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573395:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951792.573442:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.573448:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b5de71d/0x22c73c7857bb3d73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573456:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.573460:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.573463:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b5de71d/0x22c73c7857bb3d73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573470:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b5de71d/0x22c73c7857bb3d73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573478:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b5de71d/0x22c73c7857bb3d73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.573485:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b5de71d/0x22c73c7857bb3d73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573700:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951792.573705:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9ebdd04/0x22c73c7857bb3d65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573712:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.573715:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9ebdd04/0x22c73c7857bb3d65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573723:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9ebdd04/0x22c73c7857bb3d65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573743:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9ebdd04/0x22c73c7857bb3d65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573750:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9ebdd04/0x22c73c7857bb3d65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573764:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.573767:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000193396ab/0x22c73c7857bb3d6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573773:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.573776:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000193396ab/0x22c73c7857bb3d6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573783:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000193396ab/0x22c73c7857bb3d6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573791:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000193396ab/0x22c73c7857bb3d6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573797:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000193396ab/0x22c73c7857bb3d6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.573807:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.573808:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.573815:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.574000:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951792.574128:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951792.574179:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.574184:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3d7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.574192:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.574200:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.574204:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.574214:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.574220:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.574227:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3d7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.578880:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951792.578894:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b5de71d/0x22c73c7857bb3d73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.578909:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.578914:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b5de71d/0x22c73c7857bb3d73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.578933:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b5de71d/0x22c73c7857bb3d73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.578956:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b5de71d/0x22c73c7857bb3d73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.578978:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b5de71d/0x22c73c7857bb3d73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.579015:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951792.579020:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3d7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.579027:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.579031:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3d7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.579039:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3d7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.579050:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3d7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.579058:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.579060:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.579062:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951792.582285:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783951792.582303:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3d7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951792.582450:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.582458:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3d81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.582472:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.582477:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.582483:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3d81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.582504:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3d81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.582524:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3d81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.582531:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3d81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.585063:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.585078:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3d81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.585091:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.585096:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3d81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.585108:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3d81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.585131:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3d81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.585144:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.585146:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.585148:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783951792.585240:0:26203:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1148 00000100:00100000:1.0:1783951792.585354:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:83355:x1870605465340544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 58654us (59146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951792.585365:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4878 00000100:00100000:3.0:1783951792.585560:0:83355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83355:1870605465340544:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783951792.585576:0:83355:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6c1:0x0] from OST, last_created [0x2c0000401:0x6c1:0x0]last_used is [0x2c0000401:0x47c:0x0] 00000100:00100000:3.0:1783951792.585690:0:83355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83355:1870605465340928:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783951792.585729:0:83355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951792.585767:0:83355:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b153094000 going to sleep for 20 seconds 00000100:00100000:3.0:1783951792.585783:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465340928 00000100:00100000:3.0:1783951792.585789:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465340928 00000100:00100000:3.0:1783951792.585833:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4880 00000100:00100000:3.0:1783951792.585843:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:83355:x1870605465340928:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:3.0:1783951792.585848:0:26197:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1783951792.585881:0:26197:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1730 00000100:00100000:1.0:1783951792.587399:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465340800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951792.587460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951792.587531:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:83355:x1870605465340928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1688us (1801us total) trans 4294968949 rc 0/0 00000100:00100000:3.0:1783951792.587541:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4880 00000100:00100000:3.0:1783951792.587608:0:83355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83355:1870605465340928:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783951792.587622:0:83355:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6c1:0x0]-[0x2c0000401:0x6e1:0x0] 00000100:00100000:2.0:1783951792.588645:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465340800 00000100:00100000:2.0:1783951792.588657:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465340800 00000100:00100000:2.0:1783951792.588700:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:2.0:1783951792.588709:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dc67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465340800:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:2.0:1783951792.588716:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1783951792.588741:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951792.588801:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dc67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465340800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951792.588807:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00010000:00010000:0.0:1783951792.591197:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783951792.591214:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3d81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951792.591367:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.591375:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ff12ae7/0x22c73c7857bb3d88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.591388:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.591392:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.591398:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ff12ae7/0x22c73c7857bb3d88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.591413:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ff12ae7/0x22c73c7857bb3d88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.591423:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ff12ae7/0x22c73c7857bb3d88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.591452:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ff12ae7/0x22c73c7857bb3d88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.591482:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951792.591580:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.591616:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ff12ae7/0x22c73c7857bb3d88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.591743:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.591748:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ff12ae7/0x22c73c7857bb3d88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.591756:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ff12ae7/0x22c73c7857bb3d88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.591772:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ff12ae7/0x22c73c7857bb3d88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.591779:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ff12ae7/0x22c73c7857bb3d88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.591794:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.591796:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.591797:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951792.591935:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465340800:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1783951792.592175:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.592180:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dab8ad2/0x22c73c7857bb3d8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592189:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.592192:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.592196:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dab8ad2/0x22c73c7857bb3d8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592205:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dab8ad2/0x22c73c7857bb3d8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592213:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dab8ad2/0x22c73c7857bb3d8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592220:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dab8ad2/0x22c73c7857bb3d8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592241:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951792.592282:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.592288:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5488e0f/0x22c73c7857bb3d96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592301:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.592304:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.592309:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5488e0f/0x22c73c7857bb3d96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592317:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5488e0f/0x22c73c7857bb3d96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592325:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5488e0f/0x22c73c7857bb3d96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592334:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5488e0f/0x22c73c7857bb3d96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592346:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951792.592439:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.592444:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051fdee84/0x22c73c7857bb3d9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592450:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.592453:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.592457:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051fdee84/0x22c73c7857bb3d9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592465:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051fdee84/0x22c73c7857bb3d9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592483:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051fdee84/0x22c73c7857bb3d9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.592489:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051fdee84/0x22c73c7857bb3d9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592611:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951792.592619:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dab8ad2/0x22c73c7857bb3d8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592627:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.592630:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dab8ad2/0x22c73c7857bb3d8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592638:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dab8ad2/0x22c73c7857bb3d8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592651:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dab8ad2/0x22c73c7857bb3d8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592667:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dab8ad2/0x22c73c7857bb3d8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592684:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951792.592688:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5488e0f/0x22c73c7857bb3d96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592695:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.592698:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5488e0f/0x22c73c7857bb3d96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592707:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5488e0f/0x22c73c7857bb3d96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592732:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5488e0f/0x22c73c7857bb3d96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592740:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5488e0f/0x22c73c7857bb3d96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.592751:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.592753:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.592755:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.593077:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.593178:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.620104:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951792.620939:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951792.621060:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951792.621069:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051fdee84/0x22c73c7857bb3d9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.621093:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951792.621097:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051fdee84/0x22c73c7857bb3d9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.621108:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051fdee84/0x22c73c7857bb3d9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.621125:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051fdee84/0x22c73c7857bb3d9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.621132:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051fdee84/0x22c73c7857bb3d9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951792.621153:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.621155:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.621156:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951792.621296:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.621304:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6de341/0x22c73c7857bb3da4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621316:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.621320:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.621326:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6de341/0x22c73c7857bb3da4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621339:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a6de341/0x22c73c7857bb3da4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621347:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6de341/0x22c73c7857bb3da4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621353:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a6de341/0x22c73c7857bb3da4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621386:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951792.621428:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.621432:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c381da9/0x22c73c7857bb3dab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621440:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.621443:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.621447:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c381da9/0x22c73c7857bb3dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621456:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c381da9/0x22c73c7857bb3dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621463:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c381da9/0x22c73c7857bb3dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621469:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c381da9/0x22c73c7857bb3dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621546:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951792.621637:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.621643:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb3db2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621651:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.621659:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.621663:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb3db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621672:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb3db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621679:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb3db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.621685:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb3db2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627155:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951792.627170:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a6de341/0x22c73c7857bb3da4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627184:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.627189:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6de341/0x22c73c7857bb3da4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627221:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6de341/0x22c73c7857bb3da4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627242:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a6de341/0x22c73c7857bb3da4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627250:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6de341/0x22c73c7857bb3da4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627270:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951792.627274:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c381da9/0x22c73c7857bb3dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627280:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.627284:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c381da9/0x22c73c7857bb3dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627291:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c381da9/0x22c73c7857bb3dab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627300:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c381da9/0x22c73c7857bb3dab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627307:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c381da9/0x22c73c7857bb3dab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627328:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.627331:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb3db2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627338:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.627341:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb3db2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627348:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb3db2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627358:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb3db2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.627365:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.627366:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.627368:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.627886:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951792.627964:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783951792.627974:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb3db2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.628097:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951792.628235:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.628241:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3db9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628254:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.628259:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.628265:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628278:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628296:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628304:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628327:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951792.628376:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.628381:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3dc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628389:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.628392:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.628396:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628406:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628413:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628420:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628483:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951792.628531:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951792.628536:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087138c2a/0x22c73c7857bb3dc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628545:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1783951792.628548:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951792.628552:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087138c2a/0x22c73c7857bb3dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628561:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087138c2a/0x22c73c7857bb3dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628569:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087138c2a/0x22c73c7857bb3dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.628578:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087138c2a/0x22c73c7857bb3dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.633985:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951792.634954:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.634970:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.634975:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.635122:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3db9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.635145:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3db9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.635153:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd5dbbe6/0x22c73c7857bb3db9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.635917:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951792.635933:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.635942:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951792.635945:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.635953:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.635965:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3dc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951792.635983:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057c22afc/0x22c73c7857bb3dc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951792.636098:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1783951792.636192:0:8433:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1698 00000100:00100000:0.0:1783951792.636281:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:83353:x1870605465340672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93941us (102197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951792.636291:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4879 00000100:00100000:2.0:1783951792.636394:0:83353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83353:1870605465340672:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783951792.636410:0:83353:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6c1:0x0] from OST, last_created [0x280000401:0x6c1:0x0]last_used is [0x280000401:0x6a2:0x0] 00000100:00100000:2.0:1783951792.636486:0:83353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83353:1870605465341184:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783951792.636534:0:83353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951792.636555:0:83353:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d9b40 going to sleep for 20 seconds 00000100:00100000:2.0:1783951792.636569:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951792.636579:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465341056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951792.636644:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951792.636675:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465341184 00000100:00100000:2.0:1783951792.636681:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465341184 00000100:00100000:2.0:1783951792.636715:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4881 00000100:00100000:2.0:1783951792.636723:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:83353:x1870605465341184:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:2.0:1783951792.636728:0:15187:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:2.0:1783951792.636763:0:15187:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1730 00000100:00100000:2.0:1783951792.638347:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:83353:x1870605465341184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1621us (1810us total) trans 4294968948 rc 0/0 00000100:00100000:2.0:1783951792.638363:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4881 00000100:00100000:2.0:1783951792.638403:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465341056 00000100:00100000:2.0:1783951792.638410:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465341056 00000100:00100000:2.0:1783951792.638435:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:2.0:1783951792.638441:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465341056:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:2.0:1783951792.638447:0:8437:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1783951792.638465:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951792.638499:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465341056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951792.638506:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:2.0:1783951792.638550:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465341056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951792.638584:0:83353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83353:1870605465341184:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783951792.638616:0:83353:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6c1:0x0]-[0x280000401:0x6e1:0x0] 00010000:00010000:2.0:1783951792.638636:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951792.638643:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087138c2a/0x22c73c7857bb3dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.638654:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951792.638658:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087138c2a/0x22c73c7857bb3dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.638667:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087138c2a/0x22c73c7857bb3dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.638684:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087138c2a/0x22c73c7857bb3dc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.638699:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087138c2a/0x22c73c7857bb3dc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951792.638718:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.638721:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951792.638722:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.639347:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.639351:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951792.639353:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951792.640825:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1783951793.313929:0:8444:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b164e3f480 x1870605465339264/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1783951802 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951793.314076:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465339264:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1057638us (1060375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951793.314089:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692 00000100:00080000:2.0:1783951793.314313:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1783951793.314322:0:3641:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff97b164e3ce00 x1870605465339264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951822 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951793.314331:0:3641:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff97b164e3ce00 x1870605465339264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951822 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951793.314338:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783951793.314361:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783951793.315976:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951793.316011:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465341312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951793.316081:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951793.316265:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465341312 00000100:00100000:0.0:1783951793.316287:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465341312 00000100:00100000:0.0:1783951793.316341:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:0.0:1783951793.316351:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465341312:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1783951793.316357:0:8445:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783951793.316389:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445249024 avail 1299009536 00000100:00100000:0.0:1783951793.316444:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465341312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951793.316451:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000100:00100000:3.0:1783951793.316533:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465341312:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1783951793.342378:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000963e4a97): req@ffff97b174af7480 x1870605465253248/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951610 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951793.342411:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465339264:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1783951793.346347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951793.346474:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465253248 00000100:00100000:0.0:1783951793.346483:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465253248 00000100:00100000:0.0:1783951793.346544:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699 00000100:00100000:0.0:1783951793.346555:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465253248:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1783951793.346563:0:26467:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783951793.346632:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445249024 avail 1299009536 00000100:00100000:0.0:1783951793.346676:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465253248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951793.346684:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699 00000100:00100000:1.0:1783951793.346811:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465253248:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783951793.632884:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951794.656827:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951794.785256:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465341440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951794.785331:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951794.785441:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465341440 00000100:00100000:1.0:1783951794.785450:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465341440 00000100:00100000:1.0:1783951794.785513:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:1.0:1783951794.785523:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465341440:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:1.0:1783951794.785544:0:11087:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1783951794.785574:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951794.785651:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465341440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951794.785658:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00080000:2.0:1783951794.785980:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951794.786020:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465341440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951794.786039:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951794.786045:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465341568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951794.786079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951794.786249:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465341568 00000100:00100000:0.0:1783951794.786255:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465341568 00000100:00100000:0.0:1783951794.786296:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:0.0:1783951794.786305:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465341568:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:0.0:1783951794.786309:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783951794.786325:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951794.786364:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465341568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951794.786370:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00080000:0.0:1783951794.786385:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951794.801107:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465341568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951795.297620:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951795.297656:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465341696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951795.298504:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951795.298912:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465341696 00000100:00100000:0.0:1783951795.298939:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465341696 00000100:00100000:0.0:1783951795.298995:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:0.0:1783951795.299005:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465341696:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1783951795.299013:0:8445:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783951795.299052:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783951795.299113:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465341696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951795.299120:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00000100:00100000:2.0:1783951795.299412:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465341696:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783951795.680799:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951796.705551:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951797.344991:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465341952:0@lo:400:kworker.0 00000100:00100000:1.0:1783951797.345073:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951797.345177:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465341824:0@lo:400:kworker.0 00000100:00100000:2.0:1783951797.345218:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951797.345299:0:83341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465341824 00000100:00100000:2.0:1783951797.345308:0:83341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465341824 00000100:00100000:2.0:1783951797.345361:0:83341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783951797.345370:0:83341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465341824:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783951797.345377:0:83341:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783951797.345436:0:83341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465341824:12345-0@lo:400:kworker.0 Request processed in 67us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951797.345444:0:83341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783951797.345476:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465341952 00000100:00100000:2.0:1783951797.345480:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465341952 00000100:00100000:2.0:1783951797.345512:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1783951797.345518:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465341952:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783951797.345522:0:66236:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783951797.347897:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465342080:0@lo:400:kworker.0 00000100:00100000:3.0:1783951797.347970:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951797.348088:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465341824:0@lo:400:kworker.0 00000100:00100000:3.0:1783951797.348127:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465342080 00000100:00100000:3.0:1783951797.348133:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465342080 00000100:00100000:3.0:1783951797.348178:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1783951797.348187:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465342080:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783951797.348194:0:68591:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783951797.348241:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465342080:12345-0@lo:400:kworker.0 Request processed in 55us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951797.348409:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1783951797.348448:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465342080:0@lo:400:kworker.0 00000100:00080000:3.0:1783951797.348492:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951797.348496:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951797.349010:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951797.349021:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465342464:0@lo:400:kworker.0 00000100:00100000:0.0:1783951797.349062:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951797.349081:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465342208:0@lo:400:kworker.0 00000100:00100000:0.0:1783951797.349094:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465342464 00000100:00100000:0.0:1783951797.349099:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465342464 00000100:00100000:3.0:1783951797.349109:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951797.349140:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951797.349146:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465342336:0@lo:400:kworker.0 00000100:00100000:3.0:1783951797.349168:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951797.349276:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:0.0:1783951797.349285:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465342464:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1783951797.349290:0:26467:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783951797.349335:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465342464:12345-0@lo:400:kworker.0 Request processed in 51us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951797.349341:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00000100:00100000:0.0:1783951797.349369:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465342464:0@lo:400:kworker.0 00000100:00100000:0.0:1783951797.349401:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465342592:0@lo:400:kworker.0 00000100:00100000:2.0:1783951797.349536:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465341952:12345-0@lo:400:kworker.0 Request processed in 4011us (4455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951797.349545:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1783951797.349567:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465342208 00000100:00100000:2.0:1783951797.349571:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465342208 00000100:00100000:2.0:1783951797.349617:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465342336 00000100:00100000:2.0:1783951797.349621:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465342336 00000100:00100000:2.0:1783951797.349659:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1783951797.349665:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465342208:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783951797.349670:0:66237:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783951797.349704:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465342208:12345-0@lo:400:kworker.0 Request processed in 39us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951797.349710:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1783951797.349723:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1783951797.349728:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465342336:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783951797.349732:0:66237:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783951797.349759:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465342336:12345-0@lo:400:kworker.0 Request processed in 31us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951797.349765:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1783951797.349849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951797.349924:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951797.349931:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465342976:0@lo:400:kworker.0 00000100:00100000:0.0:1783951797.349956:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951797.349981:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465342976 00000100:00100000:0.0:1783951797.349984:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465342976 00000100:00100000:0.0:1783951797.350017:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702 00000100:00100000:0.0:1783951797.350023:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465342976:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1783951797.350027:0:8445:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783951797.350060:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465342976:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951797.350066:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00080000:3.0:1783951797.350079:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951797.350083:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951797.350088:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465342976:0@lo:400:kworker.0 00000100:00100000:3.0:1783951797.350092:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465342720:0@lo:400:kworker.0 00000100:00100000:0.0:1783951797.350103:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465342848:0@lo:400:kworker.0 00000100:00100000:3.0:1783951797.350120:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951797.350120:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951797.350143:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465342336:0@lo:400:kworker.0 00000100:00100000:0.0:1783951797.350145:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465342848 00000100:00100000:0.0:1783951797.350148:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465342848 00000100:00100000:3.0:1783951797.350154:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465342208:0@lo:400:kworker.0 00000100:00100000:2.0:1783951797.350280:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465342592 00000100:00100000:2.0:1783951797.350285:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465342592 00000100:00100000:2.0:1783951797.350314:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465342720 00000100:00100000:2.0:1783951797.350317:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465342720 00000100:00100000:2.0:1783951797.350337:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:2.0:1783951797.350343:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465342592:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783951797.350347:0:26199:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783951797.350383:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465342592:12345-0@lo:400:kworker.0 Request processed in 39us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951797.350389:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:2.0:1783951797.350400:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:2.0:1783951797.350406:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465342720:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783951797.350410:0:26199:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783951797.350517:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465342720:12345-0@lo:400:kworker.0 Request processed in 110us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951797.350532:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:0.0:1783951797.350570:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1783951797.350579:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465342848:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1783951797.350583:0:83761:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783951797.350635:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465342848:12345-0@lo:400:kworker.0 Request processed in 58us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951797.350699:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465341952:0@lo:400:kworker.0 00000100:00100000:1.0:1783951797.350780:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951797.350787:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465343104:0@lo:400:kworker.0 00000100:00100000:1.0:1783951797.350816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951797.350850:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465343360:0@lo:400:kworker.0 00000100:00100000:1.0:1783951797.350873:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951797.350909:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465342848:0@lo:400:kworker.0 00000100:00100000:1.0:1783951797.350921:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951797.350926:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465343232:0@lo:400:kworker.0 00000100:00100000:1.0:1783951797.350947:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951797.350982:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465343104 00000100:00100000:1.0:1783951797.350986:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465343104 00000100:00100000:1.0:1783951797.351012:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465343232 00000100:00100000:1.0:1783951797.351014:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465343232 00000100:00100000:1.0:1783951797.351032:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521 00000100:00100000:1.0:1783951797.351038:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465343104:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783951797.351042:0:26204:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783951797.351074:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465343104:12345-0@lo:400:kworker.0 Request processed in 36us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951797.351087:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521 00000100:00100000:1.0:1783951797.351100:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:1.0:1783951797.351106:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465343232:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783951797.351109:0:26204:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783951797.351141:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465343232:12345-0@lo:400:kworker.0 Request processed in 35us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951797.351146:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:1.0:1783951797.351183:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465342592:0@lo:400:kworker.0 00000100:00100000:1.0:1783951797.351210:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465342720:0@lo:400:kworker.0 00000100:00100000:1.0:1783951797.351231:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465343232:0@lo:400:kworker.0 00000100:00100000:1.0:1783951797.351255:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465343104:0@lo:400:kworker.0 00000100:00100000:3.0:1783951797.351476:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465343360 00000100:00100000:3.0:1783951797.351482:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465343360 00000100:00100000:2.0:1783951797.351511:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:2.0:1783951797.351524:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465343360:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783951797.351528:0:66237:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783951797.351565:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465343360:12345-0@lo:400:kworker.0 Request processed in 43us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951797.351571:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:0.0:1783951797.351625:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:1.0:1783951797.355243:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465343360:0@lo:400:kworker.0 00000100:00080000:3.0:1783951797.355438:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951797.355444:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783951797.728865:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951797.744050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951797.744117:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447673088 00000100:00100000:2.0:1783951797.744128:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447673088 00000100:00100000:2.0:1783951797.744325:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1006 00000100:00100000:2.0:1783951797.744334:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870605447673088:12345-192.168.202.48@tcp:38:kworker.0 00000020:02000000:2.0:1783951797.744343:0:66238:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:2.0:1783951797.744378:0:66238:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp t94489280513 exp 0000000000000000 cur 3512 last 0 00000020:00000080:2.0:1783951797.744422:0:66238:0:(genops.c:1406:class_connect()) connect: client 458183b2-4c6d-478c-9fed-a955779e6611, cookie 0x22c73c7857bb3dce 00000004:00100000:2.0:1783951797.744443:0:66238:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783951797.744573:0:66238:0:(import.c:65:import_set_state_nolock()) ffff97b144764800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951797.744673:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447673088:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 337us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951797.744681:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1006 00000100:00100000:3.0:1783951797.757326:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951797.757363:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951797.757394:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951797.757427:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447673344 00000100:00100000:2.0:1783951797.757439:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447673344 00000100:00100000:1.0:1783951797.757497:0:83339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447672960 00000100:00100000:1.0:1783951797.757501:0:83339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447672960 00000100:00100000:2.0:1783951797.757502:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2523 00000100:00100000:2.0:1783951797.757511:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447673344:12345-192.168.202.48@tcp:400:kworker.0 00000020:02000000:2.0:1783951797.757519:0:26207:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783951797.757527:0:83339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 151 00000100:00100000:1.0:1783951797.757533:0:83339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447672960:12345-192.168.202.48@tcp:400:kworker.0 00000020:02000000:1.0:1783951797.757537:0:83339:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783951797.757636:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447673344:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 114us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951797.757644:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2523 00000100:00100000:0.0:1783951797.757652:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447673216 00000100:00100000:0.0:1783951797.757656:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447673216 00000100:00080000:2.0:1783951797.757682:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951797.757686:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951797.757690:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 971 00000100:00100000:0.0:1783951797.757696:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447673216:12345-192.168.202.48@tcp:400:kworker.0 00000020:02000000:0.0:1783951797.757701:0:68591:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783951797.757780:0:83339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447672960:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 246us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951797.757787:0:83339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 151 00000100:00100000:0.0:1783951797.758714:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447673216:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 1015us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951797.758724:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 971 00000100:00100000:2.0:1783951797.775573:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951797.775788:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447673472 00000100:00100000:0.0:1783951797.775824:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447673472 00000100:00100000:0.0:1783951797.775936:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1007 00000100:00100000:0.0:1783951797.775948:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:64051:x1870605447673472:12345-192.168.202.48@tcp:41:lfs.0 00000020:02000000:0.0:1783951797.775956:0:83761:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783951797.775996:0:83761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783951797.776122:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:64051:x1870605447673472:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 176us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951797.776129:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1007 00000100:00100000:3.0:1783951797.793668:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951797.793796:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447673600 00000100:00100000:1.0:1783951797.793806:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447673600 00000100:00100000:1.0:1783951797.793912:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1955 00000100:00100000:1.0:1783951797.793924:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:64051:x1870605447673600:12345-192.168.202.48@tcp:13:lfs.0 00000020:02000000:1.0:1783951797.793944:0:8437:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1783951797.793985:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951797.794051:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:64051:x1870605447673600:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 129us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951797.794058:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1955 00000100:00100000:1.0:1783951797.800543:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951797.800634:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447673728 00000100:00100000:2.0:1783951797.800644:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447673728 00000100:00100000:2.0:1783951797.800721:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4882 00000100:00100000:2.0:1783951797.800730:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2397:x1870605447673728:12345-192.168.202.48@tcp:8:lfs.0 00000020:02000000:2.0:1783951797.800738:0:26205:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:2.0:1783951797.800768:0:26205:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp t0 exp 0000000000000000 cur 3512 last 0 00000020:00000080:2.0:1783951797.800797:0:26205:0:(genops.c:1406:class_connect()) connect: client 458183b2-4c6d-478c-9fed-a955779e6611, cookie 0x22c73c7857bb3dd5 00002000:00100000:2.0:1783951797.800808:0:26205:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 458183b2-4c6d-478c-9fed-a955779e6611/ffff97b144763000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783951797.800836:0:26205:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783951797.800929:0:26205:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783951797.800955:0:26205:0:(import.c:65:import_set_state_nolock()) ffff97b144763800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951797.801027:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447673728:12345-192.168.202.48@tcp:8:lfs.0 Request processed in 296us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951797.801035:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4882 00000001:00100000:3.0:1783951797.804221:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00080000:3.0:1783951797.804237:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968949 is committed 00000100:00100000:2.0:1783951797.806486:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951797.806613:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447673856 00000100:00100000:0.0:1783951797.806622:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447673856 00000100:00100000:0.0:1783951797.806805:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1956 00000100:00100000:0.0:1783951797.806817:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:64051:x1870605447673856:12345-192.168.202.48@tcp:13:lfs.0 00000020:02000000:0.0:1783951797.806824:0:11087:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783951797.806847:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951797.806934:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:64051:x1870605447673856:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 119us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951797.806942:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1956 00000100:00100000:0.0:1783951797.856822:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951797.856849:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465343488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951797.856937:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951797.856981:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465343488 00000100:00100000:3.0:1783951797.856989:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465343488 00000100:00100000:3.0:1783951797.857130:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1783951797.857142:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465343488:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:3.0:1783951797.857149:0:8437:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783951797.857171:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951797.857236:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465343488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951797.857243:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1783951797.857283:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968949 gen 2 00000100:00100000:3.0:1783951797.857304:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465343488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951797.864472:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465343616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951797.864539:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951797.864660:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465343616 00000100:00100000:0.0:1783951797.864669:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465343616 00000100:00100000:0.0:1783951797.864719:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:0.0:1783951797.864729:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465343616:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:0.0:1783951797.864735:0:11087:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783951797.864756:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951797.864811:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465343616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951797.864829:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1783951797.864970:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465343616:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1783951797.872298:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968948 is committed 00000100:00100000:2.0:1783951798.369194:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951798.369220:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465343744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951798.369293:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951798.369406:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465343744 00000100:00100000:0.0:1783951798.369414:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465343744 00000100:00100000:0.0:1783951798.369467:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:0.0:1783951798.369476:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465343744:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1783951798.369483:0:26467:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783951798.369519:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:0.0:1783951798.369583:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465343744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951798.369613:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00000100:00100000:3.0:1783951798.369669:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465343744:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783951798.752749:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783951798.884517:0:83335:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00010000:00010000:3.0:1783951799.777170:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951799.885311:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951799.887302:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447673984 00000100:00100000:0.0:1783951799.887318:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447673984 00000100:00100000:0.0:1783951799.887450:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1008 00000100:00100000:0.0:1783951799.887463:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+5:64142:x1870605447673984:12345-192.168.202.48@tcp:101:lfs.0 00000020:02000000:0.0:1783951799.887470:0:66236:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1783951799.887488:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951799.887545:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9200/0x22c73c7857bb3ddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a0ec expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951799.893101:0:66236:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5432us 00000100:00100000:3.0:1783951799.904915:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465343872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951799.904991:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951799.905223:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465343872 00000100:00100000:0.0:1783951799.905231:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465343872 00000100:00100000:0.0:1783951799.905299:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:0.0:1783951799.905309:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465343872:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:0.0:1783951799.905318:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783951799.905348:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951799.905407:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465343872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951799.905414:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:0.0:1783951799.905459:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465343872:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783951799.905569:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951799.921158:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465344000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951799.921235:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951799.923900:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465344000 00000100:00100000:1.0:1783951799.923916:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465344000 00000100:00100000:1.0:1783951799.923990:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:1.0:1783951799.924002:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465344000:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:1.0:1783951799.924009:0:8437:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1783951799.924039:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951799.924118:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465344000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951799.924126:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00080000:3.0:1783951799.924474:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951799.924534:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465344000:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783951799.934785:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5600/0x22c73c7857bb3de3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951799.934808:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5600/0x22c73c7857bb3de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951799.934823:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5600/0x22c73c7857bb3de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951799.934895:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951799.934899:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1783951799.934954:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5600/0x22c73c7857bb3de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951799.935005:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9200/0x22c73c7857bb3ddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0ec expref: 7 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951799.935027:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5600/0x22c73c7857bb3de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0ec expref: 6 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951799.935036:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531c300) 00010000:00010000:1.0:1783951799.935038:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951799.935041:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1767e5600, rc 0) 00000100:00100000:1.0:1783951799.935116:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:64142:x1870605447673984:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 47655us (49815us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951799.935124:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1008 00000100:00100000:1.0:1783951799.957444:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951799.957657:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447674112 00000100:00100000:3.0:1783951799.957690:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447674112 00000100:00100000:3.0:1783951799.957765:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1009 00000100:00100000:3.0:1783951799.957778:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:64142:x1870605447674112:12345-192.168.202.48@tcp:41:lfs.0 00000020:02000000:3.0:1783951799.957787:0:66237:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1783951799.957847:0:66237:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:3.0:1783951799.958050:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:64142:x1870605447674112:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 274us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951799.958058:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1009 00000100:00100000:2.0:1783951799.972458:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951799.972630:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447674240 00000100:00100000:3.0:1783951799.972638:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447674240 00000100:00100000:3.0:1783951799.972754:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1010 00000100:00100000:3.0:1783951799.972764:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:64142:x1870605447674240:12345-192.168.202.48@tcp:41:lfs.0 00000020:02000000:3.0:1783951799.972771:0:67035:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1783951799.972801:0:67035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951799.972879:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:64142:x1870605447674240:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 116us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951799.972887:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1010 00000100:00080000:0.0:1783951799.977327:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951799.982640:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951799.983492:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447674368 00000100:00100000:1.0:1783951799.983504:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447674368 00000100:00100000:1.0:1783951799.983577:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1961 00000100:00100000:1.0:1783951799.983610:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:64142:x1870605447674368:12345-192.168.202.48@tcp:13:lfs.0 00000020:02000000:1.0:1783951799.983616:0:11087:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1783951799.983637:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951799.983699:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:64142:x1870605447674368:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 115us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951799.983704:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1961 00000100:00080000:0.0:1783951799.984270:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951799.991194:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951799.991285:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447674496 00000100:00100000:0.0:1783951799.991295:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447674496 00000100:00100000:0.0:1783951799.991354:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1962 00000100:00100000:0.0:1783951799.991365:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:64142:x1870605447674496:12345-192.168.202.48@tcp:13:lfs.0 00000020:02000000:0.0:1783951799.991371:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783951799.991406:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951799.991476:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:64142:x1870605447674496:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 114us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951799.991482:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1962 00000100:00100000:2.0:1783951800.016504:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951800.016877:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447674624 00000100:00100000:1.0:1783951800.016888:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447674624 00000100:00100000:2.0:1783951800.017349:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1011 00000100:00100000:2.0:1783951800.017362:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:63658:x1870605447674624:12345-192.168.202.48@tcp:101:multiop.0 00000020:02000000:2.0:1783951800.017369:0:66238:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1783951800.017387:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951800.017410:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3dea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a0f3 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.017472:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.017483:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.017492:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.017502:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3df8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.017507:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3df8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.017511:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3df8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018095:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73800/0x22c73c7857bb3dff lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018104:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73800/0x22c73c7857bb3dff lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018122:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73800/0x22c73c7857bb3dff lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951800.018149:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:2.0:1783951800.018154:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1783951800.018188:0:66238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73800/0x22c73c7857bb3dff lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018200:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73800/0x22c73c7857bb3dff lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018210:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018215:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018219:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018223:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018227:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc72c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951800.018230:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018235:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018244:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531c300) 00010000:00010000:2.0:1783951800.018246:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951800.018256:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018262:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3df1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018275:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3df8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018282:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3df8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018288:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3df8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018294:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951800.018297:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3df8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018303:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3df8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018311:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff97b04d802400) 00010000:00010000:2.0:1783951800.018313:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951800.018315:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3df8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018320:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3df8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018351:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3dea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0f3 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018373:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73800/0x22c73c7857bb3dff lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0f3 expref: 7 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951800.018379:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff97b04d802a00) 00010000:00010000:2.0:1783951800.018382:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951800.018384:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14dc73800, rc 0) 00000100:00100000:2.0:1783951800.018485:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:63658:x1870605447674624:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1126us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951800.018491:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1011 00000100:00100000:2.0:1783951800.416754:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951800.416773:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465344128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951800.416914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951800.417066:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465344128 00000100:00100000:0.0:1783951800.417072:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465344128 00000100:00100000:0.0:1783951800.417120:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:0.0:1783951800.417127:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465344128:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1783951800.417134:0:8445:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783951800.417175:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783951800.417229:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465344128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951800.417235:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00000100:00100000:3.0:1783951800.417300:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465344128:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783951800.800737:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951801.824899:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951802.467871:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465344512:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.467941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951802.467976:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465345024:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468003:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951802.468022:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465345536:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468042:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951802.468065:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783951802.468084:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465344640:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468107:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951802.468125:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465345152:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468163:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951802.468179:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465345664:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951802.468241:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465344512 00000100:00100000:3.0:1783951802.468248:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465344512 00000100:00100000:3.0:1783951802.468297:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465344640 00000100:00100000:3.0:1783951802.468300:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465344640 00000100:00100000:3.0:1783951802.468321:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1783951802.468330:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15145c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465344512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468385:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15145c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465344512:12345-0@lo:400:kworker.0 Request processed in 57us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951802.468392:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1783951802.468408:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1783951802.468415:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465344640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468444:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465344640:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951802.468450:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1783951802.468468:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465345024 00000100:00100000:3.0:1783951802.468472:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465345024 00000100:00100000:3.0:1783951802.468491:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465345536 00000100:00100000:3.0:1783951802.468494:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465345536 00000100:00100000:3.0:1783951802.468512:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465345152 00000100:00100000:3.0:1783951802.468514:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465345152 00000100:00100000:3.0:1783951802.468534:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465345664 00000100:00100000:3.0:1783951802.468537:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465345664 00000100:00100000:3.0:1783951802.468569:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1783951802.468575:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465345024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468633:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15145c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465345024:12345-0@lo:400:kworker.0 Request processed in 58us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951802.468638:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1783951802.468649:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:3.0:1783951802.468653:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465345536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468680:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465345536:12345-0@lo:400:kworker.0 Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951802.468685:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:3.0:1783951802.468694:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:3.0:1783951802.468700:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465345152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468726:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465345152:12345-0@lo:400:kworker.0 Request processed in 25us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951802.468731:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:3.0:1783951802.468741:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:3.0:1783951802.468748:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465345664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468769:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465345664:12345-0@lo:400:kworker.0 Request processed in 23us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951802.468774:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00080000:3.0:1783951802.468794:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951802.468797:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951802.468800:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951802.468802:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951802.468850:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465344640:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468860:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465345152:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468879:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465345664:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468887:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465344512:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468895:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465345024:0@lo:400:kworker.0 00000100:00100000:3.0:1783951802.468903:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968948 gen 2 00000100:00100000:3.0:1783951802.468916:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465345536:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469043:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dc62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465344384:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469080:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951802.469109:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465344896:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951802.469151:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465345408:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469173:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951802.469192:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1783951802.469197:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dc61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465344256:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469249:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951802.469276:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465344768:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469300:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951802.469317:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465345280:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951802.469355:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465345792:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469377:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951802.469453:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465344896 00000100:00100000:0.0:1783951802.469459:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465344896 00000100:00100000:0.0:1783951802.469485:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465345408 00000100:00100000:0.0:1783951802.469488:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465345408 00000100:00100000:0.0:1783951802.469506:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:0.0:1783951802.469513:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465344896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469556:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465344896:12345-0@lo:400:kworker.0 Request processed in 43us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951802.469563:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:0.0:1783951802.469579:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:0.0:1783951802.469584:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465345408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469645:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465345408:12345-0@lo:400:kworker.0 Request processed in 61us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951802.469650:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00100000:0.0:1783951802.469671:0:83341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465344256 00000100:00100000:0.0:1783951802.469674:0:83341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465344256 00000100:00100000:0.0:1783951802.469696:0:83341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783951802.469702:0:83341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465344256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469729:0:83341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465344256:12345-0@lo:400:kworker.0 Request processed in 28us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951802.469735:0:83341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783951802.469759:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465344384 00000100:00100000:0.0:1783951802.469763:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465344384 00000100:00100000:0.0:1783951802.469791:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465344768 00000100:00100000:0.0:1783951802.469793:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465344768 00000100:00100000:0.0:1783951802.469805:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465345280 00000100:00100000:0.0:1783951802.469808:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465345280 00000100:00100000:0.0:1783951802.469819:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465345792 00000100:00100000:0.0:1783951802.469821:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465345792 00000100:00100000:0.0:1783951802.469848:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:0.0:1783951802.469855:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465344384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469886:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465344384:12345-0@lo:400:kworker.0 Request processed in 33us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951802.469892:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:0.0:1783951802.469903:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1783951802.469908:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465344768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469932:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465344768:12345-0@lo:400:kworker.0 Request processed in 23us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951802.469947:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1783951802.469961:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1783951802.469966:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465345280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.469994:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465345280:12345-0@lo:400:kworker.0 Request processed in 28us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951802.470000:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1783951802.470012:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1783951802.470018:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465345792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.470044:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465345792:12345-0@lo:400:kworker.0 Request processed in 26us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951802.470049:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00080000:0.0:1783951802.470078:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951802.470081:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951802.470105:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dc61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465344256:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.470116:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465344768:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.470126:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465345280:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.470135:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465345792:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.470144:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dc62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465344384:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.470153:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465344896:0@lo:400:kworker.0 00000100:00100000:0.0:1783951802.470162:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465345408:0@lo:400:kworker.0 00000100:00100000:2.0:1783951802.846052:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951802.846093:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447674880 00000100:00100000:2.0:1783951802.846103:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447674880 00000100:00100000:2.0:1783951802.846189:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1012 00000100:00100000:2.0:1783951802.846200:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:64260:x1870605447674880:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:2.0:1783951802.846254:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783951802.846283:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73800/0x22c73c7857bb3dff lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0f3 expref: 7 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846301:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff97b04d802a00) 00010000:00010000:2.0:1783951802.846319:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5600/0x22c73c7857bb3de3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0ec expref: 6 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846356:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531c300) 00010000:00010000:2.0:1783951802.846366:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951802.846404:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846417:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846427:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846438:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846444:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846449:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846521:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3e14 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846539:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3e14 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846546:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3e14 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783951802.846805:0:66238:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5c:0x0].2, 64 off8320 00000004:00080000:2.0:1783951802.846821:0:66238:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3517789232370ns, next at 3518789230332ns, rc = 0 00010000:00010000:2.0:1783951802.846889:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846899:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846907:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846914:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.846921:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848011:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848072:0:66238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951802.848111:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3e14 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848118:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3e14 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848125:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3e14 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848131:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951802.848135:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3e14 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848143:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3e14 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848183:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff97b04d802900) 00010000:00010000:2.0:1783951802.848187:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783951802.848192:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3e14 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848199:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73e00/0x22c73c7857bb3e14 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848219:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848226:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848231:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848237:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848242:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc72c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951802.848245:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848251:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848259:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d802c00) 00010000:00010000:2.0:1783951802.848262:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951802.848266:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848281:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72c00/0x22c73c7857bb3e06 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951802.848298:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c56be8f4 reply state 00000000577f4c98 transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848309:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951802.848315:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff97b04d802500) 00010000:00010000:2.0:1783951802.848317:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951802.848319:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783951802.848429:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:64260:x1870605447674880:12345-192.168.202.48@tcp:36:rm.0 Request processed in 2227us (2384us total) trans 98784247809 rc 0/0 00000100:00100000:2.0:1783951802.848438:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1012 00000100:00080000:2.0:1783951802.848473:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783951802.850459:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951802.850472:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951802.850481:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc72800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951802.850485:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951802.850493:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951802.850508:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff97b04d802900) 00010000:00010000:3.0:1783951802.850510:0:7459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783951802.850513:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951802.850519:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e1b lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951802.850538:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951802.850540:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951802.850542:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951802.850604:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951802.874128:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951802.874184:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951802.874210:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951802.874242:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951802.874279:0:83339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447675008 00000100:00100000:1.0:1783951802.874290:0:83339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447675008 00000100:00100000:3.0:1783951802.874328:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447675136 00000100:00100000:3.0:1783951802.874337:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447675136 00000100:00100000:1.0:1783951802.874367:0:83339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 153 00000100:00100000:1.0:1783951802.874387:0:83339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447675008:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951802.874456:0:83339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447675008:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951802.874463:0:83339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 153 00000100:00100000:3.0:1783951802.874482:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 978 00000100:00100000:3.0:1783951802.874489:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447675136:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951802.874544:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447675136:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 56us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951802.874551:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 978 00000100:00080000:3.0:1783951802.874568:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951802.883622:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447675392 00000100:00100000:2.0:1783951802.883636:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447675392 00000100:00100000:2.0:1783951802.885122:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447675264 00000100:00100000:2.0:1783951802.885132:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447675264 00000100:00100000:2.0:1783951802.885173:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2528 00000100:00100000:2.0:1783951802.885183:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447675392:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951802.885267:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447675392:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 86us (11056us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951802.885275:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2528 00000100:00100000:2.0:1783951802.885294:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2529 00000100:00100000:2.0:1783951802.885302:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447675264:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951802.885359:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447675264:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 57us (11115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951802.885366:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2529 00000100:00080000:0.0:1783951802.890140:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951802.890150:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951802.989403:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465345920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951802.989472:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951802.989534:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465345920 00000100:00100000:3.0:1783951802.989541:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465345920 00000100:00100000:3.0:1783951802.989621:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:3.0:1783951802.989631:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465345920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951802.989659:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951802.989703:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465345920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951802.989710:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00080000:3.0:1783951802.989728:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951802.989758:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465345920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951802.992034:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951802.992055:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465346048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951802.992116:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951802.992439:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465346048 00000100:00100000:0.0:1783951802.992447:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465346048 00000100:00100000:0.0:1783951802.992491:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:0.0:1783951802.992499:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465346048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951802.992526:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951802.992566:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465346048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951802.992573:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1783951802.992733:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465346048:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783951802.997258:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951803.489090:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951803.489114:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465346176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951803.489183:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951803.489282:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465346176 00000100:00100000:0.0:1783951803.489289:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465346176 00000100:00100000:0.0:1783951803.489356:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:0.0:1783951803.489364:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465346176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951803.489401:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:0.0:1783951803.489453:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465346176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951803.489460:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:00100000:3.0:1783951803.489628:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465346176:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783951803.873032:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951804.896877:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951805.025128:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465346304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951805.025216:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951805.025367:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465346304 00000100:00100000:0.0:1783951805.025374:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465346304 00000100:00100000:0.0:1783951805.025448:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:0.0:1783951805.025458:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465346304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951805.025487:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951805.025544:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465346304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951805.025564:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:0.0:1783951805.025628:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465346304:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783951805.025692:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951805.026162:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465346432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951805.026201:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951805.026582:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465346432 00000100:00100000:3.0:1783951805.026608:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465346432 00000100:00100000:3.0:1783951805.026681:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:3.0:1783951805.026689:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dc08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465346432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951805.026711:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783951805.026840:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951805.027132:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dc08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465346432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 444us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951805.027140:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:2.0:1783951805.032899:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465346432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951805.541461:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465346560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951805.541548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951805.541843:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465346560 00000100:00100000:0.0:1783951805.541852:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465346560 00000100:00100000:2.0:1783951805.541971:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1783951805.541980:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465346560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951805.542018:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951805.542070:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465346560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951805.542077:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00100000:3.0:1783951805.542578:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465346560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783951805.921781:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951806.944964:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951807.586149:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951807.586244:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951807.586265:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465347072:0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.586356:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951807.586402:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465346944:0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.586427:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951807.586453:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951807.586458:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465346816:0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.586500:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951807.586532:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465347072 00000100:00100000:2.0:1783951807.586540:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465347072 00000100:00100000:2.0:1783951807.586605:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465346944 00000100:00100000:2.0:1783951807.586608:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465346944 00000100:00100000:2.0:1783951807.586627:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465346816 00000100:00100000:2.0:1783951807.586630:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465346816 00000100:00100000:2.0:1783951807.586654:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1783951807.586662:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465347072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.586712:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dc09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465347072:12345-0@lo:400:kworker.0 Request processed in 50us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951807.586718:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1783951807.586735:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1783951807.586741:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465346944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.586782:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465346944:12345-0@lo:400:kworker.0 Request processed in 41us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951807.586783:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465346688:0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.586799:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1783951807.586812:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1783951807.586818:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465346816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951807.587053:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465347328:0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951807.587111:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465346816:12345-0@lo:400:kworker.0 Request processed in 294us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951807.587118:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1783951807.587134:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465347584:0@lo:400:kworker.0 00000100:00080000:2.0:1783951807.587142:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951807.587145:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951807.587161:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951807.587164:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465347200:0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587177:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465348096:0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951807.587194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951807.587208:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465347712:0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587224:0:83341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465346688 00000100:00100000:3.0:1783951807.587228:0:83341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465346688 00000100:00100000:2.0:1783951807.587228:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951807.587242:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465348224:0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587255:0:83341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783951807.587260:0:83341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465346688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.587263:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951807.587291:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465347072:0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587292:0:83341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465346688:12345-0@lo:400:kworker.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951807.587297:0:83341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783951807.587317:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465347200 00000100:00100000:2.0:1783951807.587320:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465347200 00000100:00100000:3.0:1783951807.587322:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465347584 00000100:00100000:3.0:1783951807.587330:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465347584 00000100:00100000:2.0:1783951807.587344:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465347712 00000100:00100000:2.0:1783951807.587347:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465347712 00000100:00100000:3.0:1783951807.587353:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465348096 00000100:00100000:3.0:1783951807.587355:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465348096 00000100:00100000:2.0:1783951807.587358:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465348224 00000100:00100000:2.0:1783951807.587360:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465348224 00000100:00100000:3.0:1783951807.587372:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:2.0:1783951807.587372:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1783951807.587378:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465347584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.587378:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465347200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587407:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465347584:12345-0@lo:400:kworker.0 Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951807.587408:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465347200:12345-0@lo:400:kworker.0 Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951807.587413:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:2.0:1783951807.587414:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1783951807.587425:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:2.0:1783951807.587425:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1783951807.587431:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465348096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.587431:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465347712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587455:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465348096:12345-0@lo:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951807.587455:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465347712:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951807.587462:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:2.0:1783951807.587462:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1783951807.587473:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:2.0:1783951807.587478:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465348224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587494:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465347584:0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587503:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465348096:0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.587512:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465346688:0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.587679:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465348224:12345-0@lo:400:kworker.0 Request processed in 201us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951807.587691:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00080000:2.0:1783951807.587715:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951807.587718:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951807.587733:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465347200:0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.587741:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465347712:0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.587749:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465348224:0@lo:400:kworker.0 00000100:00100000:1.0:1783951807.588359:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465346944:0@lo:400:kworker.0 00000100:00100000:1.0:1783951807.588377:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465347456:0@lo:400:kworker.0 00000100:00100000:1.0:1783951807.588411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951807.588443:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465347968:0@lo:400:kworker.0 00000100:00100000:1.0:1783951807.588464:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951807.588485:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465346816:0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.588540:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465347456 00000100:00100000:3.0:1783951807.588780:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465347456 00000100:00100000:3.0:1783951807.588842:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465347968 00000100:00100000:3.0:1783951807.588845:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465347968 00000100:00100000:3.0:1783951807.588867:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:3.0:1783951807.588873:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465347456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.588922:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465347456:12345-0@lo:400:kworker.0 Request processed in 50us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951807.588928:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:3.0:1783951807.588940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:3.0:1783951807.588957:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465347968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.588985:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465347968:12345-0@lo:400:kworker.0 Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951807.588990:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:3.0:1783951807.589024:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465347456:0@lo:400:kworker.0 00000100:00100000:3.0:1783951807.589033:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465347968:0@lo:400:kworker.0 00000100:00080000:2.0:1783951807.589655:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951807.590781:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951807.590840:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465347840:0@lo:400:kworker.0 00000100:00100000:0.0:1783951807.590871:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951807.591300:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465347328 00000100:00100000:2.0:1783951807.591308:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465347328 00000100:00100000:2.0:1783951807.591353:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465347840 00000100:00100000:2.0:1783951807.591357:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465347840 00000100:00100000:2.0:1783951807.591379:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:2.0:1783951807.591386:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465347328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.591444:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465347328:12345-0@lo:400:kworker.0 Request processed in 59us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951807.591451:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:2.0:1783951807.591469:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:2.0:1783951807.591474:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465347840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.591518:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465347840:12345-0@lo:400:kworker.0 Request processed in 43us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951807.591524:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00100000:2.0:1783951807.591563:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465347328:0@lo:400:kworker.0 00000100:00100000:2.0:1783951807.591574:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465347840:0@lo:400:kworker.0 00010000:00010000:0.0:1783951807.978353:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951807.990036:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951807.990076:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951807.990119:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951807.990148:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951807.990173:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951807.990199:0:83339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447675520 00000100:00100000:0.0:1783951807.990209:0:83339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447675520 00000100:00100000:0.0:1783951807.990257:0:83339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 155 00000100:00100000:0.0:1783951807.990267:0:83339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447675520:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951807.990336:0:83339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447675520:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 69us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951807.990344:0:83339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 155 00000100:00100000:0.0:1783951807.990376:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447675776 00000100:00100000:0.0:1783951807.990380:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447675776 00000100:00100000:0.0:1783951807.990415:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447675648 00000100:00100000:0.0:1783951807.990418:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447675648 00000100:00100000:0.0:1783951807.990438:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 985 00000100:00100000:0.0:1783951807.990452:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447675776:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951807.990483:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447675776:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 33us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951807.990500:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 985 00000100:00100000:0.0:1783951807.990515:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 986 00000100:00100000:0.0:1783951807.990521:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447675648:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951807.990558:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447675648:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 37us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951807.990565:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 986 00000100:00100000:0.0:1783951807.990583:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447676032 00000100:00100000:0.0:1783951807.990608:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447676032 00000100:00100000:0.0:1783951807.990633:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447675904 00000100:00100000:0.0:1783951807.990636:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447675904 00000100:00100000:0.0:1783951807.990652:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2534 00000100:00100000:0.0:1783951807.990659:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447676032:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951807.990685:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447676032:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951807.990691:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2534 00000100:00100000:0.0:1783951807.990702:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2535 00000100:00100000:0.0:1783951807.990709:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447675904:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951807.990731:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447675904:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 23us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951807.990737:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2535 00000100:00080000:0.0:1783951807.990878:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951807.990899:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951807.990902:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951807.990904:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951808.096890:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951808.096916:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465348352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951808.096992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951808.097271:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465348352 00000100:00100000:0.0:1783951808.097280:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465348352 00000100:00100000:0.0:1783951808.097345:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:0.0:1783951808.097353:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465348352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951808.097384:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951808.097529:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465348352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951808.097544:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000004:00080000:0.0:1783951808.098360:0:83353:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3523040770787ns, next at 3524040767849ns, rc = 0 00000100:00100000:2.0:1783951808.099272:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951808.099304:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465348480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951808.099374:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951808.099512:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465348480 00000100:00100000:1.0:1783951808.099520:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465348480 00000100:00100000:1.0:1783951808.099573:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:1.0:1783951808.099581:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465348480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951808.099630:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951808.099670:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465348480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951808.099687:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:2.0:1783951808.100175:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465348480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951808.103740:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465348352:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1783951808.106837:0:83335:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1783951808.106884:0:83335:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247809 is committed 00000004:00080000:1.0:1783951808.106890:0:83335:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1783951808.106961:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951808.106972:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951808.106980:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951808.106986:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783951808.106991:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951808.106999:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951808.107020:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff97b04d802500) 00010000:00010000:0.0:1783951808.107023:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951808.107040:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951808.107046:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e0d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951808.107229:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951808.107246:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465348608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783951808.107313:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951808.107982:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465348608 00000100:00100000:1.0:1783951808.107991:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465348608 00000100:00100000:1.0:1783951808.108045:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4883 00000100:00100000:1.0:1783951808.108056:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465348608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783951808.108084:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1698 count 1 00010000:00010000:1.0:1783951808.108106:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951808.108126:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb39c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0c9 expref: 5 pid: 26201 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951808.108134:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=219s v=(0 0) 00010000:00010000:1.0:1783951808.108138:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951808.108143:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951808.108173:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb39c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0c9 expref: 5 pid: 26201 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951808.108187:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb39c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0c9 expref: 5 pid: 26201 timeout: 3623 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951808.108217:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1870605465348736:192.168.202.48@tcp:104: 00000100:00100000:1.0:1783951808.108348:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174677240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951808.120657:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1870605465348736:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783951808.120685:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951808.121701:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951808.121814:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447676160 00000100:00100000:2.0:1783951808.121823:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447676160 00010000:00010000:2.0:1783951808.121866:0:22092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb39c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0c9 expref: 6 pid: 26201 timeout: 3623 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951808.121939:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2538 00000100:00100000:2.0:1783951808.121950:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447676160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951808.121966:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951808.121971:0:22092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb39c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0c9 expref: 6 pid: 26201 timeout: 3623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951808.121985:0:22092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb39c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0c9 expref: 6 pid: 26201 timeout: 3623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951808.122009:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb39c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0c9 expref: 6 pid: 26201 timeout: 3623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951808.122026:0:22092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951808.122030:0:22092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783951808.122035:0:22092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951808.122057:0:22092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951808.122080:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951808.122136:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447676160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 187us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951808.122144:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2538 00010000:00010000:1.0:1783951808.122251:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951808.122259:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951808.122265:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951808.122270:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951808.122285:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783951808.122461:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465348608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14406us (15147us total) trans 4294968949 rc 0/0 00000100:00100000:1.0:1783951808.122469:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4883 00010000:00010000:2.0:1783951808.122820:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951808.122835:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951808.122843:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951808.122847:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951808.122856:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951808.122869:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951808.122877:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cfb0f7b/0x22c73c7857bb3e22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951808.122894:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951808.122903:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951808.122905:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783951808.122941:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97b14dc61500/2, rc 0, transno 4294968949 00000100:00100000:2.0:1783951808.122948:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465348608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783951808.610884:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465348864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951808.610973:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951808.611061:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465348864 00000100:00100000:3.0:1783951808.611070:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465348864 00000100:00100000:3.0:1783951808.611133:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:3.0:1783951808.611143:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465348864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783951808.611177:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:3.0:1783951808.614484:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465348864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3325us (3494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951808.614499:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00100000:2.0:1783951808.618649:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465348864:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783951808.992962:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951810.016824:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783951810.074983:0:84066:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 10:10:09 (1783951809) 00000100:00100000:3.0:1783951810.168652:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465348992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951810.168736:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951810.168798:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951810.168805:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465349120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951810.168829:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951810.169169:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465348992 00000100:00100000:3.0:1783951810.169177:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465348992 00000100:00100000:3.0:1783951810.169227:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465349120 00000100:00100000:3.0:1783951810.169231:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465349120 00000100:00100000:3.0:1783951810.169247:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:3.0:1783951810.169271:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465348992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951810.169302:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951810.169346:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465348992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951810.169354:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:3.0:1783951810.169370:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:3.0:1783951810.169376:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465349120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951810.169391:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951810.169416:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465349120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951810.169422:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00080000:3.0:1783951810.169435:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951810.169438:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951810.169467:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465349120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951810.169480:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465348992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951810.657015:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465349248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951810.657138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951810.657420:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465349248 00000100:00100000:3.0:1783951810.657431:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465349248 00000100:00100000:3.0:1783951810.657737:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:3.0:1783951810.657748:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465349248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951810.657809:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951810.657939:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465349248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951810.657956:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00100000:1.0:1783951810.662029:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465349248:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783951811.045514:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783951811.659901:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968949 is committed 00000100:00100000:2.0:1783951811.778546:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951811.778795:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447676288 00000100:00100000:1.0:1783951811.778809:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447676288 00000100:00100000:1.0:1783951811.778899:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1013 00000100:00100000:1.0:1783951811.778913:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+5:64848:x1870605447676288:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1783951811.778943:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1783951811.778945:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783951811.778972:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5a00/0x22c73c7857bb3e29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a0fa expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951811.779072:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5c00/0x22c73c7857bb3e30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951811.779090:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5c00/0x22c73c7857bb3e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951811.779105:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5c00/0x22c73c7857bb3e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951811.779164:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951811.779168:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1783951811.779193:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5c00/0x22c73c7857bb3e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951811.779622:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5a00/0x22c73c7857bb3e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0fa expref: 7 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951811.779644:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5c00/0x22c73c7857bb3e30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0fa expref: 6 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951811.779673:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150f45900) 00010000:00010000:1.0:1783951811.779676:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951811.779680:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1767e5c00, rc 0) 00000100:00100000:1.0:1783951811.779771:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:64848:x1870605447676288:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 860us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951811.779779:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1013 00000100:00100000:0.0:1783951811.790121:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951811.790311:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447676416 00000100:00100000:2.0:1783951811.790324:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447676416 00000100:00100000:2.0:1783951811.790397:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1014 00000100:00100000:2.0:1783951811.790410:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:64848:x1870605447676416:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:2.0:1783951811.790469:0:66238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:2.0:1783951811.790570:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:64848:x1870605447676416:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 162us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951811.790579:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1014 00000100:00100000:3.0:1783951811.794401:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951811.794651:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447676544 00000100:00100000:2.0:1783951811.794665:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447676544 00000100:00100000:2.0:1783951811.794758:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1015 00000100:00100000:2.0:1783951811.794772:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:64848:x1870605447676544:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:2.0:1783951811.794828:0:68591:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951811.794924:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:64848:x1870605447676544:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 155us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951811.794933:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1015 00000100:00080000:3.0:1783951811.797259:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951811.801955:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951811.802017:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447676672 00000100:00100000:0.0:1783951811.802031:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447676672 00000100:00100000:0.0:1783951811.802121:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1971 00000100:00100000:0.0:1783951811.802134:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:64848:x1870605447676672:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783951811.802173:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951811.802270:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:64848:x1870605447676672:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 137us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951811.802278:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1971 00000100:00080000:3.0:1783951811.802354:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951811.805103:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951811.805323:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447676800 00000100:00100000:3.0:1783951811.805337:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447676800 00000100:00100000:3.0:1783951811.805427:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1972 00000100:00100000:3.0:1783951811.805442:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:64848:x1870605447676800:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783951811.805478:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783951811.805496:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951811.805569:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:64848:x1870605447676800:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 132us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951811.805577:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1972 00000100:00100000:3.0:1783951811.865814:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951811.867200:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447676928 00000100:00100000:1.0:1783951811.867217:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447676928 00000100:00100000:1.0:1783951811.867291:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:1.0:1783951811.867303:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:458183b2-4c6d-478c-9fed-a955779e6611+6:64855:x1870605447676928:12345-192.168.202.48@tcp:700:mcreate.0 00000100:00100000:1.0:1783951811.867419:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:458183b2-4c6d-478c-9fed-a955779e6611+6:64855:x1870605447676928:12345-192.168.202.48@tcp:700:mcreate.0 Request processed in 117us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951811.867429:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:0.0:1783951811.874267:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951811.874342:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447677184 00000100:00100000:3.0:1783951811.874358:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447677184 00000100:00100000:3.0:1783951811.874426:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1016 00000100:00100000:3.0:1783951811.874440:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:64855:x1870605447677184:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00010000:3.0:1783951811.874515:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951811.874545:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5c00/0x22c73c7857bb3e30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0fa expref: 6 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.874567:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150f45900) 00010000:00010000:3.0:1783951811.874619:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951811.874705:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e37 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.874718:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.874729:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.874762:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.874771:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.874777:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.875622:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e37 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.875636:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e37 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.875643:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e37 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.875649:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ea600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951811.875654:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e37 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.875661:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e37 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.875673:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:3.0:1783951811.875677:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951811.875762:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e37 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.875769:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e37 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951811.875795:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000438b0b37 reply state 000000006185ddf7 transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.875807:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.875815:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b150d9e000) 00010000:00010000:3.0:1783951811.875817:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951811.875820:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951811.876075:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+7:64855:x1870605447677184:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 1634us (1816us total) trans 98784247810 rc 0/0 00000100:00100000:3.0:1783951811.876085:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1016 00000100:00100000:3.0:1783951811.913406:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951811.913741:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447677312 00000100:00100000:2.0:1783951811.913762:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447677312 00000100:00100000:2.0:1783951811.913825:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1017 00000100:00100000:2.0:1783951811.913838:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:64858:x1870605447677312:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:3.0:1783951811.913895:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951811.913920:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a101 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.913990:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ebe00/0x22c73c7857bb3e4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.914004:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ebe00/0x22c73c7857bb3e4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.914015:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ebe00/0x22c73c7857bb3e4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951811.914059:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951811.914063:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1783951811.914083:0:66238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ebe00/0x22c73c7857bb3e4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.914351:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea600/0x22c73c7857bb3e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a101 expref: 9 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.914371:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ebe00/0x22c73c7857bb3e4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a101 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.914379:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:3.0:1783951811.914382:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951811.914385:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762ebe00, rc 0) 00000100:00100000:3.0:1783951811.914579:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:64858:x1870605447677312:12345-192.168.202.48@tcp:101:rm.0 Request processed in 743us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951811.914619:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1017 00000100:00100000:3.0:1783951811.917870:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951811.918493:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447677440 00000100:00100000:2.0:1783951811.918504:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447677440 00000100:00100000:2.0:1783951811.918556:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1018 00000100:00100000:2.0:1783951811.918566:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:64858:x1870605447677440:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:2.0:1783951811.918604:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951811.918627:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa200/0x22c73c7857bb3e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a108 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918713:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918727:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918739:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918761:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab400/0x22c73c7857bb3e61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918769:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab400/0x22c73c7857bb3e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918776:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab400/0x22c73c7857bb3e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918860:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aac00/0x22c73c7857bb3e68 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918882:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aac00/0x22c73c7857bb3e68 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918890:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aac00/0x22c73c7857bb3e68 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951811.918935:0:68591:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x1:0x0]: returning size 0 00000004:00200000:2.0:1783951811.918940:0:68591:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1783951811.918958:0:68591:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aac00/0x22c73c7857bb3e68 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918969:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aac00/0x22c73c7857bb3e68 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918978:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918983:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918989:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.918995:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919000:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aa600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951811.919005:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919011:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919032:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:2.0:1783951811.919034:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951811.919038:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919044:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919058:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab400/0x22c73c7857bb3e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919064:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab400/0x22c73c7857bb3e61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919068:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab400/0x22c73c7857bb3e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919073:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413ab400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951811.919076:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab400/0x22c73c7857bb3e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919081:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab400/0x22c73c7857bb3e61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919088:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b150d9e000) 00010000:00010000:2.0:1783951811.919090:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951811.919092:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab400/0x22c73c7857bb3e61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919097:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab400/0x22c73c7857bb3e61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919135:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa200/0x22c73c7857bb3e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a108 expref: 10 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919149:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aac00/0x22c73c7857bb3e68 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a108 expref: 9 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.919157:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff97b04d805f00) 00010000:00010000:2.0:1783951811.919159:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951811.919162:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1413aac00, rc 0) 00000100:00100000:2.0:1783951811.919230:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+9:64858:x1870605447677440:12345-192.168.202.48@tcp:101:rm.0 Request processed in 665us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951811.919237:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1018 00000100:00100000:1.0:1783951811.924139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951811.924218:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447677696 00000100:00100000:3.0:1783951811.924227:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447677696 00000100:00100000:3.0:1783951811.924324:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1019 00000100:00100000:3.0:1783951811.924336:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:64858:x1870605447677696:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:3.0:1783951811.924392:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783951811.924420:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aac00/0x22c73c7857bb3e68 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a108 expref: 9 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924438:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff97b04d805f00) 00010000:00010000:3.0:1783951811.924454:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ebe00/0x22c73c7857bb3e4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a101 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924463:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:3.0:1783951811.924484:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951811.924508:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eaa00/0x22c73c7857bb3e6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924521:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eaa00/0x22c73c7857bb3e6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924531:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eaa00/0x22c73c7857bb3e6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924543:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924551:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924556:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924660:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e7d lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924669:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e7d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924676:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e7d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924953:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924964:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924982:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924990:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.924996:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925002:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925021:0:83761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951811.925039:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e7d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925045:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e7d lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925052:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e7d lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925057:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951811.925062:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e7d lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925069:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e7d lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925077:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff97b150d9ea00) 00010000:00010000:3.0:1783951811.925080:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783951811.925091:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e7d lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925097:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e7d lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925112:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eaa00/0x22c73c7857bb3e6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925119:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eaa00/0x22c73c7857bb3e6f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925124:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eaa00/0x22c73c7857bb3e6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925129:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eaa00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951811.925132:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eaa00/0x22c73c7857bb3e6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925138:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eaa00/0x22c73c7857bb3e6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925145:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9e300) 00010000:00010000:3.0:1783951811.925147:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951811.925150:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eaa00/0x22c73c7857bb3e6f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925157:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eaa00/0x22c73c7857bb3e6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951811.925169:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2bd9928 reply state 000000003fd60bd1 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925192:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951811.925197:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b150d9e000) 00010000:00010000:3.0:1783951811.925199:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951811.925202:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951811.925277:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:64858:x1870605447677696:12345-192.168.202.48@tcp:36:rm.0 Request processed in 942us (1146us total) trans 98784247811 rc 0/0 00000100:00100000:3.0:1783951811.925285:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1019 00010000:00010000:2.0:1783951811.925353:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951811.925360:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.925367:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc72600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951811.925371:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.925378:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.925387:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff97b150d9ea00) 00010000:00010000:2.0:1783951811.925390:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783951811.925393:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.925399:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72600/0x22c73c7857bb3e84 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951811.925419:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951811.925421:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951811.925422:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951812.069403:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951812.708766:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465349376:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.708838:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.708882:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465349888:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.708910:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.708931:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465350400:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.708952:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.708968:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465350912:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.708988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.709013:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783951812.709018:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465349760:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709038:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.709054:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465350272:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.709090:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465350784:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.709142:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465349504:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709164:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.709181:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465350016:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709212:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.709231:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465350528:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709264:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.709283:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783951812.709288:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465349632:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709308:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.709323:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465350144:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709343:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.709356:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465350656:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709370:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951812.709397:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465349888 00000100:00100000:3.0:1783951812.709405:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465349888 00000100:00100000:3.0:1783951812.709447:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465350400 00000100:00100000:3.0:1783951812.709450:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465350400 00000100:00100000:3.0:1783951812.709463:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465350912 00000100:00100000:3.0:1783951812.709466:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465350912 00000100:00100000:3.0:1783951812.709476:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465349760 00000100:00100000:3.0:1783951812.709478:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465349760 00000100:00100000:3.0:1783951812.709490:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465349504 00000100:00100000:3.0:1783951812.709492:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465349504 00000100:00100000:3.0:1783951812.709506:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465349632 00000100:00100000:3.0:1783951812.709508:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465349632 00000100:00100000:3.0:1783951812.709522:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1783951812.709530:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465349888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709582:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465349888:12345-0@lo:400:kworker.0 Request processed in 53us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.709619:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1783951812.709635:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1783951812.709639:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465350400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709681:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465350400:12345-0@lo:400:kworker.0 Request processed in 42us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.709686:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1783951812.709695:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1783951812.709699:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465350912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709720:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465350912:12345-0@lo:400:kworker.0 Request processed in 20us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.709725:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1783951812.709733:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1783951812.709748:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465349760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709775:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465349760:12345-0@lo:400:kworker.0 Request processed in 38us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.709780:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1783951812.709790:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1783951812.709795:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465349504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709821:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465349504:12345-0@lo:400:kworker.0 Request processed in 27us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.709826:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1783951812.709836:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1783951812.709840:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465349632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.709865:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465349632:12345-0@lo:400:kworker.0 Request processed in 25us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.709877:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1783951812.709906:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465350272 00000100:00100000:3.0:1783951812.709910:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465350272 00000100:00100000:3.0:1783951812.709934:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465350784 00000100:00100000:3.0:1783951812.709937:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465350784 00000100:00100000:3.0:1783951812.709953:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465350144 00000100:00100000:3.0:1783951812.709956:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465350144 00000100:00100000:3.0:1783951812.709972:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465350656 00000100:00100000:3.0:1783951812.709975:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465350656 00000100:00100000:3.0:1783951812.709992:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:3.0:1783951812.709997:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465350272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.710028:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465350272:12345-0@lo:400:kworker.0 Request processed in 31us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.710034:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00100000:3.0:1783951812.710046:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:3.0:1783951812.710051:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465350784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.710076:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465350784:12345-0@lo:400:kworker.0 Request processed in 25us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.710081:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:3.0:1783951812.710091:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1783951812.710096:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465350144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.710122:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465350144:12345-0@lo:400:kworker.0 Request processed in 26us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.710127:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1783951812.710135:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1783951812.710140:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465350656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.710172:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465350656:12345-0@lo:400:kworker.0 Request processed in 32us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.710176:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1783951812.710199:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465350016 00000100:00100000:3.0:1783951812.710202:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465350016 00000100:00100000:3.0:1783951812.710227:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:3.0:1783951812.710232:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465350016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.710274:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465350016:12345-0@lo:400:kworker.0 Request processed in 42us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.710280:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00100000:3.0:1783951812.710290:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465350528 00000100:00100000:3.0:1783951812.710293:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465350528 00000100:00100000:1.0:1783951812.710812:0:83341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465349376 00000100:00100000:1.0:1783951812.710817:0:83341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465349376 00000100:00100000:1.0:1783951812.710848:0:83341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783951812.710855:0:83341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465349376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951812.710890:0:83341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465349376:12345-0@lo:400:kworker.0 Request processed in 36us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951812.710895:0:83341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783951812.710981:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:3.0:1783951812.710988:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465350528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.711018:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465350528:12345-0@lo:400:kworker.0 Request processed in 32us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951812.711022:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00080000:0.0:1783951812.711273:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951812.711278:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951812.711281:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951812.711283:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951812.712221:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465349632:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712235:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465350144:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712243:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968949 gen 2 00000004:00080000:3.0:1783951812.712248:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97b14dc61500, transno 4294968949 00000100:00100000:3.0:1783951812.712276:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465350656:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712290:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465349504:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712300:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465350016:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712325:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465350528:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712370:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465349760:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712379:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465350272:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712388:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465350784:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712395:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465349376:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712406:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465349888:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712417:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465350400:0@lo:400:kworker.0 00000100:00100000:3.0:1783951812.712426:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465350912:0@lo:400:kworker.0 00010000:00010000:3.0:1783951813.089019:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951813.105235:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951813.106271:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951813.106298:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951813.106320:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951813.106346:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951813.106388:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447678336 00000100:00100000:0.0:1783951813.106397:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447678336 00000100:00100000:0.0:1783951813.106463:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447678208 00000100:00100000:0.0:1783951813.106467:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447678208 00000100:00100000:0.0:1783951813.106493:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2540 00000100:00100000:0.0:1783951813.106502:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447678336:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951813.106573:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447678336:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951813.106580:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2540 00000100:00100000:0.0:1783951813.106622:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2541 00000100:00100000:0.0:1783951813.106628:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447678208:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951813.106657:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447678208:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951813.106664:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2541 00000100:00100000:0.0:1783951813.106682:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447678080 00000100:00100000:0.0:1783951813.106687:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447678080 00000100:00100000:0.0:1783951813.106716:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447677952 00000100:00100000:0.0:1783951813.106719:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447677952 00000100:00100000:0.0:1783951813.106756:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 993 00000100:00100000:0.0:1783951813.106764:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447678080:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951813.106794:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447678080:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 31us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951813.106801:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 993 00000100:00100000:0.0:1783951813.106813:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 994 00000100:00100000:0.0:1783951813.106820:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+9:2398:x1870605447677952:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000080:0.0:1783951813.106841:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050c27480 x1870605447677952/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:74/0 lens 224/224 e 0 to 0 dl 1783951824 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951813.106875:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+9:2398:x1870605447677952:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 56us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951813.106882:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 994 00000100:00080000:0.0:1783951813.106902:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783951813.106907:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951813.106909:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951813.106911:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951813.110859:0:83339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447677824 00000100:00100000:1.0:1783951813.110877:0:83339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447677824 00000100:00100000:0.0:1783951813.111068:0:83339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 157 00000100:00100000:0.0:1783951813.111080:0:83339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b176e43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447677824:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951813.111278:0:83339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b176e43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447677824:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 199us (6047us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951813.111286:0:83339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 157 00000100:00100000:2.0:1783951813.216818:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951813.216844:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465351168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951813.216927:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951813.216970:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465351040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951813.216997:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951813.217228:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465351168 00000100:00100000:3.0:1783951813.217238:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465351168 00000100:00100000:3.0:1783951813.217296:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465351040 00000100:00100000:3.0:1783951813.217300:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465351040 00000100:00100000:3.0:1783951813.217317:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1783951813.217327:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465351168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951813.217360:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951813.217475:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:2.0:1783951813.217485:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465351040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951813.217505:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951813.217558:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465351168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 232us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951813.217566:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:2.0:1783951813.227721:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465351040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10228us (10712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951813.227746:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:1.0:1783951813.231480:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465351168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951813.231539:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465351040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951813.732386:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465351296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951813.732466:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951813.734875:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465351296 00000100:00100000:0.0:1783951813.734889:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465351296 00000100:00100000:0.0:1783951813.734943:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:0.0:1783951813.734953:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465351296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951813.734993:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00010000:00000080:0.0:1783951813.735011:0:8445:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050d2e680 x1870605465351296/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:74/0 lens 224/368 e 0 to 0 dl 1783951824 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951813.735086:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465351296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951813.735093:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00100000:0.0:1783951813.735144:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465351296:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783951814.112987:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951815.145016:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951815.265943:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465351552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951815.266014:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951815.266069:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465351552 00000100:00100000:1.0:1783951815.266076:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465351552 00000100:00100000:1.0:1783951815.266128:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1783951815.266137:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465351552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951815.266169:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951815.266213:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465351552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951815.266221:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1783951815.266268:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465351552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951815.266398:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465351424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951815.266452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951815.266494:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951815.266617:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465351424 00000100:00100000:1.0:1783951815.266623:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465351424 00000100:00100000:1.0:1783951815.266652:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:1.0:1783951815.266659:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465351424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951815.266677:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951815.266710:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465351424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951815.266729:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00080000:0.0:1783951815.266882:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951815.266905:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465351424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951815.776940:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465351680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951815.777016:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951815.777137:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465351680 00000100:00100000:3.0:1783951815.777145:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465351680 00000100:00100000:3.0:1783951815.777200:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:3.0:1783951815.777209:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465351680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951815.777254:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951815.777310:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465351680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951815.777317:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:1.0:1783951815.777390:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465351680:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783951816.160867:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951817.189174:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951817.825002:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465351936:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825105:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465352448:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825144:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465352960:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825185:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1783951817.825189:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465351808:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825254:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465352320:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825274:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825292:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465352832:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825313:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825328:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465353344:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825369:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465352064:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825406:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825424:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465352576:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825447:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825461:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465353088:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825476:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825494:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783951817.825499:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465352192:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825518:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825532:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465352704:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825547:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825561:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465353216:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825580:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951817.825642:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465351936 00000100:00100000:2.0:1783951817.825649:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465351936 00000100:00100000:2.0:1783951817.825711:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465352320 00000100:00100000:2.0:1783951817.825714:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465352320 00000100:00100000:2.0:1783951817.825728:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465352832 00000100:00100000:2.0:1783951817.825730:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465352832 00000100:00100000:2.0:1783951817.825739:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465353344 00000100:00100000:2.0:1783951817.825747:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465353344 00000100:00100000:2.0:1783951817.825760:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465352064 00000100:00100000:2.0:1783951817.825762:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465352064 00000100:00100000:2.0:1783951817.825772:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465352192 00000100:00100000:2.0:1783951817.825774:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465352192 00000100:00100000:2.0:1783951817.825786:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1783951817.825793:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465351936:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951817.825814:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b144cf6a00 x1870605465351936/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1783951828 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951817.825854:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465351936:12345-0@lo:400:kworker.0 Request processed in 61us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.825860:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1783951817.825875:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1783951817.825881:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465352320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.825909:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465352320:12345-0@lo:400:kworker.0 Request processed in 29us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.825915:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1783951817.825927:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1783951817.825932:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465352832:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951817.825942:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b144cf4380 x1870605465352832/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1783951828 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951817.825967:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465352832:12345-0@lo:400:kworker.0 Request processed in 35us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.825973:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1783951817.825984:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1783951817.825989:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465353344:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951817.826007:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b047ac7100 x1870605465353344/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1783951828 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951817.826033:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465353344:12345-0@lo:400:kworker.0 Request processed in 44us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.826039:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1783951817.826052:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1783951817.826057:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465352064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826086:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465352064:12345-0@lo:400:kworker.0 Request processed in 29us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.826092:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1783951817.826102:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1783951817.826108:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465352192:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951817.826117:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16588f100 x1870605465352192/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1783951828 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951817.826143:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465352192:12345-0@lo:400:kworker.0 Request processed in 36us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.826148:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1783951817.826166:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465352448 00000100:00100000:2.0:1783951817.826169:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465352448 00000100:00100000:2.0:1783951817.826192:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465352960 00000100:00100000:2.0:1783951817.826195:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465352960 00000100:00100000:2.0:1783951817.826211:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:2.0:1783951817.826216:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465352448:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951817.826229:0:8445:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b144cf5180 x1870605465352448/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:78/0 lens 224/224 e 0 to 0 dl 1783951828 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951817.826269:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465352448:12345-0@lo:400:kworker.0 Request processed in 53us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.826275:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00100000:2.0:1783951817.826287:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:2.0:1783951817.826292:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465352960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826316:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465352960:12345-0@lo:400:kworker.0 Request processed in 25us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.826322:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00100000:2.0:1783951817.826341:0:83341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465351808 00000100:00100000:2.0:1783951817.826345:0:83341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465351808 00000100:00100000:2.0:1783951817.826370:0:83341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783951817.826377:0:83341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b176e40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465351808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826404:0:83341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b176e40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465351808:12345-0@lo:400:kworker.0 Request processed in 28us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.826409:0:83341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783951817.826450:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465352576 00000100:00100000:2.0:1783951817.826454:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465352576 00000100:00100000:2.0:1783951817.826481:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465353088 00000100:00100000:2.0:1783951817.826483:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465353088 00000100:00100000:2.0:1783951817.826499:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465352704 00000100:00100000:2.0:1783951817.826502:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465352704 00000100:00100000:2.0:1783951817.826518:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465353216 00000100:00100000:2.0:1783951817.826521:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465353216 00000100:00100000:2.0:1783951817.826539:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:2.0:1783951817.826546:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465352576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826575:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465352576:12345-0@lo:400:kworker.0 Request processed in 30us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.826612:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:2.0:1783951817.826625:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:2.0:1783951817.826630:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465353088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826661:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465353088:12345-0@lo:400:kworker.0 Request processed in 31us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.826665:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:2.0:1783951817.826675:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:2.0:1783951817.826680:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465352704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826717:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465352704:12345-0@lo:400:kworker.0 Request processed in 37us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.826723:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:2.0:1783951817.826732:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:2.0:1783951817.826737:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465353216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826762:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465353216:12345-0@lo:400:kworker.0 Request processed in 25us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951817.826767:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00080000:2.0:1783951817.826797:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951817.826801:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951817.826803:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951817.826805:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951817.826854:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465351808:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826867:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465352320:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826878:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465352832:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826888:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465353344:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826907:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465351936:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826916:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465352448:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826925:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465352960:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826966:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465352192:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826975:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465352704:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826984:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465353216:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.826994:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465352064:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.827003:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465352576:0@lo:400:kworker.0 00000100:00100000:2.0:1783951817.827013:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465353088:0@lo:400:kworker.0 00000001:00080000:1.0:1783951817.828775:0:83335:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247811 is committed 00010000:00010000:1.0:1783951817.828814:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828826:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828833:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828840:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eae00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951817.828845:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828853:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828869:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b150d9e000) 00010000:00010000:1.0:1783951817.828872:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951817.828877:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828882:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762eae00/0x22c73c7857bb3e3e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828896:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828902:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828917:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828922:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ea800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951817.828924:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828930:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828937:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b150d9e000) 00010000:00010000:1.0:1783951817.828939:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951817.828941:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951817.828947:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ea800/0x22c73c7857bb3e76 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1783951817.924936:0:84462:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1783951817.998609:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951817.998722:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447678464 00000100:00100000:3.0:1783951817.998733:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447678464 00000100:00100000:3.0:1783951817.998804:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1020 00000100:00100000:3.0:1783951817.998815:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+5:64926:x1870605447678464:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783951817.998837:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951817.998861:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a10f expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951817.998930:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783951817.999646:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783951818.000098:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951818.000113:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951818.000166:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951818.000171:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1783951818.000191:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951818.000235:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73200/0x22c73c7857bb3e8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a10f expref: 7 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951818.000438:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a10f expref: 6 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951818.000448:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:3.0:1783951818.000451:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951818.000454:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14dc72800, rc 0) 00010000:00000080:3.0:1783951818.000464:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050c26a00 x1870605447678464/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:78/0 lens 576/688 e 0 to 0 dl 1783951828 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783951818.000585:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:64926:x1870605447678464:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1770us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951818.000619:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1020 00000100:00100000:1.0:1783951818.013438:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951818.015064:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447678592 00000100:00100000:0.0:1783951818.015075:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447678592 00000100:00100000:0.0:1783951818.015177:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1021 00000100:00100000:0.0:1783951818.015188:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:64926:x1870605447678592:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1783951818.015216:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951818.015237:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8400/0x22c73c7857bb3e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a116 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015298:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015313:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015325:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015339:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9800/0x22c73c7857bb3ea7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015346:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9800/0x22c73c7857bb3ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015376:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9800/0x22c73c7857bb3ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015426:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015433:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015439:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015462:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015468:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783951818.015472:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015480:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015491:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:0.0:1783951818.015494:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951818.015498:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015505:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8c00/0x22c73c7857bb3ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015515:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9800/0x22c73c7857bb3ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015528:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9800/0x22c73c7857bb3ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015534:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9800/0x22c73c7857bb3ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015539:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783951818.015783:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9800/0x22c73c7857bb3ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015791:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9800/0x22c73c7857bb3ea7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015801:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff97b14531c100) 00010000:00010000:0.0:1783951818.015804:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951818.015807:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9800/0x22c73c7857bb3ea7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015813:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f9800/0x22c73c7857bb3ea7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015849:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8400/0x22c73c7857bb3e99 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a116 expref: 7 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015860:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:0.0:1783951818.015862:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951818.015866:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1772f8400/0x22c73c7857bb3e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a116 expref: 7 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951818.015888:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1772f8400, rc 0) 00010000:00000080:0.0:1783951818.015898:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050d2f800 x1870605447678592/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:79/0 lens 592/584 e 0 to 0 dl 1783951829 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783951818.015978:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:64926:x1870605447678592:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 792us (2548us total) trans 0 rc 301/301 00000100:00100000:0.0:1783951818.015986:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1021 00000100:00100000:0.0:1783951818.023888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951818.024094:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447678848 00000100:00100000:1.0:1783951818.024105:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447678848 00000100:00100000:1.0:1783951818.024162:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1022 00000100:00100000:1.0:1783951818.024174:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:64926:x1870605447678848:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1783951818.024195:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951818.024198:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783951818.024223:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72800/0x22c73c7857bb3e92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a10f expref: 6 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.024574:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:1.0:1783951818.024618:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951818.024636:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5600/0x22c73c7857bb3eae lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a11d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.025504:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.025532:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.025543:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.025557:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.025565:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.025572:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027022:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027050:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027059:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951818.027069:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783951818.027094:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027110:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027116:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027122:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027141:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951818.027145:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027152:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027163:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150f45500) 00010000:00010000:1.0:1783951818.027166:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951818.027170:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027177:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4000/0x22c73c7857bb3eb5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951818.027190:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000477b66cb reply state 00000000be64e179 transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027200:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027205:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff97b150f45f00) 00010000:00010000:1.0:1783951818.027213:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951818.027217:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783951818.027266:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5600/0x22c73c7857bb3eae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 8 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027286:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 7 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.027294:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff97b150f45b00) 00010000:00010000:1.0:1783951818.027306:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783951818.027308:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1767e5200, rc 0) 00010000:00000080:1.0:1783951818.027316:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050c25180 x1870605447678848/t98784247812(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:79/0 lens 536/608 e 0 to 0 dl 1783951829 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783951818.027399:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:64926:x1870605447678848:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3228us (3521us total) trans 98784247812 rc 0/0 00000100:00100000:1.0:1783951818.027408:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1022 00000100:00100000:1.0:1783951818.031056:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951818.031178:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447679104 00000100:00100000:2.0:1783951818.031188:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447679104 00000100:00100000:2.0:1783951818.031246:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1023 00000100:00100000:2.0:1783951818.031256:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:64926:x1870605447679104:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783951818.031280:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951818.031314:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3ed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a124 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.031417:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.031434:0:83761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 9 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.031459:0:83761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.031491:0:83761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 9 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.031504:0:83761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 9 pid: 66237 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951818.031529:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16588c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:83761:1870605465353472:192.168.202.48@tcp:104: 00000100:00100000:2.0:1783951818.031625:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b152405300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951818.036864:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16588c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:83761:1870605465353472:192.168.202.48@tcp:104: 00010000:00010000:2.0:1783951818.036894:0:83761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951818.040620:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951818.040721:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447679232 00000100:00100000:2.0:1783951818.040732:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447679232 00010000:00010000:2.0:1783951818.040769:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 10 pid: 66237 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951818.040816:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2539 00000100:00100000:2.0:1783951818.040825:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458183b2-4c6d-478c-9fed-a955779e6611+10:2401:x1870605447679232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951818.040839:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951818.040846:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 10 pid: 66237 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.040873:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 10 pid: 66237 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.040895:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e5200/0x22c73c7857bb3ec3 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 10 pid: 66237 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.040911:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff97b150f45b00) 00010000:00010000:2.0:1783951818.040917:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.040926:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.040933:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951818.040962:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951818.041008:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458183b2-4c6d-478c-9fed-a955779e6611+9:2401:x1870605447679232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 184us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951818.041015:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2539 00010000:00010000:1.0:1783951818.041138:0:83761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.041147:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951818.041164:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783951818.041825:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.041835:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.041846:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.041852:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413ab600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951818.042119:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.042128:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.042140:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff97b150f45b00) 00010000:00010000:1.0:1783951818.042143:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783951818.042147:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.042153:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413ab600/0x22c73c7857bb3ed8 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.042347:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3ed1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a124 expref: 9 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.042358:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d802a00) 00010000:00010000:1.0:1783951818.042361:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783951818.042364:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1413aa600/0x22c73c7857bb3ed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a124 expref: 9 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951818.042378:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1413aa600, rc 0) 00010000:00000080:1.0:1783951818.042387:0:83761:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050d2c380 x1870605447679104/t98784247813(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:79/0 lens 712/824 e 0 to 0 dl 1783951829 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783951818.042619:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:64926:x1870605447679104:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 11363us (11569us total) trans 98784247813 rc 301/301 00000100:00100000:1.0:1783951818.042627:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1023 00000100:00100000:0.0:1783951818.050139:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951818.050202:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447679488 00000100:00100000:3.0:1783951818.050213:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447679488 00000100:00100000:3.0:1783951818.050269:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 214 00000100:00100000:3.0:1783951818.050280:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:64926:x1870605447679488:12345-192.168.202.48@tcp:35:lfs.0 00010000:00000080:3.0:1783951818.050479:0:81182:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050c27b80 x1870605447679488/t98784247814(0) o35->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:79/0 lens 392/456 e 0 to 0 dl 1783951829 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783951818.050543:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:458183b2-4c6d-478c-9fed-a955779e6611+9:64926:x1870605447679488:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 265us (414us total) trans 98784247814 rc 0/0 00000100:00100000:3.0:1783951818.050550:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 214 00000100:00100000:2.0:1783951818.052768:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951818.052970:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447679744 00000100:00100000:3.0:1783951818.052979:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447679744 00000100:00100000:3.0:1783951818.053027:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 215 00000100:00100000:3.0:1783951818.053036:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+9:64926:x1870605447679744:12345-192.168.202.48@tcp:35:lfs.0 00010000:00000080:3.0:1783951818.053206:0:66239:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16588c000 x1870605447679744/t98784247815(0) o35->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:79/0 lens 392/456 e 0 to 0 dl 1783951829 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783951818.053268:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:64926:x1870605447679744:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 233us (508us total) trans 98784247815 rc 0/0 00000100:00100000:3.0:1783951818.053276:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 215 00010000:00010000:1.0:1783951818.208881:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951818.223819:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951818.223922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951818.223960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951818.224000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951818.224100:0:83345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447679872 00000100:00100000:1.0:1783951818.224110:0:83345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447679872 00000100:00100000:1.0:1783951818.224177:0:83345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 159 00000100:00100000:1.0:1783951818.224188:0:83345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b176e42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447679872:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951818.224272:0:83345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b176e42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447679872:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 86us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951818.224280:0:83345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 159 00000100:00100000:1.0:1783951818.224312:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447680256 00000100:00100000:1.0:1783951818.224316:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447680256 00000100:00100000:1.0:1783951818.224350:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447680128 00000100:00100000:1.0:1783951818.224353:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447680128 00000100:00100000:1.0:1783951818.224390:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2546 00000100:00100000:1.0:1783951818.224397:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447680256:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951818.224426:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447680256:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951818.224432:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2546 00000100:00100000:1.0:1783951818.224445:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2547 00000100:00100000:1.0:1783951818.224452:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447680128:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951818.224475:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447680128:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951818.224496:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2547 00000100:00080000:1.0:1783951818.224694:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951818.224700:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951818.227934:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447680000 00000100:00100000:3.0:1783951818.227949:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447680000 00000100:00100000:3.0:1783951818.228039:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1001 00000100:00100000:3.0:1783951818.228050:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447680000:12345-192.168.202.48@tcp:400:kworker.0 00000100:00080000:1.0:1783951818.228512:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951818.228939:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447680000:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 889us (5128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951818.228949:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1001 00000100:00100000:1.0:1783951818.338220:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951818.338245:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465353600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951818.338317:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951818.338369:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465353600 00000100:00100000:1.0:1783951818.338376:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465353600 00000100:00100000:1.0:1783951818.338424:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:1.0:1783951818.338433:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465353600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951818.338464:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951818.338506:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465353600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951818.338515:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:1.0:1783951818.338562:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465353600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951818.338808:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465353728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951818.338839:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951818.339082:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465353728 00000100:00100000:3.0:1783951818.339087:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465353728 00000100:00100000:3.0:1783951818.339123:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:3.0:1783951818.339131:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465353728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951818.339150:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951818.339204:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465353728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951818.339210:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:2.0:1783951818.339498:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465353728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951818.855236:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465353856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951818.855312:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951818.860313:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465353856 00000100:00100000:2.0:1783951818.860330:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465353856 00000100:00100000:2.0:1783951818.860406:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:2.0:1783951818.860417:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465353856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951818.860458:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00010000:00000080:2.0:1783951818.860486:0:8445:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050d2f100 x1870605465353856/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:79/0 lens 224/368 e 0 to 0 dl 1783951829 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951818.860563:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465353856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (5250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951818.860571:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:1.0:1783951818.860706:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465353856:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783951819.237145:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783951820.017823:0:84559:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783951820.017877:0:84559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.017893:0:84559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.017900:0:84559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.017907:0:84559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.017937:0:84559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783951820.017943:0:84559:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1783951820.017962:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951820.017970:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783951820.017971:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951820.017975:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1783951820.017978:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eb200 already unused, calling callback (ffffffffc13acc20) 00000100:00080000:2.0:1783951820.017980:0:84559:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:3.0:1783951820.017982:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.017999:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783951820.018004:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b04d9f7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:3.0:1783951820.018006:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951820.018011:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951820.018013:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783951820.018016:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1783951820.018038:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16588dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465353984:0@lo:39:umount.0 00010000:00010000:3.0:1783951820.018041:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.018046:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951820.018067:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.018074:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762eb200/0x22c73c7857bb3ae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3ae8 expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.018083:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951820.018085:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951820.018086:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951820.018093:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951820.018103:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951820.018104:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465354112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951820.018136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951820.018174:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465353984 00000100:00100000:3.0:1783951820.018181:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465353984 00000100:00100000:3.0:1783951820.018235:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1783951820.018244:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465353984:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783951820.018275:0:67035:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3c00 00000100:00080000:3.0:1783951820.018283:0:67035:0:(import.c:65:import_set_state_nolock()) ffff97b174691800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1783951820.018312:0:67035:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16588f480 x1870605465353984/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:81/0 lens 224/224 e 0 to 0 dl 1783951831 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951820.018352:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1870605465353984:12345-0@lo:39:umount.0 Request processed in 109us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951820.018360:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000020:00000080:3.0:1783951820.018369:0:67035:0:(genops.c:906:class_export_put()) final put ffff97b16e9fb800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1783951820.018564:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465354112 00000100:00100000:3.0:1783951820.018569:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465354112 00000100:00100000:3.0:1783951820.018624:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1783951820.018632:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1472bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465354112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951820.018644:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951820.018659:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc72a00/0x22c73c7857bb3ae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3ae1 expref: 24 pid: 83340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.018684:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951820.018712:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1472bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3645:x1870605465354112:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951820.018719:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00010000:00010000:3.0:1783951820.018764:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783951820.018952:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b16e9fb800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783951820.019005:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b174691800 for lustre-MDT0000 00000100:00100000:3.0:1783951820.019037:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465354112:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783951820.019067:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b04d9f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783951820.019075:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16588dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465353984:0@lo:39:umount.0 00000100:00080000:2.0:1783951820.019545:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951820.019549:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783951820.019560:0:84559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783951820.021518:0:84559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021531:0:84559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021536:0:84559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021541:0:84559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021558:0:84559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951820.021563:0:84559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021566:0:84559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021570:0:84559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021574:0:84559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021584:0:84559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783951820.021609:0:84559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021615:0:84559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.021617:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951820.021625:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.021633:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73600 already unused, calling callback (ffffffffc13acc20) 00010000:00010000:2.0:1783951820.021634:0:84559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951820.021637:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021640:0:84559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.021646:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951820.021652:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021654:0:84559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783951820.021658:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951820.021658:0:84559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951820.021661:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1783951820.021665:0:84559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021670:0:84559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021686:0:84559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951820.021696:0:84559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783951820.021700:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951820.021700:0:84559:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1783951820.021704:0:84559:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1783951820.021706:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951820.021725:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.021731:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3a01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3a0f expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783951820.021735:0:84559:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1783951820.021739:0:84559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:3.0:1783951820.021743:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00000080:2.0:1783951820.021743:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1783951820.021746:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:2.0:1783951820.021748:0:84559:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1783951820.021751:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eb600 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783951820.021759:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.021766:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951820.021928:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951820.021933:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951820.021935:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783951820.021937:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783951820.021951:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.021957:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951820.021970:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.021976:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762eb600/0x22c73c7857bb3b27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3b2e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.021985:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951820.021988:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.021994:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ae00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783951820.021996:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.022003:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951820.022016:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951820.022022:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783951820.022024:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783951820.022026:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783951820.022040:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.022045:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951820.022052:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.022058:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb3ad3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3ada expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.022068:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951820.022071:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.022077:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc72200 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783951820.022080:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.022087:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951820.022093:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951820.022108:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951820.022110:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783951820.022112:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783951820.022125:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.022131:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951820.022137:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.022144:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14dc72200/0x22c73c7857bb39f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb39fa expref: -99 pid: 83334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.022154:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951820.022155:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951820.022158:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951820.022176:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465354624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951820.022237:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951820.022279:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951820.022285:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465354240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951820.022305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951820.022335:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465354624 00000100:00100000:3.0:1783951820.022341:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465354624 00000100:00100000:3.0:1783951820.022380:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465354240 00000100:00100000:3.0:1783951820.022383:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465354240 00000100:00100000:3.0:1783951820.022425:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1783951820.022434:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465354624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951820.022446:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951820.022466:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86a200/0x22c73c7857bb39fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb39f3 expref: 24 pid: 83345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951820.022478:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783951820.022498:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1783951820.022508:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3644:x1870605465354240:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951820.022510:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3644:x1870605465354624:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951820.022516:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00010000:00010000:0.0:1783951820.022516:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783951820.022524:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b400/0x22c73c7857bb3a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3a01 expref: 23 pid: 83339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951820.022533:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951820.022540:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951820.022549:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951820.022557:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3644:x1870605465354240:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951820.022563:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1783951820.022568:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465354240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951820.022576:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465354624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951820.023058:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951820.023071:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465354368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951820.023103:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951820.023143:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951820.023150:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465354496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951820.023171:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951820.023236:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465354368 00000100:00100000:0.0:1783951820.023241:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465354368 00000100:00100000:0.0:1783951820.023331:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465354496 00000100:00100000:0.0:1783951820.023341:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465354496 00000004:00000080:2.0:1783951820.024846:0:84559:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:1.0:1783951820.025112:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1783951820.025126:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3642:x1870605465354368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951820.025142:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951820.025162:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc72000/0x22c73c7857bb3b2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3b27 expref: 22 pid: 83345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.025177:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951820.025253:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3642:x1870605465354368:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951820.025260:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1783951820.025282:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1783951820.025289:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3642:x1870605465354496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951820.025297:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951820.025307:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86ba00/0x22c73c7857bb3ada lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3ad3 expref: 20 pid: 83345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.025315:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951820.025337:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3642:x1870605465354496:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951820.025343:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000001:00080000:1.0:1783951820.025633:0:83335:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00010000:00010000:1.0:1783951820.025659:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.025668:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.025692:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.025698:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951820.025703:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.025710:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.025722:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff97b150f45f00) 00010000:00010000:1.0:1783951820.025726:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951820.025729:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.025735:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1767e4400/0x22c73c7857bb3ebc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951820.025961:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465354496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951820.025970:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465354368:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1783951820.026035:0:84559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1783951820.026043:0:84559:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b144760000 458183b2-4c6d-478c-9fed-a955779e6611 192.168.202.48@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 98784247815 stale:0 00000020:00080000:2.0:1783951820.026048:0:84559:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b16e9f8000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951820.026053:0:84559:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b16e9ff800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951820.026057:0:84559:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b17407f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951820.026061:0:84559:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b176d51000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951820.026065:0:84559:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff97b0489bb380) has exports, disconnecting them 00000020:00080000:2.0:1783951820.026069:0:84559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.48@tcp (ffff97b144760000), last request at 1783951818 00000020:00000080:2.0:1783951820.026076:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3dce 00000100:00080000:2.0:1783951820.026084:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b144764800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951820.026106:0:84559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b144760000): rc 0 00000020:00000080:2.0:1783951820.026109:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b144760000/458183b2-4c6d-478c-9fed-a955779e6611 00000020:00080000:2.0:1783951820.026118:0:84559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b16e9f8000), last request at 1783951610 00000020:00000080:2.0:1783951820.026121:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3bf9 00000100:00080000:2.0:1783951820.026124:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b16e9fd800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951820.026137:0:84559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b16e9f8000): rc 0 00000020:00000080:2.0:1783951820.026139:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b16e9f8000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1783951820.026143:0:84559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b16e9ff800), last request at 1783951817 00000020:00000080:2.0:1783951820.026146:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3bf2 00000100:00080000:2.0:1783951820.026148:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b16e9fc000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951820.026155:0:84559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b16e9ff800): rc 0 00000020:00000080:2.0:1783951820.026157:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b16e9ff800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1783951820.026160:0:84559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b17407f000), last request at 1783951817 00000020:00000080:2.0:1783951820.026163:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3beb 00000100:00080000:2.0:1783951820.026172:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b047add800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951820.026204:0:84559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b17407f000): rc 0 00000020:00000080:2.0:1783951820.026206:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b17407f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1783951820.026210:0:84559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b176d51000), last request at 1783951605 00000020:00000080:2.0:1783951820.026214:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a55 00000100:00080000:2.0:1783951820.026220:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b144467800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951820.026224:0:84559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b176d51000): rc 0 00000020:00000080:2.0:1783951820.026226:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b176d51000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1783951820.026232:0:84559:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa80a47f73ae0 00000100:00080000:2.0:1783951820.026251:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783951820.026253:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411433 gen 3 00000100:00080000:2.0:1783951820.028070:0:84559:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00010000:00010000:1.0:1783951820.028860:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951820.028913:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b142e2a800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783951820.028972:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16588ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465354752:0@lo:39:umount.0 00000100:00100000:1.0:1783951820.029047:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951820.029235:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783951820.029240:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968949 gen 3 00000004:00080000:2.0:1783951820.029253:0:84559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783951820.029311:0:84559:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1783951820.029326:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b1514b8000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783951820.029331:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783951820.029431:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144760000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-MDT0000 00000020:00000080:3.0:1783951820.029481:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b16e9f8000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783951820.029515:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b16e9ff800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783951820.029537:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783951820.029564:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176d51000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783951820.029623:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144764800 for lustre-MDT0000 00000020:00000080:3.0:1783951820.029629:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b16e9fd800 for lustre-MDT0000 00000020:00000080:3.0:1783951820.029634:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b16e9fc000 for lustre-MDT0000 00000020:00000080:3.0:1783951820.029638:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b047add800 for lustre-MDT0000 00000020:00000080:3.0:1783951820.029640:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144467800 for lustre-MDT0000 00010000:00010000:3.0:1783951820.029649:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951820.029656:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951820.030286:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16588df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465354880:0@lo:9:umount.0 00000100:00100000:1.0:1783951820.030341:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951820.030405:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465354752 00000100:00100000:1.0:1783951820.030414:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465354752 00000100:00100000:1.0:1783951820.030466:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:1.0:1783951820.030476:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465354752:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783951820.030503:0:23862:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a94 00000100:00080000:1.0:1783951820.030523:0:23862:0:(import.c:65:import_set_state_nolock()) ffff97b1514ba000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951820.030543:0:23862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411433 00000100:00100000:3.0:1783951820.030546:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465354880 00000100:00100000:3.0:1783951820.030549:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465354880 00000100:00100000:3.0:1783951820.030584:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4884 00000100:00100000:3.0:1783951820.030608:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465354880:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783951820.030628:0:26196:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3ab0 00000100:00080000:3.0:1783951820.030634:0:26196:0:(import.c:65:import_set_state_nolock()) ffff97b049659000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783951820.030668:0:26196:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968949 00000100:00100000:1.0:1783951820.030710:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3641:x1870605465354752:12345-0@lo:39:umount.0 Request processed in 235us (1662us total) trans 77309411434 rc 0/0 00000100:00100000:1.0:1783951820.030718:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00010000:00010000:1.0:1783951820.030741:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951820.030748:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951820.030883:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1514b8000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783951820.030900:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783951820.030902:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951820.030906:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16588df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465354880:0@lo:9:umount.0 00000100:00080000:2.0:1783951820.031026:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783951820.031031:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968949 gen 3 00000004:00080000:2.0:1783951820.031074:0:84559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783951820.031129:0:84559:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783951820.031146:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b04b214800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1783951820.031187:0:84559:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b0489bb380) has no exports 00000020:00080000:2.0:1783951820.031788:0:84559:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b0489bb380) has no exports 00000100:00100000:3.0:1783951820.032638:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465354880:12345-0@lo:9:umount.0 Request processed in 2027us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951820.032648:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4884 00010000:00010000:3.0:1783951820.032691:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951820.034558:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b142e2a800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783951820.034572:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16588ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465354752:0@lo:39:umount.0 00000100:00100000:0.0:1783951820.038715:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16588dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465355008:0@lo:9:umount.0 00000100:00100000:0.0:1783951820.038797:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951820.038973:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465355008 00000100:00100000:3.0:1783951820.038981:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465355008 00000100:00100000:3.0:1783951820.039095:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4885 00000100:00100000:3.0:1783951820.039106:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465355008:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783951820.039133:0:11961:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3abe 00000100:00080000:3.0:1783951820.039142:0:11961:0:(import.c:65:import_set_state_nolock()) ffff97b1746cc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783951820.039187:0:11961:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968949 00000100:00100000:3.0:1783951820.039345:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465355008:12345-0@lo:9:umount.0 Request processed in 242us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951820.039351:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4885 00000100:00080000:0.0:1783951820.039496:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b04b214800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783951820.039509:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783951820.039511:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951820.039516:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16588dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465355008:0@lo:9:umount.0 00010000:00010000:3.0:1783951820.039663:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951820.039706:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1783951820.089704:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a6a 00000020:00000080:2.0:1783951820.089720:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b174b14800/lustre-QMT0000_UUID 00000020:01000000:2.0:1783951820.089917:0:84559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783951820.090033:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b14800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783951820.090061:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951820.090073:0:84559:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783951820.090077:0:84559:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff97b048b599c0) has no exports 00000020:00000080:3.0:1783951820.090545:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a63 00000020:00000080:3.0:1783951820.090552:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b174b17800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783951820.090978:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b17800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783951820.092138:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951820.092152:0:84559:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783951820.092157:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b1762c4800/lustre-QMT0000_UUID 00000020:00000080:3.0:1783951820.092161:0:84559:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783951820.092167:0:84559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1783951820.092359:0:84559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b048f33540 - data ffff97b181d57000/ffff97b049de1c00 00000020:01000000:3.0:1783951820.092485:0:84559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b1743881e0 - data 0000000000000000/ffff97b047a68000 00000020:01000000:3.0:1783951820.092496:0:84559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b152217180 - data ffff97b181cb41b0/ffff97b04b63d000 00000100:00080000:1.0:1783951820.172140:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783951820.172148:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411433 gen 4 00000100:00100000:1.0:1783951820.172164:0:84559:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff97b16588ca80 x1870605465354752/t77309411434(77309411434) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951830 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951820.172189:0:84559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783951820.176839:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783951820.176849:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968949 gen 4 00000004:00080000:1.0:1783951820.176866:0:84559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951820.176869:0:84559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783951820.179002:0:83352:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783951820.179011:0:83352:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 2 count 1 00000040:00080000:3.0:1783951820.179031:0:83352:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:1.0:1783951820.179740:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783951820.179745:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968949 gen 4 00000004:00080000:1.0:1783951820.179761:0:84559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951820.179764:0:84559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783951820.180139:0:83354:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783951820.180144:0:83354:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 1 count 1 00000040:00080000:3.0:1783951820.180153:0:83354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:1.0:1783951820.181142:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a1d 00000020:00000080:1.0:1783951820.181152:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b143cdb800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783951820.181948:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a32 00000020:00000080:1.0:1783951820.181956:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b14ed8c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783951820.181963:0:84559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783951820.181969:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951820.181981:0:84559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783951820.181984:0:84559:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff97b167c94d40) has no exports 00000004:01000000:1.0:1783951820.182140:0:84559:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783951820.182147:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3ab7 00000020:00000080:1.0:1783951820.182151:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b0410df000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783951820.182155:0:84559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783951820.182159:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951820.182167:0:84559:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783951820.182169:0:84559:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff97b048b58000) has no exports 00000020:00000080:1.0:1783951820.182175:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3aa9 00000020:00000080:1.0:1783951820.182178:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b04b216000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951820.182558:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b143cdb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783951820.182567:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14ed8c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1783951820.182571:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0410df000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783951820.182575:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04b216000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783951820.184039:0:84559:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783951820.184047:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783951820.184051:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968949 gen 5 00000004:00080000:1.0:1783951820.184059:0:84559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951820.184062:0:84559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951820.184156:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951820.184170:0:84559:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951820.184179:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a9b 00000020:00000080:1.0:1783951820.184186:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b144574000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951820.187551:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04b214800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783951820.187568:0:48498:0:(genops.c:906:class_export_put()) final put ffff97b144576000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951820.187572:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144576000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783951820.187580:0:48498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783951820.190834:0:84559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783951820.190850:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951820.190866:0:84559:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783951820.190871:0:84559:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff97b0489b8000) has no exports 00000020:00000080:1.0:1783951820.190880:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a8d 00000020:00000080:1.0:1783951820.190889:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b1514b9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783951820.190956:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144574000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1783951820.196677:0:84559:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783951820.196686:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783951820.196704:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968949 gen 5 00000004:00080000:1.0:1783951820.196711:0:84559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951820.196714:0:84559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951820.196759:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951820.197296:0:84559:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1783951820.197317:0:84559:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783951820.197326:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a7f 00000020:00000080:1.0:1783951820.197337:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b04b215800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783951820.197345:0:84559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1783951820.197350:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951820.197356:0:84559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783951820.197360:0:84559:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff97b048b5b380) has no exports 00000020:00000080:1.0:1783951820.197367:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a78 00000020:00000080:1.0:1783951820.197372:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b142e2d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783951820.198108:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1514b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951820.198129:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1514b8000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783951820.198134:0:48498:0:(genops.c:906:class_export_put()) final put ffff97b04b213800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783951820.198137:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04b213800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783951820.198141:0:48498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951820.198222:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04b215800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783951820.198227:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b142e2d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783951820.215683:0:84559:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1783951820.215693:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783951820.215697:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411433 gen 5 00000100:00100000:1.0:1783951820.215706:0:84559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951820.216146:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951820.216166:0:84559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951820.216199:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951820.216204:0:84559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951820.216210:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b14f008000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951820.216216:0:84559:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14f008000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783951820.216230:0:84559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951820.216335:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a39 00000020:00000080:1.0:1783951820.216343:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b14de80800/lustre-MDD0000_UUID 00000020:01000000:1.0:1783951820.216348:0:84559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783951820.216352:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951820.216363:0:84559:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783951820.216367:0:84559:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff97b0489b99c0) has no exports 00000020:00000080:1.0:1783951820.216393:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951820.216408:0:84559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783951820.216412:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3a40 00000020:00000080:1.0:1783951820.216417:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b14de86000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783951820.216423:0:84559:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b164ceb800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783951820.216426:0:84559:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b164ceb800 3 00000020:01000004:1.0:1783951820.216429:0:84559:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b164ceb800 from lustre-MDT0000 00000020:00000080:1.0:1783951820.216448:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951820.216451:0:84559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783951820.216454:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b143cdf800/lustre-MDT0000_UUID 00000020:00000080:1.0:1783951820.216456:0:84559:0:(genops.c:865:class_export_destroy()) destroying export ffff97b143cdf800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783951820.216462:0:84559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1783951820.216494:0:84559:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1783951820.216497:0:84559:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783951820.216500:0:84559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783951820.216502:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951820.216505:0:84559:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783951820.216513:0:84559:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b17407d000 e66faa19-2cbc-412c-8aef-9c55427739f8 192.168.202.48@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783951820.216519:0:84559:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b17704d800 75da5dc4-aa7e-42cf-a965-1b5f01232c6f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783951820.216523:0:84559:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff97b167c919c0) has exports, disconnecting them 00000020:00080000:1.0:1783951820.216528:0:84559:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.48@tcp (ffff97b17407d000), last request at 1783951606 00000020:00000080:1.0:1783951820.216546:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3b04 00000020:00010000:1.0:1783951820.216550:0:84559:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b17407d000: total 2 00000100:00080000:1.0:1783951820.216554:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b17407b800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783951820.216571:0:84559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b17407d000): rc 0 00000020:00080000:1.0:1783951820.216575:0:84559:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97b17704d800), last request at 1783951605 00000020:00000080:1.0:1783951820.216633:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb39e5 00000020:00010000:1.0:1783951820.216637:0:84559:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b17704d800: total 2 00000100:00080000:1.0:1783951820.216639:0:84559:0:(import.c:65:import_set_state_nolock()) ffff97b17704c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783951820.216647:0:84559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b17704d800): rc 0 00000020:00080000:1.0:1783951820.216650:0:84559:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff97b167c919c0) has no exports 00000020:00010000:1.0:1783951820.216662:0:15262:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b17407d000: total 2 00010000:00010000:1.0:1783951820.216665:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951820.216698:0:15262:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b17407d000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1783951820.216726:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc73c00/0x22c73c7857bb3b19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0de expref: 5 pid: 83340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.216742:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216be00/0x22c73c7857bb3b0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0d0 expref: 4 pid: 83345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.216753:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b000/0x22c73c7857bb3b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0d7 expref: 3 pid: 83341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.216763:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc73000/0x22c73c7857bb3b20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a0e5 expref: 2 pid: 83340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217023:0:15262:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b17407d000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1783951820.217043:0:15262:0:(genops.c:906:class_export_put()) final put ffff97b17407d000/e66faa19-2cbc-412c-8aef-9c55427739f8 00000020:00010000:1.0:1783951820.217048:0:15262:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b17704d800: total 3 00010000:00010000:1.0:1783951820.217063:0:15262:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b17704d800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783951820.217078:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb3b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3b89 expref: 14 pid: 83341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217089:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a600/0x22c73c7857bb3b9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3b97 expref: 13 pid: 83341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217098:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc73400/0x22c73c7857bb3b3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3b35 expref: 12 pid: 83345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217107:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86a400/0x22c73c7857bb3bba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3bb3 expref: 11 pid: 83340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217128:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a000/0x22c73c7857bb3b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3b43 expref: 10 pid: 83340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217140:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc73a00/0x22c73c7857bb3bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3ba5 expref: 9 pid: 83341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217150:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762ea200/0x22c73c7857bb3b66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3b5f expref: 8 pid: 83345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217160:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762eb800/0x22c73c7857bb3be4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3bdd expref: 7 pid: 83341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217170:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86aa00/0x22c73c7857bb3bc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3bc1 expref: 6 pid: 83339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217179:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762ea000/0x22c73c7857bb3b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3b51 expref: 5 pid: 83341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217188:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1444ff400/0x22c73c7857bb3bd6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3bcf expref: 4 pid: 83345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217199:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b200/0x22c73c7857bb3b74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3b6d expref: 3 pid: 83340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217209:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b600/0x22c73c7857bb3b82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3b7b expref: 2 pid: 83339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951820.217217:0:15262:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b17704d800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783951820.217228:0:15262:0:(genops.c:906:class_export_put()) final put ffff97b17704d800/75da5dc4-aa7e-42cf-a965-1b5f01232c6f 00010000:00010000:1.0:1783951820.217232:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951820.217237:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951820.217239:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951820.217307:0:83345:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff97b14f13ce00:83345] 3 exiting: rc = 0 00000100:00100000:0.0:1783951820.217474:0:83339:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97b176b9a400:83339] 0 exiting: rc = 1 00000100:00100000:1.0:1783951820.217656:0:83341:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97b1469d9400:83341] 2 exiting: rc = 0 00000020:00000080:1.0:1783951820.217712:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b142e2a800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783951820.217717:0:48498:0:(genops.c:906:class_export_put()) final put ffff97b04b215000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951820.217720:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04b215000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783951820.217725:0:48498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951820.217764:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14de80800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783951820.218144:0:48498:0:(genops.c:906:class_export_put()) final put ffff97b14de87000/lustre-MDD0000_UUID 00000020:00000080:1.0:1783951820.218148:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14de87000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783951820.218153:0:48498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783951820.218188:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14de86000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783951820.218193:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407d000/e66faa19-2cbc-412c-8aef-9c55427739f8 for MGS 00000020:00000080:1.0:1783951820.218221:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17704d800/75da5dc4-aa7e-42cf-a965-1b5f01232c6f for MGS 00000020:00000080:1.0:1783951820.218233:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b17407b800 for MGS 00000020:00000080:1.0:1783951820.218237:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b17704c800 for MGS 00000100:00100000:2.0:1783951820.218479:0:83340:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97b0489b3000:83340] 1 exiting: rc = 0 00010000:00010000:3.0:1783951820.218579:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951820.219194:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219203:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219211:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219218:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219225:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219231:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219236:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219243:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219250:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219256:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219263:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219268:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219274:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219279:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219297:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219302:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219308:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219314:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219320:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219326:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219332:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219339:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219345:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219351:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219358:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219364:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219370:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219375:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219381:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219386:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219391:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219396:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219401:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219406:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219411:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219417:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219422:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219427:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219433:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219439:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219444:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219450:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219456:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219462:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219467:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219473:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219478:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219484:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219489:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219505:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219511:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219518:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219524:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219529:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219534:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219540:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219546:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219551:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219557:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219563:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219567:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219572:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219577:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783951820.219582:0:84559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1783951820.224745:0:84559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b174388600 - data ffff97b181cf7af8/ffff97b047a69800 00000020:01000000:2.0:1783951820.224876:0:84559:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b176646a80 - data ffff97b1657c9360/ffff97b047935c00 00000020:00000080:2.0:1783951820.225363:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb39de 00000020:00000080:2.0:1783951820.225382:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b17407c000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783951820.225396:0:84559:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b164ceb800 from MGS, refs=2 00000020:01000004:2.0:1783951820.225400:0:84559:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b164ceb800 2 00000020:01000004:2.0:1783951820.225403:0:84559:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b164ceb800 from MGS 00000020:00000080:1.0:1783951820.225406:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951820.225423:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951820.225430:0:84559:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783951820.225438:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b17407e800/MGS 00000020:00000080:2.0:1783951820.225441:0:84559:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407e800/MGS for MGS 00000020:01000000:2.0:1783951820.225451:0:84559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783951820.225521:0:84559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783951820.225525:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951820.225535:0:84559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783951820.225541:0:84559:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97b04d9f5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951820.225547:0:84559:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff97b0489bcd40) has exports, disconnecting them 00000020:00080000:2.0:1783951820.225551:0:84559:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97b04d9f5800), last request at 1783951605 00000020:00000080:2.0:1783951820.225555:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3af6 00000020:00080000:2.0:1783951820.225563:0:84559:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b04d9f5800): rc 0 00000020:00000080:2.0:1783951820.225567:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b04d9f5800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783951820.226475:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783951820.226710:0:84559:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783951820.226723:0:84559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783951820.226728:0:84559:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783951820.226738:0:84559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951820.226800:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04d9f7800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783951820.226878:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951820.226888:0:84559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1783951820.226892:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b047ade800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783951820.226894:0:84559:0:(genops.c:865:class_export_destroy()) destroying export ffff97b047ade800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783951820.226899:0:84559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783951820.226958:0:84559:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b164ceb800 1 00000020:00000080:2.0:1783951820.226963:0:84559:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb39d0 00000020:00000080:2.0:1783951820.226968:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b174078800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1783951820.226982:0:84559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783951820.226985:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951820.226989:0:84559:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783951820.226992:0:84559:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff97b048b5cd40) has no exports 00000020:00000080:1.0:1783951820.227040:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174078800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1783951820.311583:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783951820.316750:0:84559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951820.316763:0:84559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783951820.316998:0:84559:0:(genops.c:906:class_export_put()) final put ffff97b14f00d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783951820.317004:0:84559:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14f00d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783951820.317017:0:84559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783951820.317147:0:84559:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97b164cea000 00000020:02000400:1.0:1783951820.317212:0:84559:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1783951820.388760:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465355136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951820.388966:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465355264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951820.389040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951820.389099:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465355264 00000100:00100000:2.0:1783951820.389107:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465355264 00000100:00100000:2.0:1783951820.389167:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:2.0:1783951820.389177:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465355264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951820.389208:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951820.389253:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465355264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951820.389260:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00080000:2.0:1783951820.389282:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951820.389321:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465355264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951820.389520:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951820.389641:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465355136 00000100:00100000:2.0:1783951820.389656:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465355136 00000100:00100000:2.0:1783951820.389710:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1783951820.389718:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465355136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951820.389735:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951820.389907:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465355136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 190us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951820.389914:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1783951820.389948:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465355136:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783951820.391024:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783951821.350778:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951822.371688:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951822.945201:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465355776:0@lo:400:kworker.0 00000100:00100000:2.0:1783951822.945302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951822.945355:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465356288:0@lo:400:kworker.0 00000100:00100000:2.0:1783951822.945387:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951822.945415:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783951822.945420:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465355392:0@lo:400:kworker.0 00000400:00000100:2.0:1783951822.945455:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465355392 offset 0 length 224: 4 00000100:00100000:2.0:1783951822.945481:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465355904:0@lo:400:kworker.0 00000100:00100000:2.0:1783951822.945505:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951822.945670:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465356416:0@lo:400:kworker.0 00000100:00100000:2.0:1783951822.945702:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951822.945737:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465355648:0@lo:400:kworker.0 00000100:00100000:2.0:1783951822.945763:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951822.945783:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465356160:0@lo:400:kworker.0 00000100:00100000:2.0:1783951822.945806:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951822.945824:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783951822.945849:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465355520:0@lo:400:kworker.0 00000100:00100000:2.0:1783951822.945877:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951822.945909:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465356032:0@lo:400:kworker.0 00000100:00100000:1.0:1783951822.946468:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465355776 00000100:00100000:1.0:1783951822.946481:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465355776 00000100:00100000:1.0:1783951822.946716:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465355904 00000100:00100000:1.0:1783951822.946721:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465355904 00000100:00100000:1.0:1783951822.946757:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465356416 00000100:00100000:1.0:1783951822.946761:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465356416 00000100:00100000:1.0:1783951822.946770:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465355648 00000100:00100000:1.0:1783951822.946772:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465355648 00000100:00100000:1.0:1783951822.946786:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465355520 00000100:00100000:1.0:1783951822.946788:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465355520 00000100:00100000:1.0:1783951822.946802:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1783951822.946813:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465355904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951822.946935:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1783951822.946947:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465355648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951822.948228:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1783951822.948241:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1870605465355776:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783951822.948251:0:68591:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783951822.951920:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465355904:12345-0@lo:400:kworker.0 Request processed in 5094us (6399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951822.951940:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1783951822.951990:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1783951822.951997:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1870605465356416:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783951822.952005:0:83761:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783951822.952045:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1870605465356416:12345-0@lo:400:kworker.0 Request processed in 48us (6343us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783951822.952051:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1783951822.952062:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1783951822.952067:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3645:x1870605465355520:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783951822.952072:0:83761:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783951822.952090:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3645:x1870605465355520:12345-0@lo:400:kworker.0 Request processed in 22us (6213us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783951822.952095:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00080000:1.0:1783951822.952125:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951822.952200:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465355904:0@lo:400:kworker.0 00000100:00080000:1.0:1783951822.952214:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951822.952235:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783951822.952239:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783951822.952245:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951822.952250:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3325 00000100:00080000:1.0:1783951822.952258:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951822.952298:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b050d2c000 x1870605465356544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951822.952324:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465356416:0@lo:400:kworker.0 00000100:00100000:1.0:1783951822.952386:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465356288 00000100:00100000:1.0:1783951822.952392:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465356288 00000100:00100000:1.0:1783951822.952455:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465356160 00000100:00100000:1.0:1783951822.952458:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465356160 00000100:00100000:1.0:1783951822.952488:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:1.0:1783951822.952502:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465356288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951822.952811:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465356288:12345-0@lo:400:kworker.0 Request processed in 315us (7421us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951822.952818:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:1.0:1783951822.952832:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:1.0:1783951822.952838:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465356160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951822.952865:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465356160:12345-0@lo:400:kworker.0 Request processed in 28us (7058us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951822.952870:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00080000:1.0:1783951822.952898:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951822.952901:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951822.952921:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465356288:0@lo:400:kworker.0 00000100:00100000:1.0:1783951822.952969:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465356544:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783951822.953009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951822.953042:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465356544 00000100:00100000:1.0:1783951822.953045:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465356544 00000100:00100000:1.0:1783951822.953064:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1783951822.953069:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465356544:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783951822.953091:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951822.953120:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465356544:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 51us (111us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951822.953126:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00080000:1.0:1783951822.953147:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951822.953151:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951822.953154:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465356544:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783951822.953829:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465355648:12345-0@lo:400:kworker.0 Request processed in 6882us (8060us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951822.953840:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:2.0:1783951822.956919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951822.956999:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465355648:0@lo:400:kworker.0 00000100:00100000:2.0:1783951822.957016:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465356160:0@lo:400:kworker.0 00000100:00080000:2.0:1783951822.957045:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783951822.957050:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783951822.957054:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783951822.957059:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951822.957063:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3325 00000100:00080000:2.0:1783951822.957070:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951822.957099:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b146bac380 x1870605465356672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951822.957126:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465355520:0@lo:400:kworker.0 00000100:00100000:1.0:1783951822.957204:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465356032 00000100:00100000:1.0:1783951822.957218:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465356032 00000100:00100000:0.0:1783951822.957363:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465356672:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783951822.957450:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951822.957508:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465356672 00000100:00100000:0.0:1783951822.957512:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465356672 00000100:00100000:1.0:1783951822.957630:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:1.0:1783951822.957640:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1870605465356032:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783951822.957661:0:8444:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783951822.957714:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1870605465356032:12345-0@lo:400:kworker.0 Request processed in 74us (801us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783951822.957720:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:0.0:1783951822.957787:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1783951822.957792:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465356672:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1783951822.957819:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951822.957856:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465356672:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 63us (407us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951822.957863:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00080000:0.0:1783951822.957920:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951822.957926:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951822.957949:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465356672:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1783951822.958321:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783951822.958326:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783951822.958330:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783951822.958336:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951822.958340:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3507 00000100:00080000:2.0:1783951822.958347:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951822.958379:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b146bac380 x1870605465356800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951822.958421:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465356032:0@lo:400:kworker.0 00000100:00100000:0.0:1783951822.958674:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465356800:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783951822.958718:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951822.958811:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465356800 00000100:00100000:2.0:1783951822.958816:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465356800 00000100:00100000:2.0:1783951822.958850:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:2.0:1783951822.958855:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465356800:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1783951822.958870:0:23862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951822.959037:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465356800:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 180us (318us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951822.959044:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00000100:00080000:0.0:1783951822.959110:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951822.959115:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951822.959118:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465356800:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783951822.970084:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1870605465355776:12345-0@lo:400:kworker.0 Request processed in 21828us (24767us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783951822.970106:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00080000:1.0:1783951822.970254:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951822.970261:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783951822.970266:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783951822.970272:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951822.970294:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3325 00000100:00080000:1.0:1783951822.970304:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951822.970354:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b050d2c000 x1870605465356928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951822.970427:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465356928:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783951822.970493:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951822.970723:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465355776:0@lo:400:kworker.0 00000100:00100000:3.0:1783951822.970820:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465356928 00000100:00100000:3.0:1783951822.970829:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465356928 00000100:00100000:3.0:1783951822.970898:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1783951822.970906:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465356928:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1783951822.970932:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951822.983321:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465356928:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 12400us (12813us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951822.983340:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00080000:0.0:1783951822.987717:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951822.987737:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951822.987743:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465356928:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783951823.346873:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951823.346941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:0.0:1783951823.346974:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447680384 offset 0 length 224: 4 00000100:00100000:0.0:1783951823.346993:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951823.347091:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951823.347338:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447680768 00000100:00100000:3.0:1783951823.347352:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447680768 00000100:00100000:3.0:1783951823.347439:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447680896 00000100:00100000:3.0:1783951823.347442:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447680896 00000100:00100000:3.0:1783951823.347469:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2550 00000100:00100000:3.0:1783951823.347482:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447680768:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951823.347577:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447680768:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 99us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951823.347584:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2550 00000100:00100000:3.0:1783951823.347655:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2551 00000100:00100000:3.0:1783951823.347662:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dc65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447680896:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951823.347687:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dc65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447680896:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951823.347694:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2551 00000100:00080000:0.0:1783951823.348063:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951823.348070:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951823.349130:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447680512 00000100:00100000:1.0:1783951823.349145:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447680512 00000100:00100000:1.0:1783951823.349206:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447680640 00000100:00100000:1.0:1783951823.349210:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447680640 00000100:00100000:1.0:1783951823.349347:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1004 00000100:00100000:1.0:1783951823.349359:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447680640:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951823.349466:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447680640:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 110us (2470us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951823.349474:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1004 00000100:00100000:1.0:1783951823.349495:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1031 00000100:00100000:1.0:1783951823.349500:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870605447680512:12345-192.168.202.48@tcp:400:kworker.0 00000020:00080000:1.0:1783951823.349508:0:83761:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.48@tcp 00000100:00100000:1.0:1783951823.349534:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870605447680512:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 33us (2676us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783951823.349540:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1031 00000100:00080000:3.0:1783951823.351736:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951823.363017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951823.363182:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447681024 00000100:00100000:1.0:1783951823.363197:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447681024 00000100:00100000:1.0:1783951823.363261:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1032 00000100:00100000:1.0:1783951823.363271:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dc67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447681024:12345-192.168.202.48@tcp:38:ptlrpcd_01_00.0 00010000:00020000:1.0:1783951823.363301:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951823.363453:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dc67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447681024:12345-192.168.202.48@tcp:38:ptlrpcd_01_00.0 Request processed in 182us (449us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951823.363462:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1032 00010000:00010000:3.0:1783951823.394406:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951824.417174:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951825.440790:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951825.504824:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951825.504849:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465357056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951825.504922:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951825.504965:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465357056 00000100:00100000:2.0:1783951825.504973:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465357056 00000100:00100000:2.0:1783951825.505030:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:2.0:1783951825.505039:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465357056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951825.505071:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951825.505109:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465357056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951825.505117:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:2.0:1783951825.505165:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465357056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951825.505803:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951825.505817:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465357184:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783951825.505820:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951825.505859:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951825.505930:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465357184 00000100:00100000:0.0:1783951825.505935:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465357184 00000100:00100000:0.0:1783951825.505990:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1783951825.506000:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465357184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951825.506019:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951825.506080:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465357184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951825.506087:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:3.0:1783951825.509658:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465357184:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783951825.509697:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1783951826.022932:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951826.022942:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b04965a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951826.023031:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783951826.023106:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1746cc800 for lustre-OST0001 00000001:00100000:2.0:1783951826.023446:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783951826.023462:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b04965f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951826.023523:0:48498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783951826.023569:0:48498:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b049659000 for lustre-OST0000 00000001:00100000:3.0:1783951826.024845:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783951826.024860:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411434 is committed 00000020:00000080:3.0:1783951826.024865:0:75694:0:(genops.c:906:class_export_put()) final put ffff97b1514bb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951826.024951:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1514bb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783951826.025013:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1514ba000 for lustre-MDT0001 00010000:00010000:1.0:1783951826.465377:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951827.488802:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951828.064848:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951828.064854:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951828.064858:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951828.064866:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3537 00000100:00080000:1.0:1783951828.064872:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951828.064880:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951828.064909:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b050d2d500 x1870605465357440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951828.064926:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1783951828.064951:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951828.064956:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951828.064957:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951828.064964:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3537 00000100:00100000:3.0:1783951828.064966:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465357568:0@lo:400:kworker.0 00000100:00080000:1.0:1783951828.064969:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951828.064982:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951828.064998:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b050d2c000 x1870605465357696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951828.065029:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951828.065033:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951828.065050:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951828.065055:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3537 00000100:00080000:1.0:1783951828.065058:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951828.065064:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951828.065081:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b174ad3800 x1870605465357952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951828.065096:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783951828.065124:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951828.065128:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951828.065134:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951828.065138:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3537 00000100:00080000:1.0:1783951828.065142:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951828.065145:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951828.065159:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465357312:0@lo:400:kworker.0 00000100:00100000:1.0:1783951828.065164:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b166fb2300 x1870605465358336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1783951828.065192:0:3643:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465357312 offset 0 length 224: 4 00000100:00100000:1.0:1783951828.065214:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465357568 00000100:00100000:1.0:1783951828.065223:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465357568 00000100:00100000:3.0:1783951828.065232:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951828.065241:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465358208:0@lo:400:kworker.0 00000100:00100000:3.0:1783951828.065279:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951828.065301:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:1.0:1783951828.065320:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465357568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951828.065337:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465357824:0@lo:400:kworker.0 00000100:00100000:3.0:1783951828.065373:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951828.065409:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951828.065417:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465358080:0@lo:400:kworker.0 00000100:00100000:1.0:1783951828.065437:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465357568:12345-0@lo:400:kworker.0 Request processed in 123us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951828.065447:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1783951828.065454:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951828.065470:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465357824 00000100:00100000:1.0:1783951828.065476:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465357824 00000100:00080000:3.0:1783951828.065495:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951828.065506:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1783951828.065514:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465357824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951828.065554:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465357824:12345-0@lo:400:kworker.0 Request processed in 41us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951828.065568:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1783951828.065651:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465357824:0@lo:400:kworker.0 00000100:00100000:0.0:1783951828.065738:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465357440:0@lo:38:kworker.0 00000100:00100000:0.0:1783951828.065775:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951828.065807:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465357696:0@lo:38:kworker.0 00000100:00100000:0.0:1783951828.065833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951828.065857:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465357952:0@lo:38:kworker.0 00000100:00100000:3.0:1783951828.065866:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465357568:0@lo:400:kworker.0 00000100:00100000:0.0:1783951828.065886:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951828.065906:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465358336:0@lo:38:kworker.0 00000100:00100000:0.0:1783951828.065934:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951828.066055:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465358208 00000100:00100000:2.0:1783951828.066060:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465358208 00000100:00100000:2.0:1783951828.066099:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465358080 00000100:00100000:2.0:1783951828.066103:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465358080 00000100:00100000:2.0:1783951828.066125:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:2.0:1783951828.066131:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465358208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951828.066173:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465358208:12345-0@lo:400:kworker.0 Request processed in 42us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951828.066179:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:2.0:1783951828.066191:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:2.0:1783951828.066199:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465358080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951828.066230:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465358080:12345-0@lo:400:kworker.0 Request processed in 34us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951828.066236:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:2.0:1783951828.066258:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465357952 00000100:00100000:2.0:1783951828.066261:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465357952 00000100:00100000:2.0:1783951828.066282:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:2.0:1783951828.066286:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465357952:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951828.066305:0:8445:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951828.066340:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465357952:12345-0@lo:38:kworker.0 Request processed in 52us (455us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951828.066346:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00080000:2.0:1783951828.066367:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951828.066371:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951828.066391:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465358080:0@lo:400:kworker.0 00000100:00080000:2.0:1783951828.066417:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951828.066429:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951828.066432:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465357952:0@lo:38:kworker.0 00000100:00100000:3.0:1783951828.070781:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465357440 00000100:00100000:3.0:1783951828.070805:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465357440 00000100:00100000:3.0:1783951828.070884:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465357696 00000100:00100000:3.0:1783951828.070888:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465357696 00000100:00100000:3.0:1783951828.070903:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465358336 00000100:00100000:3.0:1783951828.070906:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465358336 00000100:00100000:3.0:1783951828.070951:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1783951828.070964:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dc64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465357440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951828.070996:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951828.072751:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1783951828.072767:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465357696:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951828.072795:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951828.074974:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1783951828.075209:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465358336:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783951828.075234:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951828.077012:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465358208:0@lo:400:kworker.0 00000100:00080000:2.0:1783951828.077066:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951828.077072:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951828.077075:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465357440:0@lo:38:kworker.0 00000100:00100000:3.0:1783951828.078830:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dc64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465357440:12345-0@lo:38:kworker.0 Request processed in 7854us (13039us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951828.078851:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1783951828.079205:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465357696:12345-0@lo:38:kworker.0 Request processed in 6431us (13361us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951828.079219:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00080000:2.0:1783951828.079274:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951828.079282:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951828.079288:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465357696:0@lo:38:kworker.0 00000100:00100000:1.0:1783951828.079366:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465358336:12345-0@lo:38:kworker.0 Request processed in 4155us (13430us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951828.079375:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:2.0:1783951828.079385:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951828.079392:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951828.079397:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465358336:0@lo:38:kworker.0 00000400:00000100:1.0:1783951828.462324:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447681152 offset 0 length 224: 4 00000100:00100000:1.0:1783951828.462573:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951828.462680:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951828.462768:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951828.462811:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951828.462850:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447681536 00000100:00100000:1.0:1783951828.462862:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447681536 00000100:00100000:1.0:1783951828.462936:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447681664 00000100:00100000:1.0:1783951828.462940:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447681664 00000100:00100000:1.0:1783951828.462967:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2554 00000100:00100000:1.0:1783951828.462979:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447681536:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951828.463130:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2555 00000100:00100000:2.0:1783951828.463142:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447681664:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951828.463225:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447681664:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 87us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951828.463234:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2555 00000100:00080000:2.0:1783951828.463262:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951828.463266:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951828.463375:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447681280 00000100:00100000:0.0:1783951828.463380:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447681280 00000100:00100000:0.0:1783951828.463564:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447681408 00000100:00100000:0.0:1783951828.463570:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447681408 00000100:00100000:0.0:1783951828.463645:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1007 00000100:00100000:0.0:1783951828.463670:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447681408:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951828.464127:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1036 00000100:00100000:2.0:1783951828.464136:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447681280:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:2.0:1783951828.464165:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951828.464212:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447681280:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 76us (1533us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951828.464228:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1036 00000100:00080000:2.0:1783951828.464275:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951828.464511:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447681408:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 841us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951828.464520:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1007 00000100:00100000:1.0:1783951828.465198:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447681536:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 2217us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951828.465211:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2554 00010000:00010000:3.0:1783951828.512877:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951829.536804:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951830.560811:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951830.624860:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951830.624900:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465358464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951830.625040:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465358592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951830.625109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951830.625218:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465358592 00000100:00100000:2.0:1783951830.625227:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465358592 00000100:00100000:2.0:1783951830.625288:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:2.0:1783951830.625297:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465358592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951830.625328:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951830.625380:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465358592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951830.625388:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:0.0:1783951830.625465:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465358592:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783951830.625623:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951830.626737:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951830.626886:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465358464 00000100:00100000:2.0:1783951830.626898:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465358464 00000100:00100000:2.0:1783951830.626969:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:2.0:1783951830.626978:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465358464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951830.627006:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951830.627078:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465358464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951830.627085:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:1.0:1783951830.627309:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465358464:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783951830.628126:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783951831.585198:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951832.608751:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951833.184807:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951833.184813:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951833.184817:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951833.184825:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3543 00000100:00080000:1.0:1783951833.184831:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951833.184839:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951833.184864:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b146baf100 x1870605465358848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951833.184912:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951833.184916:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951833.184918:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951833.184922:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3543 00000100:00080000:1.0:1783951833.184925:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951833.184928:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951833.184944:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b164e3e300 x1870605465359104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951833.184960:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951833.184963:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951833.184965:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951833.184968:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3543 00000100:00080000:1.0:1783951833.184971:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951833.184974:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951833.185000:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b164e3f480 x1870605465359360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951833.185023:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951833.185026:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951833.185027:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951833.185031:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3543 00000100:00080000:1.0:1783951833.185033:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951833.185036:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951833.185047:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047acf480 x1870605465359744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951833.185078:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465358848:0@lo:38:kworker.0 00000100:00100000:1.0:1783951833.185150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951833.185188:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465359104:0@lo:38:kworker.0 00000100:00100000:1.0:1783951833.185209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951833.185386:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465359488:0@lo:400:kworker.0 00000100:00100000:3.0:1783951833.185418:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951833.185457:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783951833.185464:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465358720:0@lo:400:kworker.0 00000400:00000100:3.0:1783951833.185484:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465358720 offset 0 length 224: 4 00000100:00100000:3.0:1783951833.185516:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465359616:0@lo:400:kworker.0 00000100:00100000:3.0:1783951833.185535:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951833.185577:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465359488 00000100:00100000:3.0:1783951833.185585:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465359488 00000100:00100000:3.0:1783951833.185661:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465359616 00000100:00100000:3.0:1783951833.185664:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465359616 00000100:00100000:3.0:1783951833.185689:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1783951833.185699:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465359488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951833.185756:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465359488:12345-0@lo:400:kworker.0 Request processed in 60us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951833.185765:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1783951833.185781:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:3.0:1783951833.185787:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465359616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951833.185813:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465359616:12345-0@lo:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951833.185819:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00080000:3.0:1783951833.185837:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951833.185841:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951833.185870:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465359616:0@lo:400:kworker.0 00000100:00100000:3.0:1783951833.185879:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465359488:0@lo:400:kworker.0 00000100:00100000:1.0:1783951833.186127:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465359360:0@lo:38:kworker.0 00000100:00100000:1.0:1783951833.186158:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951833.186959:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465359744:0@lo:38:kworker.0 00000100:00100000:1.0:1783951833.186995:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951833.187041:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465358976:0@lo:400:kworker.0 00000100:00100000:1.0:1783951833.187064:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951833.187084:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951833.187090:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465359232:0@lo:400:kworker.0 00000100:00100000:1.0:1783951833.187110:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951833.187146:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465358848 00000100:00100000:1.0:1783951833.187165:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465358848 00000100:00100000:1.0:1783951833.187192:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465359104 00000100:00100000:1.0:1783951833.187195:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465359104 00000100:00100000:1.0:1783951833.187204:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465359744 00000100:00100000:1.0:1783951833.187206:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465359744 00000100:00100000:1.0:1783951833.187212:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465358976 00000100:00100000:1.0:1783951833.187214:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465358976 00000100:00100000:1.0:1783951833.187240:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465359232 00000100:00100000:1.0:1783951833.187243:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465359232 00000100:00100000:1.0:1783951833.187257:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:1.0:1783951833.187264:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465358976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951833.187309:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465358976:12345-0@lo:400:kworker.0 Request processed in 46us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951833.187316:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:1.0:1783951833.187330:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1783951833.187335:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465359232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951833.187358:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465359232:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951833.187363:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1783951833.187375:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1783951833.187379:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465358848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783951833.187397:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951833.187428:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465358848:12345-0@lo:38:kworker.0 Request processed in 48us (2278us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951833.187433:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1783951833.187443:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1783951833.187446:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465359104:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783951833.187454:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951833.187483:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465359104:12345-0@lo:38:kworker.0 Request processed in 35us (2273us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951833.187488:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1783951833.187498:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1783951833.187501:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465359744:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783951833.187510:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951833.187530:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465359744:12345-0@lo:38:kworker.0 Request processed in 27us (535us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951833.187535:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1783951833.187607:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465359232:0@lo:400:kworker.0 00000100:00100000:1.0:1783951833.187617:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465358976:0@lo:400:kworker.0 00000100:00080000:1.0:1783951833.187636:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951833.187652:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951833.187657:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951833.187660:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465358848:0@lo:38:kworker.0 00000100:00080000:1.0:1783951833.187668:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951833.187672:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951833.187675:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465359104:0@lo:38:kworker.0 00000100:00080000:1.0:1783951833.187683:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951833.187685:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951833.187688:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465359744:0@lo:38:kworker.0 00000100:00100000:2.0:1783951833.197072:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465359360 00000100:00100000:2.0:1783951833.197086:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465359360 00000100:00100000:3.0:1783951833.197242:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:3.0:1783951833.197489:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465359360:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951833.197523:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951833.197770:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465359360:12345-0@lo:38:kworker.0 Request processed in 282us (11608us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951833.197780:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00080000:1.0:1783951833.202871:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951833.202883:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951833.202905:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465359360:0@lo:38:kworker.0 00000100:00100000:2.0:1783951833.596110:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:2.0:1783951833.596153:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447681792 offset 0 length 224: 4 00000100:00100000:2.0:1783951833.596179:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951833.596206:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951833.596288:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951833.596299:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447682048 00000100:00100000:3.0:1783951833.596318:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447682048 00000100:00100000:2.0:1783951833.596328:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447681920 00000100:00100000:2.0:1783951833.596339:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447681920 00000100:00100000:2.0:1783951833.596407:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1010 00000100:00100000:2.0:1783951833.596422:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447682048:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951833.596439:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1040 00000100:00100000:3.0:1783951833.596450:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1769a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447681920:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783951833.596482:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951833.596518:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dc61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447682048:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 100us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951833.596527:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1010 00000100:00100000:3.0:1783951833.596564:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1769a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447681920:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 98us (367us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951833.596623:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1040 00000100:00100000:2.0:1783951833.596624:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447682176 00000100:00100000:2.0:1783951833.596630:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447682176 00000100:00100000:2.0:1783951833.596665:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447682304 00000100:00100000:2.0:1783951833.596670:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447682304 00000100:00100000:2.0:1783951833.596694:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4886 00000100:00100000:2.0:1783951833.596701:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+5:2397:x1870605447682176:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:2.0:1783951833.596721:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb393d 00000100:00080000:2.0:1783951833.596729:0:8435:0:(import.c:65:import_set_state_nolock()) ffff97b1746cd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783951833.596771:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968949 00000100:00100000:2.0:1783951833.596968:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+2:2397:x1870605447682176:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 261us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951833.596980:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4886 00000100:00100000:2.0:1783951833.597013:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4887 00000100:00100000:2.0:1783951833.597027:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+5:2397:x1870605447682304:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:2.0:1783951833.597042:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3dd5 00000100:00080000:2.0:1783951833.597053:0:8435:0:(import.c:65:import_set_state_nolock()) ffff97b144763800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783951833.597083:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968949 00000100:00100000:2.0:1783951833.597226:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+2:2397:x1870605447682304:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 201us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951833.597234:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4887 00010000:00010000:2.0:1783951833.597434:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951833.597716:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951833.597721:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951833.597726:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783951833.598950:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951833.632728:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951834.663826:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951835.680975:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951835.754519:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465359872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951835.754863:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951835.754966:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465359872 00000100:00100000:2.0:1783951835.754976:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465359872 00000100:00100000:2.0:1783951835.755038:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:2.0:1783951835.755048:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465359872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951835.755078:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951835.755126:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465359872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951835.755133:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:2.0:1783951835.755181:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465359872:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783951835.757442:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951835.758625:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465360000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951835.758705:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951835.758968:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465360000 00000100:00100000:2.0:1783951835.758978:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465360000 00000100:00100000:2.0:1783951835.759042:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:2.0:1783951835.759052:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465360000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951835.759082:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951835.759128:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465360000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951835.759136:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00080000:1.0:1783951835.759441:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951835.759477:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465360000:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783951836.704694:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951837.750847:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783951838.305750:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951838.305757:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951838.305760:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951838.305768:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3548 00000100:00080000:0.0:1783951838.305774:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783951838.305781:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951838.305798:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951838.305803:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b174af6680 x1870605465360256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951838.305822:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465360128:0@lo:400:kworker.0 00000100:00080000:0.0:1783951838.305827:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951838.305832:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951838.305833:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951838.305837:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3548 00000100:00080000:0.0:1783951838.305840:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783951838.305843:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951838.305855:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b174af7480 x1870605465360512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1783951838.305878:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465360128 offset 0 length 224: 4 00000100:00080000:0.0:1783951838.305882:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951838.305887:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951838.305900:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951838.305905:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3548 00000100:00080000:0.0:1783951838.305907:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783951838.305912:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951838.305921:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465360384:0@lo:400:kworker.0 00000100:00100000:0.0:1783951838.305927:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd6fb80 x1870605465360768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951838.305952:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951838.305956:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951838.305960:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783951838.305961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951838.305967:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3548 00000100:00080000:0.0:1783951838.305970:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783951838.305973:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951838.305983:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd6df80 x1870605465361152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951838.305986:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951838.306003:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465361024:0@lo:400:kworker.0 00000100:00100000:2.0:1783951838.306032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951838.306062:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465361024 00000100:00100000:2.0:1783951838.306069:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465361024 00000100:00100000:2.0:1783951838.306116:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:2.0:1783951838.306124:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465361024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951838.306148:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465360256:0@lo:38:kworker.0 00000100:00100000:2.0:1783951838.306203:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465361024:12345-0@lo:400:kworker.0 Request processed in 76us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951838.306210:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951838.306214:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:1.0:1783951838.306238:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465360512:0@lo:38:kworker.0 00000100:00100000:1.0:1783951838.306261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951838.306265:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465361024:0@lo:400:kworker.0 00000100:00100000:1.0:1783951838.306284:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465360768:0@lo:38:kworker.0 00000100:00100000:1.0:1783951838.306309:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951838.306333:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465361152:0@lo:38:kworker.0 00000100:00100000:1.0:1783951838.306353:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951838.306379:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465360768 00000100:00080000:1.0:1783951838.306384:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951838.306385:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465360768 00000100:00100000:1.0:1783951838.306399:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465360384 00000100:00100000:1.0:1783951838.306404:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465360384 00000100:00100000:2.0:1783951838.306416:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:2.0:1783951838.306422:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465360768:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951838.306441:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951838.306442:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465360256 00000100:00100000:1.0:1783951838.306446:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465360256 00000100:00100000:1.0:1783951838.306460:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465360512 00000100:00100000:1.0:1783951838.306464:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465360512 00000100:00100000:1.0:1783951838.306474:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465361152 00000100:00100000:1.0:1783951838.306476:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465361152 00000100:00100000:1.0:1783951838.306486:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1783951838.306500:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465360384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951838.306552:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465360384:12345-0@lo:400:kworker.0 Request processed in 53us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951838.306559:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1783951838.306572:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1783951838.306577:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465360256:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783951838.306613:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951838.306646:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465360256:12345-0@lo:38:kworker.0 Request processed in 67us (446us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951838.306653:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1783951838.306668:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1783951838.306673:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465360512:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783951838.306683:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951838.306719:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465360512:12345-0@lo:38:kworker.0 Request processed in 45us (457us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951838.306726:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1783951838.306736:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1783951838.306740:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465361152:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783951838.306749:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951838.306771:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465361152:12345-0@lo:38:kworker.0 Request processed in 30us (419us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951838.306779:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:1.0:1783951838.306804:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951838.306820:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951838.306825:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951838.306835:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465360256:0@lo:38:kworker.0 00000100:00080000:1.0:1783951838.306844:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951838.306848:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951838.306851:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465360512:0@lo:38:kworker.0 00000100:00080000:1.0:1783951838.306858:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951838.306861:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951838.306863:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465361152:0@lo:38:kworker.0 00000100:00100000:1.0:1783951838.306890:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465360384:0@lo:400:kworker.0 00000100:00100000:0.0:1783951838.307962:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465360640:0@lo:400:kworker.0 00000100:00100000:0.0:1783951838.308010:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951838.308113:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951838.308122:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465360896:0@lo:400:kworker.0 00000100:00100000:0.0:1783951838.308145:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951838.309104:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465360640 00000100:00100000:0.0:1783951838.309112:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465360640 00000100:00100000:0.0:1783951838.309182:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1783951838.309192:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465360640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951838.309769:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465360640:12345-0@lo:400:kworker.0 Request processed in 578us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951838.309786:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1783951838.309811:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465360896 00000100:00100000:0.0:1783951838.309816:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465360896 00000100:00100000:0.0:1783951838.309844:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:0.0:1783951838.309850:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465360896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951838.309880:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465360896:12345-0@lo:400:kworker.0 Request processed in 31us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951838.309886:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00080000:0.0:1783951838.309902:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951838.309905:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951838.310109:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465360896:0@lo:400:kworker.0 00000100:00100000:1.0:1783951838.310121:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465360640:0@lo:400:kworker.0 00000100:00100000:0.0:1783951838.343883:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465360768:12345-0@lo:38:kworker.0 Request processed in 37451us (37565us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951838.343899:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00080000:2.0:1783951838.360512:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951838.360525:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951838.360530:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465360768:0@lo:38:kworker.0 00000400:00000100:2.0:1783951838.707355:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447682432 offset 0 length 224: 4 00000100:00100000:2.0:1783951838.707398:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951838.707436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951838.707467:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447682688 00000100:00100000:2.0:1783951838.707476:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447682688 00000100:00100000:2.0:1783951838.707850:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1013 00000100:00100000:2.0:1783951838.707862:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447682688:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951838.707953:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447682688:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 95us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951838.707962:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1013 00000100:00080000:2.0:1783951838.707984:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951838.708200:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447682560 00000100:00100000:3.0:1783951838.708206:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447682560 00000100:00100000:3.0:1783951838.708243:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1044 00000100:00100000:3.0:1783951838.708713:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870605447682560:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783951838.708738:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951838.708780:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870605447682560:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 531us (1343us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951838.708787:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1044 00010000:00010000:3.0:1783951838.752873:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783951838.827546:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:2.0:1783951838.827556:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b144763000/458183b2-4c6d-478c-9fed-a955779e6611 00000001:00100000:2.0:1783951838.827953:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:2.0:1783951838.827957:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b1746cc000/458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:2.0:1783951838.827972:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144763000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-OST0001 00000020:00000080:2.0:1783951838.828487:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1746cc000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-OST0000 00000020:00000080:2.0:1783951838.828526:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144763800 for lustre-OST0001 00000020:00000080:2.0:1783951838.828532:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1746cd000 for lustre-OST0000 00000100:00000400:0.0:1783951839.332142:0:3642:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951822/real 1783951822] req@ffff97b050c25f80 x1870605465355392/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783951838 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951839.332176:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff97b050c25f80 x1870605465355392/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783951838 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951839.332185:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783951839.332198:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1783951839.365342:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.148@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783951839.365348:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783951839.365359:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b050c25f80 x1870605465355392/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783951838 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951839.365373:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b050d2ca80 x1870605465357312/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951844 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951839.365389:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b174ad0a80 x1870605465358720/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951849 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951839.365409:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b174af4e00 x1870605465360128/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951854 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783951839.365422:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783951839.365425:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783951839.365426:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783951839.365428:0:3642:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1783951839.365468:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465357312:0@lo:400:kworker.0 00000100:00100000:0.0:1783951839.365518:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465358720:0@lo:400:kworker.0 00000100:00100000:0.0:1783951839.365540:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465360128:0@lo:400:kworker.0 00000100:00080000:0.0:1783951839.365561:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951839.365564:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783951839.365567:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951839.365572:0:40998:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3320 00000100:00080000:0.0:1783951839.365580:0:40998:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951839.365643:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd6d500 x1870605465361280/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951839.365662:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951839.365666:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951839.365668:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951839.368845:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3553 00000100:00080000:0.0:1783951839.368853:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783951839.368863:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951839.368904:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd6c000 x1870605465361408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951839.368960:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951839.368963:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951839.368966:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951839.368970:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3553 00000100:00080000:0.0:1783951839.368972:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783951839.368975:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951839.368987:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd6d180 x1870605465361664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951839.369005:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951839.369009:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951839.369010:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951839.369013:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3553 00000100:00080000:0.0:1783951839.369015:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783951839.369018:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951839.369029:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd6f800 x1870605465361920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951839.369051:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951839.369054:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951839.369056:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951839.369058:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3553 00000100:00080000:0.0:1783951839.369061:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783951839.369064:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951839.369074:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd6fb80 x1870605465362304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951839.369116:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465361280:0@lo:250:kworker.0 00000400:00000100:0.0:1783951839.369169:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465361280 offset 0 length 520: 4 00000100:00100000:3.0:1783951839.369798:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465361536:0@lo:400:kworker.0 00000100:00100000:3.0:1783951839.369845:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951839.369905:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465361792:0@lo:400:kworker.0 00000100:00100000:3.0:1783951839.369930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951839.370808:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465361408:0@lo:38:kworker.0 00000100:00100000:0.0:1783951839.370846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951839.370870:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465361664:0@lo:38:kworker.0 00000100:00100000:0.0:1783951839.370893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951839.370910:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465361920:0@lo:38:kworker.0 00000100:00100000:0.0:1783951839.370933:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951839.370952:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465362304:0@lo:38:kworker.0 00000100:00100000:0.0:1783951839.370973:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951839.371006:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465362176:0@lo:400:kworker.0 00000100:00100000:0.0:1783951839.371032:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951839.371059:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465362048:0@lo:400:kworker.0 00000100:00100000:0.0:1783951839.371082:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951839.371116:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465361536 00000100:00100000:0.0:1783951839.371125:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465361536 00000100:00100000:0.0:1783951839.371169:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465361792 00000100:00100000:0.0:1783951839.371172:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465361792 00000100:00100000:0.0:1783951839.371186:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465361408 00000100:00100000:0.0:1783951839.371189:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465361408 00000100:00100000:0.0:1783951839.376017:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465361664 00000100:00100000:0.0:1783951839.376033:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465361664 00000100:00100000:0.0:1783951839.376047:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465362304 00000100:00100000:0.0:1783951839.376049:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465362304 00000100:00100000:0.0:1783951839.376063:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1783951839.376077:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465361536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951839.376203:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465361536:12345-0@lo:400:kworker.0 Request processed in 122us (6347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951839.376211:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1783951839.376230:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1783951839.376237:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465361792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951839.376271:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465361792:12345-0@lo:400:kworker.0 Request processed in 35us (6340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951839.376277:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1783951839.376289:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1783951839.376293:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465361408:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951839.376310:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951839.376342:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465361408:12345-0@lo:38:kworker.0 Request processed in 47us (5495us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951839.376347:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1783951839.376358:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1783951839.376362:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465361664:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951839.376370:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951839.376394:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465361664:12345-0@lo:38:kworker.0 Request processed in 31us (5501us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951839.376400:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1783951839.376410:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1783951839.376414:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465362304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951839.376422:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951839.376443:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465362304:12345-0@lo:38:kworker.0 Request processed in 28us (5469us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951839.376455:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1783951839.376490:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465361920 00000100:00100000:0.0:1783951839.376507:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465361920 00000100:00100000:0.0:1783951839.376527:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:0.0:1783951839.376531:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465361920:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951839.376541:0:8445:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951839.376568:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465361920:12345-0@lo:38:kworker.0 Request processed in 35us (5633us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951839.376573:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:0.0:1783951839.376608:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465362176 00000100:00100000:0.0:1783951839.376612:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465362176 00000100:00100000:0.0:1783951839.376639:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465362048 00000100:00100000:0.0:1783951839.376643:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465362048 00000100:00100000:0.0:1783951839.377128:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:0.0:1783951839.377187:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465362176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951839.377287:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465362176:12345-0@lo:400:kworker.0 Request processed in 149us (6253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951839.377293:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:0.0:1783951839.377308:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:0.0:1783951839.377314:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465362048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951839.377346:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465362048:12345-0@lo:400:kworker.0 Request processed in 32us (6263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951839.377351:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00080000:0.0:1783951839.377395:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951839.377401:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951839.377404:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465361408:0@lo:38:kworker.0 00000100:00080000:0.0:1783951839.377424:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951839.377427:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951839.377430:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465361664:0@lo:38:kworker.0 00000100:00080000:0.0:1783951839.377438:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951839.377441:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951839.377443:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465361920:0@lo:38:kworker.0 00000100:00080000:0.0:1783951839.377450:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951839.377453:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951839.377456:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465362304:0@lo:38:kworker.0 00000100:00100000:0.0:1783951839.377515:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465362176:0@lo:400:kworker.0 00000100:00100000:0.0:1783951839.377544:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465362048:0@lo:400:kworker.0 00000100:00100000:0.0:1783951839.377636:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465361536:0@lo:400:kworker.0 00000100:00100000:3.0:1783951839.377962:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465361792:0@lo:400:kworker.0 00000100:00100000:3.0:1783951839.377970:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465355392:0@lo:400:kworker.0 00000100:00100000:2.0:1783951839.605477:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951839.606296:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447683072 00000100:00100000:3.0:1783951839.606310:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447683072 00000100:00100000:3.0:1783951839.606380:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1016 00000100:00100000:3.0:1783951839.606390:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447683072:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951839.606486:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447683072:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 98us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951839.606505:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1016 00000400:00000100:2.0:1783951839.609258:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447682816 offset 0 length 520: 4 00000100:00100000:2.0:1783951839.609362:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951839.609872:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447682944 00000100:00100000:0.0:1783951839.609882:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447682944 00000100:00100000:0.0:1783951839.609918:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1048 00000100:00100000:0.0:1783951839.609925:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447682944:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:0.0:1783951839.609949:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951839.610005:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447682944:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 78us (643us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951839.610013:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1048 00010000:00010000:2.0:1783951839.777681:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951840.801808:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951840.864869:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951840.866279:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465362560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951840.866363:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951840.867697:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465362432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951840.867750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951840.867797:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465362560 00000100:00100000:3.0:1783951840.867805:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465362560 00000100:00100000:3.0:1783951840.867930:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465362432 00000100:00100000:3.0:1783951840.867934:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465362432 00000100:00100000:3.0:1783951840.867956:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:3.0:1783951840.867964:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465362560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951840.868105:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783951840.869763:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951840.869772:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951840.870457:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465362560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2485us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951840.870468:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:3.0:1783951840.870512:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:3.0:1783951840.870525:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465362432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951840.870560:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951840.870659:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465362432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951840.870666:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1783951840.870851:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465362432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951840.870967:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465362560:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783951841.833139:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951842.849705:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951843.877160:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951844.449774:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951844.449785:0:40998:0:(pinger.c:247:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783951844.449788:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951844.449792:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951844.449795:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951844.449802:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1783951844.449806:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951844.449813:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951844.449849:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b174af4e00 x1870605465362688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951844.449899:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951844.449902:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951844.449909:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951844.449913:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1783951844.449915:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951844.449919:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951844.449932:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b174af5180 x1870605465362944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951844.449958:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951844.449961:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951844.449963:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951844.449965:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1783951844.449967:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951844.449970:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951844.449980:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b174af6680 x1870605465363200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951844.449998:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951844.450001:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951844.450002:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951844.450005:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1783951844.450006:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951844.450009:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951844.450016:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047acd880 x1870605465363584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951844.450042:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465363072:0@lo:400:kworker.0 00000100:00100000:1.0:1783951844.450112:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951844.450240:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465362816:0@lo:400:kworker.0 00000100:00100000:3.0:1783951844.450272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951844.450307:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951844.450313:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465363456:0@lo:400:kworker.0 00000100:00100000:3.0:1783951844.450339:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951844.450372:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465363072 00000100:00100000:3.0:1783951844.450379:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465363072 00000100:00100000:3.0:1783951844.450429:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465362816 00000100:00100000:3.0:1783951844.450433:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465362816 00000100:00100000:3.0:1783951844.450466:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1783951844.450474:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465363072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951844.450523:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465363072:12345-0@lo:400:kworker.0 Request processed in 50us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951844.450530:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1783951844.450546:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1783951844.450552:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465362816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951844.450583:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465362816:12345-0@lo:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951844.450613:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1783951844.450631:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465363456 00000100:00100000:3.0:1783951844.450634:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465363456 00000100:00100000:3.0:1783951844.450662:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1783951844.450669:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465363456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951844.450700:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465363456:12345-0@lo:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951844.450705:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00080000:3.0:1783951844.450721:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951844.450725:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951844.450762:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465363456:0@lo:400:kworker.0 00000100:00100000:3.0:1783951844.450784:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465362816:0@lo:400:kworker.0 00000100:00100000:1.0:1783951844.450861:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465363072:0@lo:400:kworker.0 00000100:00100000:1.0:1783951844.450871:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951844.450878:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465363328:0@lo:400:kworker.0 00000100:00100000:1.0:1783951844.450904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951844.450977:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465363328 00000100:00100000:3.0:1783951844.450982:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465363328 00000100:00100000:3.0:1783951844.451023:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1783951844.451029:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465363328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951844.451064:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465363328:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951844.451069:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1783951844.451092:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465363328:0@lo:400:kworker.0 00000100:00100000:0.0:1783951844.451176:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465362688:0@lo:38:kworker.0 00000100:00100000:0.0:1783951844.451210:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951844.451239:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465362944:0@lo:38:kworker.0 00000100:00100000:0.0:1783951844.451261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951844.451278:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465363200:0@lo:38:kworker.0 00000100:00100000:0.0:1783951844.451301:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951844.451318:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465363584:0@lo:38:kworker.0 00000100:00100000:0.0:1783951844.451341:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951844.451368:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465362688 00000100:00100000:0.0:1783951844.451372:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465362688 00000100:00100000:0.0:1783951844.451394:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465362944 00000100:00100000:0.0:1783951844.451397:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465362944 00000100:00100000:0.0:1783951844.451409:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465363584 00000100:00100000:0.0:1783951844.451412:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465363584 00000100:00100000:0.0:1783951844.451423:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1783951844.451428:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465362688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951844.451445:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951844.451490:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465362688:12345-0@lo:38:kworker.0 Request processed in 60us (278us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951844.451497:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1783951844.451508:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1783951844.451512:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465362944:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951844.451521:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951844.451541:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465362944:12345-0@lo:38:kworker.0 Request processed in 28us (280us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951844.451554:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1783951844.451566:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1783951844.451571:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465363584:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951844.451580:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951844.451623:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465363584:12345-0@lo:38:kworker.0 Request processed in 51us (281us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951844.451628:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1783951844.451644:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465363200 00000100:00100000:0.0:1783951844.451648:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465363200 00000100:00100000:0.0:1783951844.451677:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1783951844.451683:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465363200:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951844.451692:0:23862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951844.451718:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465363200:12345-0@lo:38:kworker.0 Request processed in 34us (416us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951844.451723:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00080000:0.0:1783951844.451759:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951844.451764:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951844.451768:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465362688:0@lo:38:kworker.0 00000100:00080000:0.0:1783951844.451775:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951844.451779:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951844.451781:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465362944:0@lo:38:kworker.0 00000100:00080000:0.0:1783951844.451788:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951844.451790:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951844.451793:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465363200:0@lo:38:kworker.0 00000100:00080000:0.0:1783951844.451809:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951844.451812:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951844.451815:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465363584:0@lo:38:kworker.0 00000100:00080000:1.0:1783951844.454257:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951844.846974:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951844.847012:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951844.847101:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447683200 00000100:00100000:3.0:1783951844.847110:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447683200 00000100:00100000:3.0:1783951844.847167:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447683328 00000100:00100000:3.0:1783951844.847171:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447683328 00000100:00100000:3.0:1783951844.847235:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1019 00000100:00100000:3.0:1783951844.847245:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447683328:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951844.847302:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1052 00000100:00100000:1.0:1783951844.847309:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447683200:12345-192.168.202.48@tcp:38:kworker.0 00000100:00100000:3.0:1783951844.847320:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447683328:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 77us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951844.847326:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1019 00010000:00020000:1.0:1783951844.847328:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951844.847355:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447683200:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 46us (392us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951844.847361:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1052 00000100:00080000:2.0:1783951844.847524:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783951844.899749:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783951845.653492:0:85178:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783951845.653498:0:85178:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783951845.653499:0:85178:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783951845.653653:0:85178:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97b174696000 00000020:01000004:2.0:1783951845.653674:0:85178:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783951845.653689:0:85178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783951845.653703:0:85178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97b14545cd40) 00000020:00000080:2.0:1783951845.653722:0:85178:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783951845.806919:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783951845.811786:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783951845.814087:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1783951845.814383:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1783951845.814869:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1783951845.815412:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783951845.816717:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1783951845.817760:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1783951845.818327:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1783951845.819000:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783951845.819365:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1783951845.820216:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1783951845.820577:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1783951845.822034:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783951845.824610:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1783951845.825072:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783951845.825235:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783951845.825504:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783951845.825724:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1783951845.825867:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1783951845.826569:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1783951845.826794:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783951845.826987:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783951845.827249:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783951845.827798:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783951845.828189:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783951845.828485:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783951845.829556:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783951845.830083:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783951845.830359:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783951845.830613:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783951845.830838:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783951845.831030:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783951845.831276:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783951845.831577:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783951845.834369:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783951845.834886:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783951845.835119:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783951845.835448:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783951845.836392:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783951845.836847:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783951845.837364:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783951845.837896:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783951845.838176:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783951845.838382:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1783951845.838580:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1783951845.838739:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783951845.840893:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1783951845.841254:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1783951845.841523:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783951845.841910:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1783951845.842149:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1783951845.842419:0:85178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1783951845.843228:0:85178:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783951845.843799:0:85178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783951845.843810:0:85178:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783951845.843823:0:85178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb3eed 00000020:01000004:2.0:1783951845.843831:0:85178:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783951845.843842:0:85178:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783951845.843857:0:85178:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b174696000 from MGS 00000020:01000004:2.0:1783951845.843861:0:85178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783951845.843871:0:85178:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97b14545b380) 00000020:00000080:2.0:1783951845.843885:0:85178:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1783951845.843961:0:85178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b174696000 from MGS, refs=2 00080000:01000000:2.0:1783951845.843966:0:85178:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783951845.843971:0:85178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb3efb 00010000:00010000:2.0:1783951845.844100:0:85178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1783951845.850514:0:85178:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1783951845.852572:0:85182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783951845.852617:0:85178:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783951845.852651:0:85178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783951845.853640:0:85178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783951845.853869:0:85178:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951845.854374:0:85178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783951845.854381:0:85178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783951845.855527:0:85178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783951845.855536:0:85178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783951845.857653:0:85178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783951845.857665:0:85178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783951845.866277:0:85178:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783951845.866316:0:85178:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1783951845.866317:0:85178:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1783951845.866320:0:85178:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1783951845.866325:0:85178:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 66, was 0): CONNECTING 00000100:00100000:2.0:1783951845.866330:0:85178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:0.0:1783951845.920937:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951845.986683:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465363712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951845.986777:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951845.986894:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465363712 00000100:00100000:2.0:1783951845.986903:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465363712 00000100:00100000:2.0:1783951845.986971:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1783951845.986981:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465363712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951845.987016:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951845.987604:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951845.987618:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465363840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951845.987654:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951845.987683:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465363840 00000100:00100000:0.0:1783951845.987687:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465363840 00000100:00100000:0.0:1783951845.987727:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:0.0:1783951845.987735:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465363840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951845.987754:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951845.987788:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465363840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951845.987796:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:0.0:1783951845.987841:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465363840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951845.988849:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465363712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1865us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951845.988859:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:1.0:1783951845.989544:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465363712:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783951846.944866:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951847.968970:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951848.992745:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951849.569008:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951839/real 1783951839] req@ffff97b16dd6d500 x1870605465361280/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951849 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951849.569039:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97b16dd6d500 x1870605465361280/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951849 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783951849.569082:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951849.569090:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783951849.569109:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465361280:0@lo:250:kworker.0 00000100:00080000:2.0:1783951849.569114:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951849.569120:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783951849.569123:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951849.577752:0:48498:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3554 00000100:00080000:2.0:1783951849.577762:0:48498:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783951849.577790:0:48498:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951849.577828:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b147742d80 x1870605465363968/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951849.577849:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951849.577852:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951849.577855:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951849.577859:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3559 00000100:00080000:2.0:1783951849.577861:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951849.577865:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951849.577882:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b147741180 x1870605465364096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951849.577992:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465364224:0@lo:400:kworker.0 00000100:00100000:0.0:1783951849.578061:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951849.579044:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951849.579050:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951849.579053:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951849.579057:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3559 00000100:00080000:2.0:1783951849.579061:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951849.579065:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951849.579090:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047998000 x1870605465364352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951849.579126:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951849.579130:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951849.579132:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951849.579135:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3559 00000100:00080000:2.0:1783951849.579138:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951849.579141:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951849.579164:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04799aa00 x1870605465364608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:1.0:1783951849.579617:0:85178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1783951849.579635:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86b000/0x22c73c7857bb3bcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3bd6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.579643:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:00010000:1.0:1783951849.579648:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86b000/0x22c73c7857bb3bcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3bd6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.579656:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465364864:0@lo:400:kworker.0 10000000:01000000:1.0:1783951849.579658:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1783951849.579684:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465364736:0@lo:400:kworker.0 00000100:00100000:0.0:1783951849.579722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951849.579738:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.579750:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86b000/0x22c73c7857bb3bcf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3bd6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.579772:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762eba00/0x22c73c7857bb3b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3b3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951849.579779:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762eba00/0x22c73c7857bb3b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3b3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.579780:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465364224 10000000:01000000:1.0:1783951849.579788:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783951849.579789:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465364224 00010000:00010000:1.0:1783951849.579793:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.579797:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762eba00/0x22c73c7857bb3b35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3b3c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.579806:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762eb400/0x22c73c7857bb3b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3b58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951849.579816:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762eb400/0x22c73c7857bb3b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3b58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951849.579834:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951849.579838:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.579844:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762eb400/0x22c73c7857bb3b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3b58 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.579854:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762eac00/0x22c73c7857bb3b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3b82 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951849.579861:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762eac00/0x22c73c7857bb3b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3b82 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951849.579866:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951849.579871:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:0.0:1783951849.579873:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00010000:00010000:1.0:1783951849.579876:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762eac00/0x22c73c7857bb3b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3b82 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.579886:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465364224:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1783951849.579889:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb3b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3b90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951849.579897:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb3b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3b90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951849.579903:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951849.579907:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.579911:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb3b89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3b90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.579920:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb3ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3bac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951849.579939:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb3ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3bac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.579946:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465364224:12345-0@lo:400:kworker.0 Request processed in 63us (1882us total) trans 0 rc 0/0 10000000:01000000:1.0:1783951849.579948:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951849.579955:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.579961:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb3ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3bac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.579972:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762ea400/0x22c73c7857bb3bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3bba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.579974:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 10000000:00010000:1.0:1783951849.579997:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762ea400/0x22c73c7857bb3bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3bba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.580002:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465364864 10000000:01000000:1.0:1783951849.580005:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783951849.580008:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465364864 00010000:00010000:1.0:1783951849.580011:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.580017:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762ea400/0x22c73c7857bb3bb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3bba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.580029:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb3bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3be4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951849.580036:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb3bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3be4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.580042:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 10000000:01000000:1.0:1783951849.580044:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951849.580052:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:0.0:1783951849.580054:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465364864:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1783951849.580057:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb3bdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3be4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.580084:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762ebc00/0x22c73c7857bb3b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3b4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951849.580091:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762ebc00/0x22c73c7857bb3b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3b4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.580098:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465364864:12345-0@lo:400:kworker.0 Request processed in 45us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.580107:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 10000000:01000000:1.0:1783951849.580112:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951849.580118:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.580124:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762ebc00/0x22c73c7857bb3b43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3b4a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.580133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951849.580140:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb3b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3b66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.580156:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951849.580163:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465364480:0@lo:400:kworker.0 00000100:00100000:0.0:1783951849.580383:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951849.580422:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951849.580426:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951849.580436:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465364480 00000100:00100000:0.0:1783951849.580439:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465364480 00000100:00100000:0.0:1783951849.580624:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1783951849.580631:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465364480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951849.580670:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465364480:12345-0@lo:400:kworker.0 Request processed in 40us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.580676:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1783951849.580696:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465364736 00000100:00100000:0.0:1783951849.580699:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465364736 00000100:00100000:0.0:1783951849.580724:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:0.0:1783951849.580737:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465364736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951849.580769:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465364736:12345-0@lo:400:kworker.0 Request processed in 33us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.580776:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00080000:0.0:1783951849.581121:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951849.581124:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951849.581159:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465364480:0@lo:400:kworker.0 00000100:00100000:0.0:1783951849.581169:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465364736:0@lo:400:kworker.0 00000100:00100000:0.0:1783951849.581273:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465364864:0@lo:400:kworker.0 00000100:00100000:0.0:1783951849.581285:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465364224:0@lo:400:kworker.0 00000100:00080000:2.0:1783951849.582444:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951849.582451:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951849.582455:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951849.582468:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3559 00000100:00080000:2.0:1783951849.582472:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951849.582478:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951849.582521:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04799a300 x1870605465364992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:1.0:1783951849.583613:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb3b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3b66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951849.583624:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783951849.583646:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.583656:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb3b5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3b66 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.583677:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb3b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3b74 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951849.583683:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb3b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3b74 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951849.583688:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951849.583705:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.583710:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb3b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3b74 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.583718:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb3b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3b9e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951849.583724:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb3b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3b9e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951849.583729:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951849.583732:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.583735:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb3b97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3b9e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.583743:0:85178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb3bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb3bc8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951849.583750:0:85178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb3bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb3bc8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951849.583754:0:85178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783951849.583757:0:85178:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783951849.583760:0:85178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb3bc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb3bc8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951849.583777:0:85178:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 67, was 0): CONNECTING 00000100:00080000:1.0:1783951849.583781:0:85178:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1783951849.584397:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465363968:0@lo:250:kworker.0 00000100:00100000:3.0:1783951849.584475:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.584510:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465364096:0@lo:38:kworker.0 00000100:00100000:3.0:1783951849.584538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.584561:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465364352:0@lo:38:kworker.0 00000100:00100000:3.0:1783951849.584583:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.584615:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465364608:0@lo:38:kworker.0 00000100:00100000:3.0:1783951849.584639:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.584655:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465364992:0@lo:38:kworker.0 00000100:00100000:3.0:1783951849.584674:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.584706:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465364096 00000100:00100000:3.0:1783951849.584712:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465364096 00000100:00100000:3.0:1783951849.584738:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465364352 00000100:00100000:3.0:1783951849.584740:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465364352 00000100:00100000:3.0:1783951849.584751:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465364992 00000100:00100000:3.0:1783951849.584752:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465364992 00000100:00100000:3.0:1783951849.584768:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1783951849.584774:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465364096:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951849.584794:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951849.584829:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465364096:12345-0@lo:38:kworker.0 Request processed in 54us (290us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951849.584835:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1783951849.584859:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1783951849.584864:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465364352:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951849.584877:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951849.584905:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465364352:12345-0@lo:38:kworker.0 Request processed in 40us (321us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951849.584910:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1783951849.584920:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1783951849.584924:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465364992:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951849.584931:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951849.584951:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465364992:12345-0@lo:38:kworker.0 Request processed in 26us (275us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951849.584955:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1783951849.584980:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465364608 00000100:00100000:3.0:1783951849.584983:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465364608 00000100:00100000:0.0:1783951849.585548:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465363968 00000100:00100000:0.0:1783951849.585554:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465363968 00000100:00100000:0.0:1783951849.585607:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783951849.585613:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3641:x1870605465363968:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1783951849.585630:0:85183:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo t0 exp 0000000000000000 cur 3564 last 0 00000020:00000080:0.0:1783951849.585657:0:85183:0:(genops.c:1406:class_connect()) connect: client 75da5dc4-aa7e-42cf-a965-1b5f01232c6f, cookie 0x22c73c7857bb3f02 00000100:00080000:0.0:1783951849.585772:0:85183:0:(import.c:65:import_set_state_nolock()) ffff97b04d9f3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951849.585817:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:3641:x1870605465363968:12345-0@lo:250:kworker.0 Request processed in 203us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.585824:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783951849.585878:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.148@tcp: connect to target with instance 0 10000000:01000000:0.0:1783951849.585887:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:0.0:1783951849.585891:0:3641:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x22c73c7857bb3f02 00000100:00100000:3.0:1783951849.586300:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:3.0:1783951849.586308:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465364608:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951849.586321:0:8445:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951849.586352:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465364608:12345-0@lo:38:kworker.0 Request processed in 45us (1712us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951849.586358:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00080000:0.0:1783951849.609640:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:0.0:1783951849.609656:0:3641:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:1.0:1783951849.618922:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465363968:0@lo:250:kworker.0 00000100:00080000:1.0:1783951849.618964:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951849.618982:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951849.618996:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465364096:0@lo:38:kworker.0 00000100:00080000:1.0:1783951849.619012:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951849.619016:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951849.619019:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465364352:0@lo:38:kworker.0 00000100:00080000:1.0:1783951849.619029:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951849.619032:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951849.619034:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465364608:0@lo:38:kworker.0 00000100:00080000:0.0:1783951849.619038:0:85187:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.202.148@tcp to MGS@0@lo 00000100:00100000:0.0:1783951849.619042:0:85187:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783951849.619044:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951849.619046:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 10000000:01000000:0.0:1783951849.619046:0:85187:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:1.0:1783951849.619049:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465364992:0@lo:38:kworker.0 00000100:00080000:0.0:1783951849.619056:0:85187:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1783951849.619060:0:85187:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from RECOVER to FULL 10000000:01000000:0.0:1783951849.619062:0:85187:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783951849.619091:0:85187:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:0.0:1783951849.619095:0:85187:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) MGC192.168.202.148@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:2.0:1783951849.619176:0:48498:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.148@tcp 10000000:01000000:2.0:1783951849.619210:0:48498:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1783951849.619213:0:48498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783951849.619215:0:48498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783951849.619216:0:48498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951849.619218:0:48498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951849.619219:0:48498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951849.619220:0:48498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951849.619221:0:48498:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951849.619223:0:48498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951849.619224:0:48498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783951849.619270:0:48498:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1783951849.619277:0:48498:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1783951849.619279:0:48498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783951849.619280:0:48498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783951849.619281:0:48498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951849.619282:0:48498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951849.619283:0:48498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951849.619284:0:48498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951849.619285:0:48498:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951849.619287:0:48498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951849.619288:0:48498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783951849.619317:0:48498:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1783951849.619327:0:48498:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1783951849.619329:0:48498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783951849.619330:0:48498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783951849.619331:0:48498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951849.619332:0:48498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951849.619333:0:48498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951849.619334:0:48498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951849.619335:0:48498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951849.619336:0:48498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951849.619337:0:48498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783951849.619352:0:48498:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1783951849.619372:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951849.619385:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465365120:0@lo:253:kworker.0 00000100:00100000:1.0:1783951849.619390:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465365248:0@lo:253:kworker.0 00000100:00100000:2.0:1783951849.619459:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951849.619527:0:85178:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1783951849.619537:0:85178:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783951849.619572:0:85178:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783951849.619576:0:85178:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783951849.619692:0:85178:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783951849.619718:0:85178:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783951849.619722:0:85178:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783951849.619723:0:85178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951849.619724:0:85178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951849.619725:0:85178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951849.619726:0:85178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951849.619727:0:85178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951849.619728:0:85178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951849.619730:0:85178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951849.619731:0:85178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951849.619732:0:85178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783951849.619735:0:85178:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783951849.619737:0:85178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783951849.619738:0:85178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783951849.619739:0:85178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951849.619740:0:85178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951849.619741:0:85178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951849.619742:0:85178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951849.619743:0:85178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951849.619744:0:85178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783951849.619745:0:85178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951849.619746:0:85178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783951849.619758:0:85178:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783951849.619771:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465365504:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783951849.619838:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465365376:0@lo:253:kworker.0 00000100:00100000:1.0:1783951849.621471:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.621642:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465365120 00000100:00100000:1.0:1783951849.621650:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465365120 00000100:00100000:1.0:1783951849.621690:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465365248 00000100:00100000:1.0:1783951849.621693:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465365248 00000100:00100000:1.0:1783951849.621711:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783951849.621719:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:3644:x1870605465365120:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783951849.621751:0:85185:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1783951849.621857:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951849.621864:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:3642:x1870605465365248:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783951849.621880:0:85184:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:1.0:1783951849.621911:0:85188:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783951849.622397:0:85185:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 103 20000000:01000000:1.0:1783951849.627156:0:85189:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783951849.627166:0:85189:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1783951849.627169:0:85189:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783951849.627172:0:85189:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783951849.627436:0:85189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783951849.627749:0:85185:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783951849.627771:0:85185:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783951849.629806:0:85185:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783951849.629818:0:85185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783951849.629969:0:85184:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783951849.630330:0:85188:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783951849.630335:0:85188:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783951849.630358:0:85188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.630376:0:85188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783951849.630385:0:85188:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050810s 00010000:00010000:1.0:1783951849.630390:0:85188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.630397:0:85188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.630417:0:85188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.630425:0:85188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.630432:0:85188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e5e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951849.630436:0:85188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.630444:0:85188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.630469:0:85188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.630477:0:85188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.630484:0:85188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb3f09 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951849.630722:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:3644:x1870605465365120:12345-0@lo:253:kworker.0 Request processed in 9001us (11260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.630732:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:2.0:1783951849.630838:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783951849.630841:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783951849.630843:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951849.630844:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951849.630845:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951849.630847:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951849.630848:0:3644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951849.630850:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951849.630851:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783951849.630855:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465365120:0@lo:253:kworker.0 00000100:00100000:1.0:1783951849.632819:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.632853:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16134e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951849.633300:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465365504 00000100:00100000:0.0:1783951849.633309:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465365504 00000100:00100000:0.0:1783951849.633365:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783951849.633375:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:85178:x1870605465365504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783951849.633433:0:85183:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783951849.633436:0:85183:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783951849.633439:0:85183:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1783951849.633445:0:85183:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783951849.638009:0:85184:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783951849.638031:0:85184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783951849.638276:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:85178:x1870605465365504:12345-0@lo:253:mount.lustre.0 Request processed in 4898us (5457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.638289:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951849.638445:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465365504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783951849.638459:0:85178:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783951849.638462:0:85178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783951849.638463:0:85178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783951849.638465:0:85178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951849.638466:0:85178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951849.638467:0:85178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951849.638468:0:85178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951849.638470:0:85178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783951849.638472:0:85178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783951849.638474:0:85178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951849.638475:0:85178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783951849.638497:0:85178:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b174696000 from lustre-MDT0000 10000000:01000000:1.0:1783951849.638541:0:85178:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783951849.638545:0:85178:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783951849.638567:0:85178:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97b174696000 10000000:01000000:1.0:1783951849.638571:0:85178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783951849.638576:0:85178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97b174696000 10000000:01000000:1.0:1783951849.638578:0:85178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783951849.638581:0:85178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b174696000 from 1 10000000:01000000:1.0:1783951849.638584:0:85178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783951849.638651:0:85178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.638663:0:85178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.638673:0:85178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951849.638692:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465365632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951849.638728:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.638753:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc63c0 going to sleep for 11 seconds 20000000:01000000:2.0:1783951849.638925:0:85188:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783951849.638929:0:85188:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783951849.638946:0:85188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.638960:0:85188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783951849.638970:0:85188:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050810s 00010000:00010000:2.0:1783951849.638982:0:85188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.638989:0:85188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.638996:0:85188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.639003:0:85188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.639010:0:85188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aa200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951849.639014:0:85188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.639022:0:85188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.639035:0:85188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.639042:0:85188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.639049:0:85188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1413aa200/0x22c73c7857bb3f17 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951849.639305:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:3642:x1870605465365248:12345-0@lo:253:kworker.0 Request processed in 17440us (17836us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.639314:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783951849.639341:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465365632 00000100:00100000:1.0:1783951849.639347:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465365632 00000100:00100000:1.0:1783951849.639378:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951849.639385:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:85178:x1870605465365632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951849.639396:0:85184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951849.639418:0:85184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1767e5400/0x22c73c7857bb3f1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb3f10 expref: -99 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639437:0:85184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1767e5400/0x22c73c7857bb3f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb3f10 expref: 6 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639453:0:85184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1767e5400/0x22c73c7857bb3f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb3f10 expref: 6 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639460:0:85184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1767e5400, rc 0) 00000100:00100000:1.0:1783951849.639492:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:85178:x1870605465365632:12345-0@lo:101:mount.lustre.0 Request processed in 107us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.639508:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783951849.639546:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465365632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951849.639559:0:85178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639566:0:85178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951849.639578:0:85178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783951849.639621:0:85178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639630:0:85178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951849.639636:0:85178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783951849.639640:0:85178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951849.639644:0:85178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97b174696000 10000000:01000000:1.0:1783951849.639647:0:85178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783951849.639650:0:85178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783951849.639653:0:85178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783951849.639676:0:85178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639684:0:85178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639691:0:85178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951849.639705:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465365760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951849.639731:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.639753:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465365760 00000100:00100000:1.0:1783951849.639757:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465365760 00000100:00100000:1.0:1783951849.639775:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951849.639782:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:85178:x1870605465365760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951849.639789:0:85184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951849.639797:0:85184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1767e5000/0x22c73c7857bb3f2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb3f25 expref: -99 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639809:0:85184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1767e5000/0x22c73c7857bb3f2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb3f25 expref: 7 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639817:0:85184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1767e5000/0x22c73c7857bb3f2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb3f25 expref: 7 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639824:0:85184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1767e5000, rc 0) 00000100:00100000:1.0:1783951849.639847:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:85178:x1870605465365760:12345-0@lo:101:mount.lustre.0 Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.639853:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783951849.639889:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951849.639902:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465365760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951849.639912:0:85178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.639920:0:85178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951849.639966:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465365888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951849.639990:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.640008:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465365888 00000100:00100000:1.0:1783951849.640012:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465365888 00000100:00100000:1.0:1783951849.640028:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951849.640034:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:85178:x1870605465365888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951849.640172:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:85178:x1870605465365888:12345-0@lo:501:mount.lustre.0 Request processed in 137us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.640179:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783951849.640200:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048e2db40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951849.640211:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465365888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951849.640234:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465366016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951849.640270:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.640289:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465366016 00000100:00100000:1.0:1783951849.640292:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465366016 00000100:00100000:1.0:1783951849.640309:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783951849.640315:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:85178:x1870605465366016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951849.640449:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048e2db40 going to sleep for 11 seconds 00000020:01000004:2.0:1783951849.640795:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783951849.640798:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783951849.640799:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951849.640801:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951849.640802:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951849.640810:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951849.640812:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951849.640813:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951849.640815:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783951849.640818:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465365248:0@lo:253:kworker.0 00000100:00100000:3.0:1783951849.641578:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951849.641809:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465365376 00000100:00100000:0.0:1783951849.641816:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465365376 00000100:00100000:0.0:1783951849.641855:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951849.641862:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:3643:x1870605465365376:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783951849.641887:0:85183:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783951849.641899:0:85183:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783951849.642491:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:85178:x1870605465366016:12345-0@lo:503:mount.lustre.0 Request processed in 2174us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.642508:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 20000000:01000000:0.0:1783951849.646995:0:85183:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783951849.647016:0:85183:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1783951849.647351:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3643:x1870605465365376:12345-0@lo:253:kworker.0 Request processed in 5485us (5770us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.647365:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000004:3.0:1783951849.647510:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783951849.647514:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783951849.647515:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951849.647516:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951849.647531:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951849.647533:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951849.647534:0:3643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951849.647536:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951849.647538:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783951849.647542:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465365376:0@lo:253:kworker.0 20000000:01000000:1.0:1783951849.647757:0:85188:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783951849.647762:0:85188:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783951849.647783:0:85188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.647798:0:85188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783951849.647807:0:85188:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050810s 00010000:00010000:1.0:1783951849.647812:0:85188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.647818:0:85188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.647824:0:85188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.647830:0:85188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.647836:0:85188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951849.647840:0:85188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.647847:0:85188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.647860:0:85188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.647874:0:85188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.647880:0:85188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1767e4e00/0x22c73c7857bb3f33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951849.649118:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465366016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951849.649843:0:85190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85190:1870605465366144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951849.649919:0:85190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.649962:0:85190:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951849.650014:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465366144 00000100:00100000:0.0:1783951849.650021:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465366144 00000100:00100000:0.0:1783951849.650069:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783951849.650079:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:85190:x1870605465366144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951849.651364:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:85190:x1870605465366144:12345-0@lo:502:llog_process_th.0 Request processed in 1283us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.651381:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951849.651784:0:85190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85190:1870605465366144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951849.651816:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951849.651828:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.651830:0:85190:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783951849.651835:0:85190:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783951849.651838:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951849.651852:0:85190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97b1454599c0) 00000020:00000080:2.0:1783951849.651875:0:85190:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1783951849.651880:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783951849.651968:0:85190:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783951849.651975:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb3f41 00000020:00000080:2.0:1783951849.652323:0:85190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783951849.652328:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951849.652332:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.652334:0:85190:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783951849.652337:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951849.652341:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.652342:0:85190:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783951849.652346:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951849.652354:0:85190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97b0465d4d40) 00000020:00000080:2.0:1783951849.652367:0:85190:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1783951849.652378:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783951849.652380:0:85190:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783951849.652383:0:85190:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783951849.652391:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783951849.652454:0:85190:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b174696000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783951849.652468:0:85190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97b174b3b380) 00000020:00000080:2.0:1783951849.652479:0:85190:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1783951849.652545:0:85190:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783951849.652550:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb3f56 00000020:00000080:2.0:1783951849.653019:0:85190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783951849.653027:0:85190:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783951849.653032:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x22c73c7857bb3f5d 00080000:01000000:2.0:1783951849.653037:0:85190:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783951849.653041:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb3f64 00010000:00010000:2.0:1783951849.792332:0:85190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1783951849.792478:0:85190:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 458183b2-4c6d-478c-9fed-a955779e6611 idx: 0 lr: 0 srv lr: 98784247808 lx: 0 gen 23 00000001:00080000:2.0:1783951849.792525:0:85190:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 22 00000001:00000004:2.0:1783951849.792547:0:85190:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:2.0:1783951849.796913:0:85190:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1783951849.796987:0:85190:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b15253b480: xid 1870605447674880, transno 98784247809, client gen 23, slot idx 0 00000020:00000080:2.0:1783951849.797740:0:85190:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97b174b3cd40) 00000020:00000080:2.0:1783951849.799542:0:85190:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1783951849.799655:0:85190:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783951849.799665:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb3f80 00000020:00000080:2.0:1783951849.807549:0:85190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783951849.824647:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x22c73c7857bb3f87 00000020:00000080:2.0:1783951849.826754:0:85190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783951849.826768:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951849.826774:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.826776:0:85190:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783951849.826779:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783951849.826793:0:85190:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1783951849.826794:0:85190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951849.826796:0:85190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951849.826798:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783951849.826801:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.826802:0:85190:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783951849.826805:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951849.826810:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.826811:0:85190:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783951849.826816:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783951849.826867:0:85190:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783951849.826885:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951849.826888:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.826889:0:85190:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783951849.826891:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951849.826895:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.826896:0:85190:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1783951849.826898:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783951849.826904:0:85190:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:00000080:2.0:1783951849.826929:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951849.826945:0:85190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff97b174b399c0) 00000020:00000080:2.0:1783951849.826964:0:85190:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1783951849.826969:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783951849.827027:0:85190:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1783951849.827033:0:85190:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783951849.827038:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb3f95 00010000:00080000:2.0:1783951849.827068:0:85190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b049659000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:3.0:1783951849.840492:0:85190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1783951849.843572:0:85190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951849.843648:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783951849.843687:0:85190:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783951849.843712:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb3f9c 00000100:00080000:2.0:1783951849.843722:0:85190:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951849.843728:0:85190:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97b049659000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951849.843771:0:85190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04799bb80 x1870605465366272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951849.843791:0:85190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1783951849.843849:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951849.843853:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.843855:0:85190:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783951849.843858:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783951849.843861:0:85190:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1783951849.843863:0:85190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951849.843864:0:85190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951849.843866:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783951849.843868:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.843870:0:85190:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783951849.843872:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783951849.843877:0:85190:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783951849.843880:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.843882:0:85190:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783951849.843885:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783951849.843888:0:85190:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:2.0:1783951849.843912:0:85190:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783951849.843916:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951849.843929:0:85190:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97b0476a99c0) 00000020:00000080:2.0:1783951849.843943:0:85190:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783951849.843949:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783951849.844006:0:85190:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783951849.844013:0:85190:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783951849.844020:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb3faa 00010000:00080000:2.0:1783951849.844050:0:85190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b18160d000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:2.0:1783951849.847221:0:85190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1783951849.847844:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465366272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783951849.847917:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.850735:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465366272 00000100:00100000:2.0:1783951849.850750:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465366272 00000100:00100000:2.0:1783951849.850818:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:2.0:1783951849.850827:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465366272:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783951849.850858:0:23862:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3564 last 0 00000020:00000080:2.0:1783951849.850894:0:23862:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb3fb1 00000004:00100000:2.0:1783951849.850910:0:23862:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951849.851010:0:23862:0:(import.c:65:import_set_state_nolock()) ffff97b18160e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951849.851106:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465366272:12345-0@lo:38:llog_process_th.0 Request processed in 279us (3188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951849.851114:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00100000:2.0:1783951849.851173:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783951849.851183:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:2.0:1783951849.851191:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783951849.851197:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783951849.851199:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b049659000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783951849.851210:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465366272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783951849.851956:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951849.851970:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465366400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951849.852014:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.852358:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465366400 00000100:00100000:3.0:1783951849.852366:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465366400 00000100:00100000:3.0:1783951849.852410:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:3.0:1783951849.852418:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465366400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951849.852449:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951849.852491:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465366400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951849.852498:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:1.0:1783951849.852631:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465366400:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1783951849.852700:0:85190:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783951849.852726:0:85190:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783951849.853061:0:85190:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:1.0:1783951849.853922:0:85190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951849.853947:0:85190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:1.0:1783951849.854086:0:85190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:3.0:1783951849.855463:0:85196:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:3.0:1783951849.855469:0:85196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783951849.865063:0:85190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951849.865078:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783951849.874002:0:85190:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783951849.874039:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb3fb8 00000100:00080000:1.0:1783951849.874052:0:85190:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783951849.874058:0:85190:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b18160d000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951849.874194:0:85190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047acf100 x1870605465366528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951849.874224:0:85190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1783951849.874332:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465366528:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783951849.874418:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.874478:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465366528 00000100:00100000:2.0:1783951849.874484:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465366528 00000100:00100000:2.0:1783951849.874516:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4888 00000100:00100000:2.0:1783951849.874524:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3641:x1870605465366528:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1783951849.874548:0:26198:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3564 last 0 00000020:00000080:2.0:1783951849.874574:0:26198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb3fbf 00002000:00100000:2.0:1783951849.874605:0:26198:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97b166f57800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783951849.874610:0:26198:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783951849.874618:0:26198:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783951849.874696:0:26198:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783951849.874718:0:26198:0:(import.c:65:import_set_state_nolock()) ffff97b14de86000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951849.874767:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465366528:12345-0@lo:8:llog_process_th.0 Request processed in 241us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951849.874774:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4888 00000100:00100000:2.0:1783951849.874810:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783951849.874818:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783951849.874824:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783951849.874828:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783951849.874831:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b18160d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000020:01000000:1.0:1783951849.874985:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951849.874991:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951849.874993:0:85190:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783951849.874996:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783951849.874999:0:85190:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1783951849.875001:0:85190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951849.875002:0:85190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951849.875004:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783951849.875007:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951849.875008:0:85190:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783951849.875011:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783951849.875015:0:85190:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783951849.875018:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951849.875019:0:85190:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783951849.875023:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783951849.875026:0:85190:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:1.0:1783951849.875047:0:85190:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783951849.875050:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951849.875061:0:85190:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97b1449b3380) 00000020:00000080:1.0:1783951849.875079:0:85190:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783951849.875085:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783951849.875165:0:85190:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783951849.875171:0:85190:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783951849.875177:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb3fcd 00010000:00080000:1.0:1783951849.875202:0:85190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b174b31800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1783951849.875423:0:85190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1783951849.875488:0:85190:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783951849.875501:0:85190:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783951849.883003:0:85190:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000100:00100000:3.0:1783951849.884946:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465366656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951849.885025:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783951849.885371:0:85190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951849.885439:0:85190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:0.0:1783951849.885630:0:85190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000100:00100000:1.0:1783951849.885886:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465366656 00000100:00100000:1.0:1783951849.885895:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465366656 00000100:00100000:1.0:1783951849.885959:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:1.0:1783951849.885975:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465366656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951849.886006:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951849.886060:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465366656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.886067:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00080000:3.0:1783951849.886192:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951849.886230:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465366656:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1783951849.886744:0:85198:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:0.0:1783951849.886749:0:85198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783951849.886894:0:85198:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:0.0:1783951849.886912:0:85198:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783951849.887027:0:85198:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:0.0:1783951849.887030:0:85198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1783951849.887796:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783951849.887807:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465366528:0@lo:8:llog_process_th.0 00000040:00080000:0.0:1783951849.888507:0:85196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 3 count 2 00000040:00080000:0.0:1783951849.888536:0:85196:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:0.0:1783951849.888539:0:85196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1783951849.888559:0:85196:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783951849.888628:0:85196:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3564831039246ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783951849.888635:0:85196:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783951849.888701:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465366784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783951849.888760:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951849.889902:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465366784 00000100:00100000:0.0:1783951849.889912:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465366784 00000100:00100000:0.0:1783951849.889968:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4889 00000100:00100000:0.0:1783951849.889978:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17743bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465366784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783951849.890008:0:26197:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1698 count 1 00000100:00100000:0.0:1783951849.890305:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17743bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465366784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 328us (1543us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951849.890314:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4889 00000004:00080000:1.0:1783951849.890670:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97b16dd6ea00, transno 0 00000004:00080000:1.0:1783951849.890677:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97b16dd6ea00/1, rc -2, transno 0 00000100:00100000:1.0:1783951849.890695:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465366784:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1783951849.890973:0:85196:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1783951849.890994:0:85196:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783951849.891982:0:85190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951849.891996:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783951849.892043:0:85190:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783951849.892069:0:85190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb3fd4 00000100:00080000:2.0:1783951849.892077:0:85190:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951849.892082:0:85190:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97b174b31800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951849.892119:0:85190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047999c00 x1870605465366912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951849.892325:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465366912:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783951849.892380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951849.892722:0:85190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783951849.892786:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951849.892790:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.892792:0:85190:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783951849.892795:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951849.892799:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.892801:0:85190:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783951849.892813:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783951849.892815:0:85190:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783951849.892817:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951849.892820:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.892821:0:85190:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783951849.892823:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951849.892826:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.892827:0:85190:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783951849.892831:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783951849.892862:0:85190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85190:1870605465367040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951849.892908:0:85190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.892927:0:85190:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c7f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951849.893274:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465366912 00000100:00100000:3.0:1783951849.893281:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465366912 00000100:00100000:3.0:1783951849.893320:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4890 00000100:00100000:3.0:1783951849.893326:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3641:x1870605465366912:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1783951849.893360:0:15187:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3564 last 0 00000020:00000080:3.0:1783951849.893385:0:15187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb3fdb 00002000:00100000:3.0:1783951849.893408:0:15187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97b176bcf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783951849.893413:0:15187:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783951849.893415:0:15187:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783951849.893478:0:15187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783951849.893501:0:15187:0:(import.c:65:import_set_state_nolock()) ffff97b176bcd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951849.893559:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465366912:12345-0@lo:8:llog_process_th.0 Request processed in 232us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951849.893567:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4890 00000100:00100000:0.0:1783951849.893700:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465367040 00000100:00100000:0.0:1783951849.893710:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465367040 00000100:00100000:0.0:1783951849.893748:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951849.893755:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:85190:x1870605465367040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951849.893857:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:85190:x1870605465367040:12345-0@lo:502:llog_process_th.0 Request processed in 102us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.893865:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783951849.894068:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783951849.894077:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783951849.894084:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783951849.894089:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783951849.894091:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b174b31800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783951849.894165:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783951849.894171:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465366912:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783951849.894202:0:85190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85190:1870605465367040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783951849.894225:0:85190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951849.894230:0:85190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951849.894232:0:85190:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783951849.894236:0:85190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1783951849.894312:0:85178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1783951849.894336:0:85178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783951849.894350:0:85178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.894361:0:85178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951849.894374:0:85178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b174696000 from 1 10000000:01000000:2.0:1783951849.894376:0:85178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783951849.894413:0:85178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.894421:0:85178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.894430:0:85178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951849.894445:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465367168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951849.894474:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.894498:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951849.894522:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465367168 00000100:00100000:2.0:1783951849.894526:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465367168 00000100:00100000:2.0:1783951849.894549:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783951849.894555:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:85178:x1870605465367168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951849.894564:0:85185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951849.894577:0:85185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb3fe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb3fe2 expref: -99 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.894631:0:85185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb3fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb3fe2 expref: 9 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.894643:0:85185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb3fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb3fe2 expref: 9 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.894663:0:85185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1413ab000, rc 0) 00000100:00100000:2.0:1783951849.894694:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:85178:x1870605465367168:12345-0@lo:101:mount.lustre.0 Request processed in 139us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951849.894700:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783951849.894747:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465367168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951849.894759:0:85178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.894768:0:85178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783951849.895411:0:85198:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783951849.895477:0:85198:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3564837888292ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783951849.895484:0:85198:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783951849.901046:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465367296:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783951849.901145:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.901521:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951849.901826:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465367296 00000100:00100000:0.0:1783951849.901834:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465367296 00000100:00100000:0.0:1783951849.901889:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951849.901899:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:85178:x1870605465367296:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783951849.901921:0:85185:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783951849.901940:0:85185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783951849.901944:0:85185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783951849.901947:0:85185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783951849.901950:0:85185:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 106 00000100:00100000:0.0:1783951849.902051:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:85178:x1870605465367296:12345-0@lo:256:mount.lustre.0 Request processed in 153us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.902059:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951849.902357:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465367296:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783951849.902964:0:85178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783951849.902979:0:85178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951849.902990:0:85178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951849.902998:0:85178:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b174696000 from 1 10000000:01000000:3.0:1783951849.903001:0:85178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951849.903031:0:85178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951849.903039:0:85178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951849.903048:0:85178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951849.903074:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465367424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783951849.903122:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.903156:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951849.903180:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465367424 00000100:00100000:3.0:1783951849.903185:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465367424 00000100:00100000:3.0:1783951849.903213:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951849.903220:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:85178:x1870605465367424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951849.903230:0:85184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951849.903244:0:85184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14dc72200/0x22c73c7857bb3ff7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb3ff0 expref: -99 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951849.903264:0:85184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14dc72200/0x22c73c7857bb3ff7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb3ff0 expref: 10 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951849.903274:0:85184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14dc72200/0x22c73c7857bb3ff7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb3ff0 expref: 10 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951849.903283:0:85184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14dc72200, rc 0) 00000100:00100000:3.0:1783951849.903313:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85178:x1870605465367424:12345-0@lo:101:mount.lustre.0 Request processed in 94us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951849.903319:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951849.903353:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465367424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951849.903364:0:85178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951849.903372:0:85178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951849.903443:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465367552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951849.903467:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.903480:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951849.903492:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465367552 00000100:00100000:3.0:1783951849.903495:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465367552 00000100:00100000:3.0:1783951849.903515:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951849.903521:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85178:x1870605465367552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951849.903661:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85178:x1870605465367552:12345-0@lo:501:mount.lustre.0 Request processed in 139us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951849.903667:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951849.903698:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465367552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951849.903725:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465367680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951849.903761:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.903778:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951849.903787:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465367680 00000100:00100000:3.0:1783951849.903790:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465367680 00000100:00100000:3.0:1783951849.903808:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951849.903813:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85178:x1870605465367680:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951849.903884:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85178:x1870605465367680:12345-0@lo:503:mount.lustre.0 Request processed in 70us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951849.903890:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951849.903928:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465367680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951849.904131:0:85200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85200:1870605465367808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951849.904167:0:85200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.904185:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465367808 00000100:00100000:3.0:1783951849.904189:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465367808 00000100:00100000:3.0:1783951849.904210:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783951849.904215:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85200:x1870605465367808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951849.904331:0:85200:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf0c0 going to sleep for 11 seconds 00000004:00080000:0.0:1783951849.904842:0:85179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783951849.905782:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951849.905798:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465367936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951849.905845:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.914027:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465367936 00000100:00100000:3.0:1783951849.914043:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465367936 00000100:00100000:3.0:1783951849.914116:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:3.0:1783951849.914127:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465367936:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783951849.914158:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1783951849.914170:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951849.914261:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465367936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (8415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951849.914269:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1783951849.914494:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465367936:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1783951849.914835:0:85179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1783951849.915925:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85200:x1870605465367808:12345-0@lo:502:llog_process_th.0 Request processed in 11704us (11751us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951849.915936:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783951849.916050:0:85200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85200:1870605465367808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783951849.916089:0:85200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951849.916108:0:85200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951849.916111:0:85200:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783951849.916118:0:85200:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b174696000 00000020:00000080:3.0:1783951849.916121:0:85200:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951849.916131:0:85200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951849.916133:0:85200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951849.916135:0:85200:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783951849.916137:0:85200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951849.916139:0:85200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951849.916141:0:85200:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783951849.916144:0:85200:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b174696000 00000020:00000080:3.0:1783951849.916146:0:85200:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783951849.916250:0:85200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85200:1870605465368064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951849.916301:0:85200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951849.916330:0:85200:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b15634ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951849.924839:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465368064 00000100:00100000:1.0:1783951849.924854:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465368064 00000100:00100000:1.0:1783951849.924918:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783951849.924929:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85200:x1870605465368064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951849.925115:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85200:x1870605465368064:12345-0@lo:502:llog_process_th.0 Request processed in 187us (8813us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.925123:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783951849.925665:0:85200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85200:1870605465368064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951849.925705:0:85200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951849.925719:0:85200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951849.925721:0:85200:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783951849.925725:0:85200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783951849.925900:0:85178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1783951849.925927:0:85178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951849.925948:0:85178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.925959:0:85178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951849.926007:0:85178:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783951849.926011:0:85178:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97b174696000 10000000:01000000:1.0:1783951849.926020:0:85178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97b174696000 10000000:01000000:1.0:1783951849.926025:0:85178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783951849.926031:0:85178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174696000 from 1 10000000:01000000:1.0:1783951849.926034:0:85178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783951849.926066:0:85178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.926075:0:85178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.926085:0:85178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951849.926116:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465368192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783951849.926160:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.926189:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fb7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951849.927250:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465368192 00000100:00100000:2.0:1783951849.927259:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465368192 00000100:00100000:2.0:1783951849.927299:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783951849.927308:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85178:x1870605465368192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951849.927321:0:85184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951849.927336:0:85184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1413ab200/0x22c73c7857bb4005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb3ffe expref: -99 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.927362:0:85184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1413ab200/0x22c73c7857bb4005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb3ffe expref: 11 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.927383:0:85184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1413ab200/0x22c73c7857bb4005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb3ffe expref: 11 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.927392:0:85184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1413ab200, rc 0) 00000100:00100000:2.0:1783951849.927504:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85178:x1870605465368192:12345-0@lo:101:mount.lustre.0 Request processed in 196us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951849.927511:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783951849.934833:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465368192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951849.934863:0:85178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951849.934876:0:85178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951849.935024:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465368320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951849.935088:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.935136:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fb7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951849.935223:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465368320 00000100:00100000:0.0:1783951849.935230:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465368320 00000100:00100000:0.0:1783951849.935277:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951849.935286:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85178:x1870605465368320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951849.935433:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85178:x1870605465368320:12345-0@lo:501:mount.lustre.0 Request processed in 147us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.935440:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783951849.935893:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465368320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951849.935927:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465368448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951849.935969:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.935992:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465368448 00000100:00100000:1.0:1783951849.935996:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465368448 00000100:00100000:1.0:1783951849.936024:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783951849.936031:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85178:x1870605465368448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783951849.936121:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85178:x1870605465368448:12345-0@lo:503:mount.lustre.0 Request processed in 89us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.936137:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783951849.936175:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fb7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951849.936187:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465368448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951849.939428:0:85203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85203:1870605465368576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951849.939513:0:85203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.939556:0:85203:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1748e69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951849.939622:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465368576 00000100:00100000:1.0:1783951849.939629:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465368576 00000100:00100000:1.0:1783951849.939674:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783951849.939683:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85203:x1870605465368576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951849.939799:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85203:x1870605465368576:12345-0@lo:502:llog_process_th.0 Request processed in 117us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.939807:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951849.939918:0:85203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85203:1870605465368576:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783951849.939975:0:85203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783951849.939990:0:85203:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97b0476a8000) 00000020:00000080:2.0:1783951849.940016:0:85203:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783951849.940181:0:85203:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b174696000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783951849.940185:0:85203:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b174696000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783951849.940187:0:85203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174696000 4 00010000:00080000:2.0:1783951849.940212:0:85203:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b144574000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:2.0:1783951849.941850:0:85203:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1783951849.941965:0:85203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783951849.942005:0:85203:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783951849.942018:0:85203:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x22c73c7857bb4013 00000100:00080000:2.0:1783951849.942027:0:85203:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951849.942032:0:85203:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b144574000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951849.942065:0:85203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047999c00 x1870605465368704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951849.942103:0:85203:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783951849.942771:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465368704:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783951849.942837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.947661:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465368704 00000100:00100000:2.0:1783951849.947676:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465368704 00000100:00100000:2.0:1783951849.947727:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1783951849.947735:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465368704:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783951849.947832:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465368704:12345-0@lo:38:llog_process_th.0 Request processed in 95us (4993us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783951849.947839:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1783951849.947972:0:85203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85203:1870605465368832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951849.948028:0:85203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.948056:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465368832 00000100:00100000:2.0:1783951849.948060:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465368832 00000100:00100000:2.0:1783951849.948092:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783951849.948719:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783951849.948728:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b144574000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951849.948733:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951849.948737:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465368704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783951849.950609:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85203:x1870605465368832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951849.950750:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85203:x1870605465368832:12345-0@lo:502:llog_process_th.0 Request processed in 2652us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951849.950758:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783951849.950819:0:85203:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1748e6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951849.950838:0:85203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85203:1870605465368832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951849.950888:0:85203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85203:1870605465368960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951849.950922:0:85203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.950946:0:85203:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1748e6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951849.951037:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465368960 00000100:00100000:1.0:1783951849.951043:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465368960 00000100:00100000:1.0:1783951849.951078:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951849.951085:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85203:x1870605465368960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951849.951155:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85203:x1870605465368960:12345-0@lo:502:llog_process_th.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.951161:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783951849.951280:0:85203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85203:1870605465368960:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783951849.951297:0:85203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783951849.957378:0:85178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783951849.957452:0:85178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783951849.957478:0:85178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.957491:0:85178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783951849.957547:0:85178:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783951849.957549:0:85178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783951849.957551:0:85178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951849.957552:0:85178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951849.957553:0:85178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951849.957555:0:85178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951849.957556:0:85178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783951849.957558:0:85178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783951849.957560:0:85178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951849.957561:0:85178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783951849.957565:0:85178:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783951849.957567:0:85178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783951849.957569:0:85178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783951849.957570:0:85178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951849.957571:0:85178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951849.957573:0:85178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951849.957574:0:85178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951849.957575:0:85178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783951849.957576:0:85178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783951849.957578:0:85178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951849.957579:0:85178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783951849.957633:0:85178:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783951849.957653:0:85178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465369088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783951849.957737:0:85178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.957776:0:85178:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fb7000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951849.957929:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465369088 00000100:00100000:2.0:1783951849.957936:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465369088 00000100:00100000:2.0:1783951849.957978:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783951849.957987:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:85178:x1870605465369088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783951849.958023:0:85185:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783951849.958037:0:85185:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783951849.966270:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951849.966357:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447683712 00000100:00100000:1.0:1783951849.966368:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447683712 00000100:00100000:1.0:1783951849.966456:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1022 00000100:00100000:1.0:1783951849.966467:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447683712:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951849.966550:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447683712:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.966558:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1022 00000100:00080000:3.0:1783951849.966869:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 20000000:01000000:2.0:1783951849.970047:0:85185:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783951849.970070:0:85185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783951849.970202:0:85188:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783951849.970207:0:85188:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783951849.970227:0:85188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.970245:0:85188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb3fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb3fe2 expref: 11 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.970254:0:85188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.970295:0:85188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb3fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb3fe2 expref: 11 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951849.970308:0:85188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb3fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb3fe2 expref: 11 pid: 85185 timeout: 3664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951849.970322:0:85188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85188:1870605465369216:0@lo:104: 00000100:00100000:1.0:1783951849.970381:0:85188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951849.970432:0:85188:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951849.971359:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951849.971406:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951849.971487:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447683584 00000100:00100000:1.0:1783951849.971494:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447683584 00000100:00100000:1.0:1783951849.971535:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1057 00000100:00100000:1.0:1783951849.971543:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447683584:12345-192.168.202.48@tcp:38:kworker.0 00000100:00100000:1.0:1783951849.971641:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447683584:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 95us (241us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783951849.971664:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1057 00000100:00100000:2.0:1783951849.972351:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465369216 00000100:00100000:2.0:1783951849.972356:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465369216 00000100:00100000:2.0:1783951849.972392:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1783951849.972409:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:85188:x1870605465369216:12345-0@lo:104: 00010000:00010000:2.0:1783951849.972424:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.972480:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783951849.972486:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:85188:x1870605465369216:12345-0@lo:104: Request processed in 88us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951849.972492:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00010000:2.0:1783951849.972518:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951849.972524:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.972531:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aac00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783951849.972536:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.972544:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951849.972563:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951849.972568:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951849.972621:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.972627:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783951849.972646:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.972655:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1413aac00/0x22c73c7857bb3fe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb3fe9 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.972671:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951849.972673:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951849.972674:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951849.972794:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465369344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951849.972830:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951849.972879:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465369344 00000100:00100000:2.0:1783951849.972883:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465369344 00010000:00010000:2.0:1783951849.972899:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb3fe9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb3fe2 expref: 12 pid: 85185 timeout: 3664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951849.972920:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:2.0:1783951849.972927:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:3644:x1870605465369344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951849.972937:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951849.972942:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb3fe9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb3fe2 expref: 12 pid: 85185 timeout: 3664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.972958:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb3fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb3fe2 expref: 12 pid: 85185 timeout: 3664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.972975:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.972983:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783951849.972997:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002789905s 00010000:00010000:2.0:1783951849.973001:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.973008:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.973015:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.973021:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.973027:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e5e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951849.973030:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.973037:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.973047:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951849.973063:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783951849.973092:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:3644:x1870605465369344:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.973251:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447683456 00000100:00100000:0.0:1783951849.973256:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447683456 00000100:00100000:0.0:1783951849.973290:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 25 00000100:00100000:0.0:1783951849.973296:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1870605447683456:12345-192.168.202.48@tcp:250:kworker.0 00010000:00080000:0.0:1783951849.973314:0:85184:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e66faa19-2cbc-412c-8aef-9c55427739f8@192.168.202.48@tcp t0 exp 0000000000000000 cur 3564 last 0 00000020:00000080:0.0:1783951849.973337:0:85184:0:(genops.c:1406:class_connect()) connect: client e66faa19-2cbc-412c-8aef-9c55427739f8, cookie 0x22c73c7857bb4021 00000100:00080000:0.0:1783951849.973468:0:85184:0:(import.c:65:import_set_state_nolock()) ffff97b04d9f3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951849.973520:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+5:2397:x1870605447683456:12345-192.168.202.48@tcp:250:kworker.0 Request processed in 224us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951849.973527:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 25 00010000:00010000:0.0:1783951849.973768:0:85188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb3fe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb3fe2 expref: 12 pid: 85185 timeout: 3664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951849.973783:0:85188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85188:1870605465369216:0@lo:104: 00010000:00010000:0.0:1783951849.973801:0:85188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951849.973810:0:85188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951849.973817:0:85188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951849.973823:0:85188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1767e5e00/0x22c73c7857bb401a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951849.973942:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:2.0:1783951849.973971:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465369344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951849.974813:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:85178:x1870605465369088:12345-0@lo:253:mount.lustre.0 Request processed in 16824us (17073us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951849.974822:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783951849.979252:0:85178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:85178:1870605465369088:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783951849.979271:0:85178:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783951849.979275:0:85178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783951849.979276:0:85178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783951849.979278:0:85178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951849.979279:0:85178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951849.979280:0:85178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951849.979281:0:85178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951849.979282:0:85178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951849.979284:0:85178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783951849.979286:0:85178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951849.979287:0:85178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783951849.979303:0:85178:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1783951850.018897:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783951850.020197:0:85178:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411352 00000040:01000000:1.0:1783951850.024535:0:85178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783951850.024978:0:85208:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411352 00000020:00080000:2.0:1783951850.024984:0:85208:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411352 00000040:01000000:1.0:1783951850.025138:0:85209:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1783951850.025202:0:85209:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1783951850.025583:0:85178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1783951850.026030:0:85210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85210:1870605465369472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951850.026095:0:85210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.026130:0:85210:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049198000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.026198:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465369472 00000100:00100000:0.0:1783951850.026205:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465369472 00000100:00100000:0.0:1783951850.026256:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1783951850.026265:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85210:x1870605465369472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783951850.026344:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85210:x1870605465369472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951850.026352:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000040:01000000:3.0:1783951850.026966:0:85178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783951850.027006:0:85178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951850.027644:0:85210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85210:1870605465369472:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1783951850.027676:0:85210:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783951850.027726:0:85210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85210:1870605465369600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951850.027771:0:85210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.027801:0:85210:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049198000 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.027925:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465369600 00000100:00100000:0.0:1783951850.027931:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465369600 00000100:00100000:0.0:1783951850.027974:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:0.0:1783951850.027983:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85210:x1870605465369600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783951850.028093:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85210:x1870605465369600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 111us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951850.028115:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000004:00000080:3.0:1783951850.028395:0:85178:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783951850.028414:0:85178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783951850.028465:0:85178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951850.028789:0:85210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85210:1870605465369600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951850.028849:0:85210:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85210:1870605465369728:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951850.028877:0:85210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.029029:0:85210:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049198000 going to sleep for 11 seconds 00000040:00080000:3.0:1783951850.033849:0:85178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783951850.035172:0:85178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783951850.035225:0:85178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783951850.035333:0:85178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783951850.035987:0:85178:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00000040:00080000:1.0:1783951850.038787:0:85209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783951850.038880:0:85209:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1783951850.039310:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465369728 00000100:00100000:0.0:1783951850.039320:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465369728 00000100:00100000:2.0:1783951850.039623:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:2.0:1783951850.039635:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85210:x1870605465369728:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951850.039863:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85210:x1870605465369728:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 230us (10984us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951850.039871:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00010000:00080000:3.0:1783951850.044048:0:85178:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247809 00010000:00080000:3.0:1783951850.049091:0:85211:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85211 00010000:02000000:3.0:1783951850.049132:0:85211:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000100:00100000:0.0:1783951850.049272:0:85210:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85210:1870605465369728:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783951850.049528:0:85210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:2.0:1783951850.049823:0:85211:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783951850.049830:0:85211:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000040:00080000:1.0:1783951850.051699:0:85210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783951850.051777:0:85210:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783951850.051782:0:85210:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1783951850.051855:0:85211:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1783951850.051946:0:85178:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783951850.051963:0:85178:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783951850.051977:0:85178:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1783951850.052007:0:85178:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1783951850.062432:0:85178:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783951850.064830:0:85178:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1783951850.785313:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783951850.785321:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b174696000 from 107 10000000:01000000:0.0:1783951850.785327:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783951850.785379:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.785399:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.785411:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951850.785439:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465369856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.785516:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951850.785564:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951850.785684:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465369856 00000100:00100000:2.0:1783951850.785692:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465369856 00000100:00100000:2.0:1783951850.785744:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783951850.785754:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:6514:x1870605465369856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951850.785769:0:85184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951850.785784:0:85184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1413aac00/0x22c73c7857bb402f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4028 expref: -99 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.785808:0:85184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1413aac00/0x22c73c7857bb402f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4028 expref: 11 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.785818:0:85184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1413aac00/0x22c73c7857bb402f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4028 expref: 11 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.785827:0:85184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1413aac00, rc 0) 00000100:00100000:2.0:1783951850.785877:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465369856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951850.785885:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783951850.787434:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465369856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951850.787455:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.787465:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951850.787545:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465369984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.787635:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951850.787665:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.787802:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465369984 00000100:00100000:1.0:1783951850.787808:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465369984 00000100:00100000:1.0:1783951850.787858:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783951850.787865:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465369984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783951850.787885:0:85185:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783951850.787903:0:85185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783951850.787906:0:85185:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 107 00000100:00100000:1.0:1783951850.788001:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465369984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.788009:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951850.788116:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465369984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783951850.788161:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783951850.788168:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.788176:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951850.788186:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783951850.788188:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b151231000 from 52 10000000:01000000:0.0:1783951850.788191:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951850.788213:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f9a00/0x22c73c7857bb4036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.788236:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1772f9a00/0x22c73c7857bb4036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.788245:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1772f9a00/0x22c73c7857bb4036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951850.788259:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.788285:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951850.788299:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951850.790502:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465370112 00000100:00100000:2.0:1783951850.790529:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465370112 00000100:00100000:2.0:1783951850.790605:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783951850.790615:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465370112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951850.790631:0:85184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951850.790649:0:85184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb403d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4036 expref: -99 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.790675:0:85184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb403d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4036 expref: 12 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.790686:0:85184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb403d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4036 expref: 12 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.790694:0:85184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1413ab000, rc 0) 00000100:00100000:2.0:1783951850.790755:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465370112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951850.790763:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783951850.791376:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951850.791405:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1772f9a00/0x22c73c7857bb4036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb403d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.791428:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1772f9a00/0x22c73c7857bb4036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb403d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951850.791508:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.791548:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951850.791613:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951850.791678:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465370240 00000100:00100000:3.0:1783951850.791684:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465370240 00000100:00100000:3.0:1783951850.791724:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783951850.791732:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465370240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.791856:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465370240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951850.791863:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951850.792028:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.792057:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.792108:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951850.792131:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951850.792243:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465370368 00000100:00100000:3.0:1783951850.792248:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465370368 00000100:00100000:3.0:1783951850.792281:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783951850.792287:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465370368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.792363:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465370368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951850.792370:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783951850.792547:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951850.793454:0:85231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783951850.793764:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783951850.793788:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783951850.793799:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f9a00/0x22c73c7857bb4036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb403d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.793809:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1772f9a00/0x22c73c7857bb4036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb403d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951850.793819:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783951850.793822:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b151231000 from 104 10000000:01000000:0.0:1783951850.793825:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783951850.793857:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f8000/0x22c73c7857bb4044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.793865:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1772f8000/0x22c73c7857bb4044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.793884:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1772f8000/0x22c73c7857bb4044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951850.793904:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.793948:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951850.793971:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951850.794169:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465370496 00000100:00100000:3.0:1783951850.794175:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465370496 00000100:00100000:3.0:1783951850.794228:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783951850.794237:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465370496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951850.794249:0:85183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951850.794261:0:85183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14dc72a00/0x22c73c7857bb404b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4044 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.794282:0:85183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14dc72a00/0x22c73c7857bb404b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4044 expref: 13 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.794292:0:85183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14dc72a00/0x22c73c7857bb404b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4044 expref: 13 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.794301:0:85183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14dc72a00, rc 0) 00000100:00100000:3.0:1783951850.794346:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465370496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951850.794360:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783951850.794553:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951850.794567:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1772f8000/0x22c73c7857bb4044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb404b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.794605:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1772f8000/0x22c73c7857bb4044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb404b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951850.794657:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.794689:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.794708:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174677840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.794875:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465370624 00000100:00100000:0.0:1783951850.794880:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465370624 00000100:00100000:0.0:1783951850.794902:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783951850.794909:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465370624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783951850.794924:0:85184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783951850.794942:0:85184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783951850.794945:0:85184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783951850.794948:0:85184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783951850.794951:0:85184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783951850.794953:0:85184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:0.0:1783951850.795036:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465370624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951850.795042:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783951850.796956:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783951850.797054:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951850.797064:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f8000/0x22c73c7857bb4044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb404b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.797075:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1772f8000/0x22c73c7857bb4044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb404b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951850.797084:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783951850.797095:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1783951850.797099:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783951850.797130:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1413aa400/0x22c73c7857bb4052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.797138:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1413aa400/0x22c73c7857bb4052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.797147:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1413aa400/0x22c73c7857bb4052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951850.797167:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.797237:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.797367:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174677840 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.799076:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465370752 00000100:00100000:0.0:1783951850.799098:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465370752 00000100:00100000:0.0:1783951850.799466:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783951850.799479:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465370752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951850.799495:0:85185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951850.799513:0:85185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1772f9000/0x22c73c7857bb4059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4052 expref: -99 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.799557:0:85185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1772f9000/0x22c73c7857bb4059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4052 expref: 14 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.799569:0:85185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1772f9000/0x22c73c7857bb4059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4052 expref: 14 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.799615:0:85185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1772f9000, rc 0) 00000100:00100000:0.0:1783951850.799686:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465370752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (2449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951850.799693:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783951850.799917:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951850.799934:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1413aa400/0x22c73c7857bb4052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4059 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.799944:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1413aa400/0x22c73c7857bb4052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4059 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951850.800017:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.800055:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.815693:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951850.815894:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465370880 00000100:00100000:2.0:1783951850.815904:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465370880 00000100:00100000:3.0:1783951850.816375:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783951850.816387:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465370880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.816687:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465370880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.816737:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.821128:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.821182:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951850.821288:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465371008 00000100:00100000:2.0:1783951850.821298:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465371008 00000100:00100000:2.0:1783951850.821342:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783951850.821351:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465371008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.821949:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465370880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5560us (21889us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951850.821959:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783951850.822288:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465371008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 936us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951850.822298:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783951850.822367:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951850.823074:0:85233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1783951850.823460:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1783951850.823484:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783951850.823496:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1413aa400/0x22c73c7857bb4052 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4059 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.823508:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1413aa400/0x22c73c7857bb4052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4059 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951850.823517:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1783951850.823520:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b151231000 from 1 10000000:01000000:2.0:1783951850.823523:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783951850.823558:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1413aae00/0x22c73c7857bb4060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.823566:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1413aae00/0x22c73c7857bb4060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.823576:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1413aae00/0x22c73c7857bb4060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951850.823625:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.823678:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.823708:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174677840 going to sleep for 11 seconds 00000100:00100000:3.0:1783951850.824223:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465371136 00000100:00100000:3.0:1783951850.824232:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465371136 00000100:00100000:3.0:1783951850.824287:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783951850.824296:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465371136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951850.824310:0:85184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951850.824324:0:85184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14dc73200/0x22c73c7857bb4067 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4060 expref: -99 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.824350:0:85184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14dc73200/0x22c73c7857bb4067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4060 expref: 15 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.824360:0:85184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14dc73200/0x22c73c7857bb4067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4060 expref: 15 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.824369:0:85184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14dc73200, rc 0) 00000100:00100000:3.0:1783951850.824435:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465371136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951850.824442:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783951850.824793:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951850.824811:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1413aae00/0x22c73c7857bb4060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4067 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.824821:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1413aae00/0x22c73c7857bb4060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4067 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951850.824837:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783951850.824842:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1413aae00/0x22c73c7857bb4060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4067 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.824849:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1413aae00/0x22c73c7857bb4060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4067 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951850.824871:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951850.824873:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b151231000 from 7 10000000:01000000:1.0:1783951850.824875:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951850.824895:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e5c00/0x22c73c7857bb406e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.824901:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1767e5c00/0x22c73c7857bb406e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.824909:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1767e5c00/0x22c73c7857bb406e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951850.824925:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.824959:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.824979:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.824994:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465371264 00000100:00100000:1.0:1783951850.824998:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465371264 00000100:00100000:1.0:1783951850.825018:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783951850.825024:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465371264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951850.825033:0:85184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951850.825041:0:85184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1767e4000/0x22c73c7857bb4075 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb406e expref: -99 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.825056:0:85184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1767e4000/0x22c73c7857bb4075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb406e expref: 16 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.825063:0:85184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1767e4000/0x22c73c7857bb4075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb406e expref: 16 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.825082:0:85184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1767e4000, rc 0) 00000100:00100000:1.0:1783951850.825115:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465371264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.825123:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783951850.825152:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951850.825164:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1767e5c00/0x22c73c7857bb406e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4075 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.825171:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1767e5c00/0x22c73c7857bb406e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4075 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951850.825221:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.825244:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.825256:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.825266:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465371392 00000100:00100000:1.0:1783951850.825269:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465371392 00000100:00100000:1.0:1783951850.825284:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783951850.825289:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465371392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.825402:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465371392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.825408:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783951850.825436:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.825459:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.825495:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.825514:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.825525:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465371520 00000100:00100000:1.0:1783951850.825528:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465371520 00000100:00100000:1.0:1783951850.825545:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783951850.825550:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465371520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.825723:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465371520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.825730:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783951850.825767:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951850.827377:0:85234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783951850.827733:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783951850.827755:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951850.827766:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e5c00/0x22c73c7857bb406e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4075 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.827777:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1767e5c00/0x22c73c7857bb406e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4075 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951850.827786:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783951850.827789:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b046482800 from 52 10000000:01000000:1.0:1783951850.827791:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783951850.827825:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e5200/0x22c73c7857bb407c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.827832:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1767e5200/0x22c73c7857bb407c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.827841:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1767e5200/0x22c73c7857bb407c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951850.827861:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.827927:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.827964:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.828031:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465371648 00000100:00100000:0.0:1783951850.828038:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465371648 00000100:00100000:0.0:1783951850.828085:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783951850.828094:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465371648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951850.828107:0:85184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951850.828120:0:85184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1772f8200/0x22c73c7857bb4083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb407c expref: -99 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.828140:0:85184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1772f8200/0x22c73c7857bb4083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb407c expref: 17 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.828150:0:85184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1772f8200/0x22c73c7857bb4083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb407c expref: 17 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.828158:0:85184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1772f8200, rc 0) 00000100:00100000:0.0:1783951850.828202:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465371648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951850.828219:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951850.829861:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951850.829887:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1767e5200/0x22c73c7857bb407c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4083 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.829898:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1767e5200/0x22c73c7857bb407c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4083 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951850.829975:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.830026:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.830071:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.830117:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465371776 00000100:00100000:0.0:1783951850.830123:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465371776 00000100:00100000:0.0:1783951850.830167:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783951850.830175:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465371776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.830317:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465371776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951850.830325:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783951850.833142:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.833207:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.833284:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.833325:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174677e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.833351:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465371904 00000100:00100000:0.0:1783951850.833358:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465371904 00000100:00100000:0.0:1783951850.833422:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783951850.833431:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465371904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.833556:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465371904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951850.833564:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951850.833774:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465371904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951850.834762:0:85235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783951850.836867:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783951850.836913:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783951850.836924:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e5200/0x22c73c7857bb407c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4083 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.836937:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1767e5200/0x22c73c7857bb407c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4083 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951850.836947:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783951850.836949:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783951850.836952:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783951850.837011:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1413aa600/0x22c73c7857bb408a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.837021:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1413aa600/0x22c73c7857bb408a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.837031:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1413aa600/0x22c73c7857bb408a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951850.837057:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.837427:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.837469:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174677e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951850.837498:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465372032 00000100:00100000:2.0:1783951850.837505:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465372032 00000100:00100000:2.0:1783951850.837561:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783951850.837572:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465372032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951850.837603:0:85184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951850.837618:0:85184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1413ab600/0x22c73c7857bb4091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb408a expref: -99 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.837642:0:85184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1413ab600/0x22c73c7857bb4091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb408a expref: 18 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.837651:0:85184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1413ab600/0x22c73c7857bb4091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb408a expref: 18 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.837660:0:85184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1413ab600, rc 0) 00000100:00100000:2.0:1783951850.837697:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465372032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951850.837704:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783951850.837751:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951850.837764:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1413aa600/0x22c73c7857bb408a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4091 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.837772:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1413aa600/0x22c73c7857bb408a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4091 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951850.837830:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.837856:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.837870:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174677e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951850.837887:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465372160 00000100:00100000:2.0:1783951850.837891:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465372160 00000100:00100000:2.0:1783951850.838268:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951850.838276:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465372160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.838436:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465372160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951850.838443:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951850.838475:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.838505:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.838544:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.838558:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174677e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951850.838569:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465372288 00000100:00100000:2.0:1783951850.838572:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465372288 00000100:00100000:2.0:1783951850.838614:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783951850.838620:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b150040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465372288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.840550:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b150040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465372288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1923us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951850.840563:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783951850.841620:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951850.844978:0:85237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1783951850.845678:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1783951850.845708:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783951850.845720:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1413aa600/0x22c73c7857bb408a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4091 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.845732:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1413aa600/0x22c73c7857bb408a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4091 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951850.845742:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951850.845745:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b046482800 from 7 10000000:01000000:1.0:1783951850.845749:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951850.845789:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e5600/0x22c73c7857bb4098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.845799:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1767e5600/0x22c73c7857bb4098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.845824:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1767e5600/0x22c73c7857bb4098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951850.845850:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.845926:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.845974:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951850.846158:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465372416 00000100:00100000:3.0:1783951850.846165:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465372416 00000100:00100000:1.0:1783951850.846417:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783951850.846429:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b150040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465372416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951850.846444:0:85183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951850.846458:0:85183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1767e5a00/0x22c73c7857bb409f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4098 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.846483:0:85183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1767e5a00/0x22c73c7857bb409f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4098 expref: 19 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.846494:0:85183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1767e5a00/0x22c73c7857bb409f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4098 expref: 19 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.846501:0:85183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1767e5a00, rc 0) 00000100:00100000:1.0:1783951850.846546:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b150040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465372416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.846553:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783951850.848457:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951850.848483:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1767e5600/0x22c73c7857bb4098 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb409f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.848510:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1767e5600/0x22c73c7857bb4098 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb409f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951850.848615:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.848674:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.848707:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783951850.848917:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465372544 00000100:00100000:3.0:1783951850.848923:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465372544 00000100:00100000:3.0:1783951850.848964:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783951850.848974:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b150041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465372544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.849097:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b150041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465372544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951850.849104:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783951850.849143:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.849173:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.849213:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951850.849833:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1572ca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.853848:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465372672 00000100:00100000:1.0:1783951850.853863:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465372672 00000100:00100000:1.0:1783951850.853911:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783951850.853922:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b150040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465372672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.854095:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b150040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465372672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (4880us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.854103:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783951850.854767:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951850.861625:0:85238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783951850.865662:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783951850.865702:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951850.865714:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e5600/0x22c73c7857bb4098 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb409f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.865727:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1767e5600/0x22c73c7857bb4098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb409f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951850.865747:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783951850.865750:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174849000 from 52 10000000:01000000:0.0:1783951850.865753:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951850.865788:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f9800/0x22c73c7857bb40a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.865796:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1772f9800/0x22c73c7857bb40a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.865807:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1772f9800/0x22c73c7857bb40a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951850.865831:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.865893:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951850.866529:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04676ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.866853:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465372800 00000100:00100000:1.0:1783951850.866861:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465372800 00000100:00100000:1.0:1783951850.867499:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783951850.867514:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b150040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465372800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951850.867530:0:85183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951850.867548:0:85183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1767e4c00/0x22c73c7857bb40ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb40a6 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.867575:0:85183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1767e4c00/0x22c73c7857bb40ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb40a6 expref: 20 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.867585:0:85183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1767e4c00/0x22c73c7857bb40ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb40a6 expref: 20 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.867628:0:85183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1767e4c00, rc 0) 00000100:00100000:1.0:1783951850.867692:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b150040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465372800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.867699:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783951850.872715:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951850.872747:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1772f9800/0x22c73c7857bb40a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.872761:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1772f9800/0x22c73c7857bb40a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb40ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951850.872847:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.872922:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951850.872985:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04676ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.873125:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465372928 00000100:00100000:1.0:1783951850.873132:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465372928 00000100:00100000:1.0:1783951850.873179:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783951850.873190:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1746f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465372928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.873321:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1746f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465372928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.873329:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783951850.874017:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465372928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.874058:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.874129:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951850.874151:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04676ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.874503:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465373056 00000100:00100000:1.0:1783951850.874509:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465373056 00000100:00100000:1.0:1783951850.874549:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783951850.874556:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1746f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465373056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.874678:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1746f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465373056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.874686:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783951850.874846:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951850.876562:0:85240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783951850.880985:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783951850.881031:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783951850.881044:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f9800/0x22c73c7857bb40a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.881058:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1772f9800/0x22c73c7857bb40a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951850.881621:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783951850.881625:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1783951850.881628:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783951850.881667:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e5e00/0x22c73c7857bb40b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.881676:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1767e5e00/0x22c73c7857bb40b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.881687:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1767e5e00/0x22c73c7857bb40b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951850.881713:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.881779:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.881818:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b142e13840 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.881839:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465373184 00000100:00100000:1.0:1783951850.881845:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465373184 00000100:00100000:1.0:1783951850.881889:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783951850.881897:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1746f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465373184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951850.881927:0:85183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951850.881939:0:85183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1767e4800/0x22c73c7857bb40bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb40b4 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.881975:0:85183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1767e4800/0x22c73c7857bb40bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb40b4 expref: 21 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.881986:0:85183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1767e4800/0x22c73c7857bb40bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb40b4 expref: 21 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.882006:0:85183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1767e4800, rc 0) 00000100:00100000:1.0:1783951850.882042:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1746f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465373184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.882049:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783951850.882293:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951850.882309:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1767e5e00/0x22c73c7857bb40b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951850.882318:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1767e5e00/0x22c73c7857bb40b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb40bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951850.882448:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.882475:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.882488:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b142e13840 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.882502:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465373312 00000100:00100000:1.0:1783951850.882505:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465373312 00000100:00100000:1.0:1783951850.882527:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783951850.882533:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1746f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465373312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.882685:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1746f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465373312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.882692:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783951850.882721:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.882745:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.882782:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951850.882799:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e180 going to sleep for 11 seconds 00000100:00100000:1.0:1783951850.882808:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465373440 00000100:00100000:1.0:1783951850.882812:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465373440 00000100:00100000:1.0:1783951850.882829:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783951850.882835:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1746f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465373440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951850.887626:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1746f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465373440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4779us (4832us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951850.887654:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783951850.887908:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951850.893268:0:85241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783951850.893334:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783951850.893360:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783951850.893372:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e5e00/0x22c73c7857bb40b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.893385:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1767e5e00/0x22c73c7857bb40b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951850.893431:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951850.893433:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b174849000 from 7 10000000:01000000:3.0:1783951850.893436:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951850.893475:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc72c00/0x22c73c7857bb40c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.893491:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14dc72c00/0x22c73c7857bb40c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.893502:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14dc72c00/0x22c73c7857bb40c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951850.893528:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.895027:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951850.895124:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951850.897022:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465373568 00000100:00100000:2.0:1783951850.897035:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465373568 00000100:00100000:2.0:1783951850.897104:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783951850.897114:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465373568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951850.897131:0:85183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951850.897149:0:85183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1413ab400/0x22c73c7857bb40c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb40c2 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.897178:0:85183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1413ab400/0x22c73c7857bb40c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb40c2 expref: 22 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.897204:0:85183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1413ab400/0x22c73c7857bb40c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb40c2 expref: 22 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.897214:0:85183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1413ab400, rc 0) 00000100:00100000:2.0:1783951850.897286:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465373568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951850.897294:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783951850.897408:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951850.897428:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14dc72c00/0x22c73c7857bb40c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.897438:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14dc72c00/0x22c73c7857bb40c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb40c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951850.897512:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.897546:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951850.897572:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951850.902906:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465373696 00000100:00100000:2.0:1783951850.902921:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465373696 00000100:00100000:2.0:1783951850.903021:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783951850.903034:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465373696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.903238:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465373696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (5673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951850.903246:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783951850.909723:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.909791:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.909875:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951850.909923:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.913051:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465373824 00000100:00100000:0.0:1783951850.913067:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465373824 00000100:00100000:0.0:1783951850.913420:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783951850.913432:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465373824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.913633:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465373824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (3758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951850.913642:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783951850.915716:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951850.923344:0:85243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783951850.924643:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783951850.924704:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783951850.924716:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc72c00/0x22c73c7857bb40c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.924728:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14dc72c00/0x22c73c7857bb40c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951850.924738:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1783951850.924741:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97b167c90000 from 1 10000000:01000000:3.0:1783951850.924745:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783951850.924788:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc73e00/0x22c73c7857bb40d0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.924799:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14dc73e00/0x22c73c7857bb40d0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951850.924815:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14dc73e00/0x22c73c7857bb40d0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951850.924846:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951850.924920:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951850.924967:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1500ce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.925505:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465373952 00000100:00100000:0.0:1783951850.925515:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465373952 00000100:00100000:0.0:1783951850.925571:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783951850.925580:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465373952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951850.925613:0:85185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951850.925629:0:85185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1772f8c00/0x22c73c7857bb40d7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb40d0 expref: -99 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.925652:0:85185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1772f8c00/0x22c73c7857bb40d7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb40d0 expref: 23 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.925662:0:85185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1772f8c00/0x22c73c7857bb40d7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb40d0 expref: 23 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.925672:0:85185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1772f8c00, rc 0) 00000100:00100000:0.0:1783951850.925739:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465373952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951850.925746:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951850.925783:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465373952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951850.925799:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14dc73e00/0x22c73c7857bb40d0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.925809:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14dc73e00/0x22c73c7857bb40d0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb40d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951850.925828:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783951850.925832:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc73e00/0x22c73c7857bb40d0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.925839:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14dc73e00/0x22c73c7857bb40d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951850.925855:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783951850.925857:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97b167c90000 from 1 10000000:01000000:2.0:1783951850.925859:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783951850.925881:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1413abe00/0x22c73c7857bb40de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.925889:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1413abe00/0x22c73c7857bb40de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.925897:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1413abe00/0x22c73c7857bb40de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951850.925913:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465374080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.938014:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.938078:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b152405900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.942617:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465374080 00000100:00100000:0.0:1783951850.942634:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465374080 00000100:00100000:0.0:1783951850.942698:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783951850.942708:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465374080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951850.942726:0:85183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951850.942744:0:85183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1772f9e00/0x22c73c7857bb40e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb40de expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.942771:0:85183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1772f9e00/0x22c73c7857bb40e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb40de expref: 24 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.942781:0:85183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1772f9e00/0x22c73c7857bb40e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb40de expref: 24 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951850.942789:0:85183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1772f9e00, rc 0) 00000100:00100000:0.0:1783951850.942859:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465374080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (4852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951850.942865:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783951850.943847:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465374080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951850.943869:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1413abe00/0x22c73c7857bb40de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.943881:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1413abe00/0x22c73c7857bb40de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb40e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951850.943960:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465374208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951850.944004:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951850.944040:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b152405900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951850.951966:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465374208 00000100:00100000:0.0:1783951850.952191:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465374208 00000100:00100000:0.0:1783951850.952255:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783951850.952265:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465374208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951850.953573:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465374208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1306us (9563us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951850.953605:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783951850.955070:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465374208:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783951850.955118:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783951850.955143:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1413abe00/0x22c73c7857bb40de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951850.955155:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1413abe00/0x22c73c7857bb40de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb40e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951851.041584:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951851.105528:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465374336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951851.105628:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951851.105960:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465374336 00000100:00100000:2.0:1783951851.105969:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465374336 00000100:00100000:2.0:1783951851.106033:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:2.0:1783951851.106044:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465374336:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783951851.106192:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783951851.106224:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951851.106434:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465374336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 391us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951851.106442:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:0.0:1783951851.108272:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465374464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951851.108345:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951851.108547:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465374464 00000100:00100000:1.0:1783951851.108555:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465374464 00000100:00100000:1.0:1783951851.108642:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:1.0:1783951851.108651:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465374464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951851.108678:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951851.108718:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465374464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951851.108724:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00080000:2.0:1783951851.108875:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951851.109904:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465374464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951851.117098:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465374336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951851.885705:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951851.886020:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447683840 00000100:00100000:0.0:1783951851.886030:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447683840 00000100:00100000:0.0:1783951851.886095:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:0.0:1783951851.886104:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+5:42446:x1870605447683840:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951851.886120:0:85185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951851.886137:0:85185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1772f9400/0x22c73c7857bb40ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a12b expref: -99 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951851.886175:0:85185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1772f9400/0x22c73c7857bb40ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a12b expref: 6 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951851.886187:0:85185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1772f9400/0x22c73c7857bb40ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a12b expref: 6 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951851.886197:0:85185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1772f9400, rc 0) 00000100:00100000:0.0:1783951851.886252:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447683840:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 150us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951851.886259:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:2.0:1783951851.892391:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951851.892855:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447683968 00000100:00100000:0.0:1783951851.892865:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447683968 00000100:00100000:0.0:1783951851.892926:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:0.0:1783951851.892936:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447683968:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783951851.892962:0:85184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1783951851.892985:0:85184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783951851.892993:0:85184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783951851.892997:0:85184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783951851.893000:0:85184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783951851.893002:0:85184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:0.0:1783951851.900229:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447683968:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 Request processed in 7284us (7842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951851.900243:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:3.0:1783951851.908499:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951851.908551:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951851.908735:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447684224 00000100:00100000:1.0:1783951851.908745:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447684224 00000100:00100000:1.0:1783951851.908789:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:1.0:1783951851.908798:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447684224:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951851.908813:0:85183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951851.908829:0:85183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86b000/0x22c73c7857bb40f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a132 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951851.908857:0:85183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86b000/0x22c73c7857bb40f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a132 expref: 7 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951851.908869:0:85183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86b000/0x22c73c7857bb40f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a132 expref: 7 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951851.908886:0:85183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86b000, rc 0) 00000100:00100000:1.0:1783951851.908940:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+7:42446:x1870605447684224:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 143us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951851.908947:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:2.0:1783951851.909090:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447684096 00000100:00100000:2.0:1783951851.909095:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447684096 00000100:00100000:2.0:1783951851.909128:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1058 00000100:00100000:2.0:1783951851.909134:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447684096:12345-192.168.202.48@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1783951851.909158:0:83761:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '458183b2-4c6d-478c-9fed-a955779e6611' at ffff97b04965f000, cookie 0x22c73c7857bb3f6b 00010000:00080000:2.0:1783951851.909164:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp recovering/t98784247810 exp ffff97b04965f000 cur 3566 last 1783951849 00010000:02000400:2.0:1783951851.909172:0:83761:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1783951851.909178:0:83761:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1783951851.909202:0:83761:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783951851.909328:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b146947800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951851.909369:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447684096:12345-192.168.202.48@tcp:38:ll_cfg_requeue.0 Request processed in 234us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951851.909376:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1058 00000100:00100000:2.0:1783951851.913220:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951851.919094:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951851.919739:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447677184 00000100:00100000:1.0:1783951851.919750:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447677184 00000100:00100000:1.0:1783951851.919821:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1059 00000100:00100000:1.0:1783951851.919833:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447677184:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00080000:1.0:1783951851.919852:0:66236:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247810, current: 98784247810, replaying 00000100:00100000:1.0:1783951851.919878:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447677184:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 49us (800us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783951851.919885:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1059 00010000:00080000:3.0:1783951851.919949:0:85211:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1783951851.920114:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447684352 00000100:00100000:0.0:1783951851.920120:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447684352 00000100:00100000:0.0:1783951851.920149:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:0.0:1783951851.920156:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+7:42446:x1870605447684352:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951851.920310:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447684352:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 154us (7099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951851.920317:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:2.0:1783951851.923679:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951851.923787:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447684480 00000100:00100000:0.0:1783951851.923797:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447684480 00000100:00100000:0.0:1783951851.923837:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:0.0:1783951851.923845:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447684480:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951851.924163:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447684480:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 317us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951851.924172:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:2.0:1783951851.937475:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951851.938038:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447684608 00000100:00100000:3.0:1783951851.938049:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447684608 00000100:00100000:3.0:1783951851.938110:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:3.0:1783951851.938121:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447684608:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951851.938137:0:85185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951851.938154:0:85185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14dc73800/0x22c73c7857bb40fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a139 expref: -99 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951851.938183:0:85185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14dc73800/0x22c73c7857bb40fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a139 expref: 9 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951851.938194:0:85185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14dc73800/0x22c73c7857bb40fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a139 expref: 9 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951851.938204:0:85185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14dc73800, rc 0) 00000100:00100000:3.0:1783951851.938260:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447684608:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 141us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951851.938268:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:2.0:1783951851.954954:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951851.957569:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447684736 00000100:00100000:1.0:1783951851.957584:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447684736 00000100:00100000:1.0:1783951851.957734:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:1.0:1783951851.957744:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447684736:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951851.957898:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447684736:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 154us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951851.957905:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:2.0:1783951851.967931:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951851.970954:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447684864 00000100:00100000:0.0:1783951851.970977:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447684864 00000100:00100000:2.0:1783951851.971152:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:2.0:1783951851.971168:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447684864:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951851.971321:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447684864:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 156us (3405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951851.971329:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:2.0:1783951851.976623:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951851.977365:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447684992 00000100:00100000:3.0:1783951851.977389:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447684992 00000100:00100000:3.0:1783951851.977466:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:3.0:1783951851.977478:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447684992:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951851.977502:0:85185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951851.977527:0:85185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14dc72400/0x22c73c7857bb4101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a140 expref: -99 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951851.977583:0:85185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14dc72400/0x22c73c7857bb4101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a140 expref: 10 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951851.977620:0:85185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14dc72400/0x22c73c7857bb4101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a140 expref: 10 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951851.977632:0:85185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14dc72400, rc 0) 00000100:00100000:3.0:1783951851.978051:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447684992:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 573us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951851.978060:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:3.0:1783951851.981161:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951851.981830:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447685120 00000100:00100000:2.0:1783951851.981905:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447685120 00000100:00100000:2.0:1783951851.981983:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:2.0:1783951851.981998:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447685120:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951851.982172:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447685120:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 178us (1022us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951851.982181:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 70 00010000:00010000:3.0:1783951852.071518:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951853.088877:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951854.115551:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951855.088447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951855.088491:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951855.088521:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447685376 00000100:00100000:2.0:1783951855.088530:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447685376 00000100:00100000:2.0:1783951855.088610:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1023 00000100:00100000:2.0:1783951855.088620:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447685376:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951855.088711:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447685376:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951855.088718:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1023 00000100:00080000:2.0:1783951855.088740:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951855.090189:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447685248 00000100:00100000:3.0:1783951855.090203:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447685248 00000100:00100000:3.0:1783951855.090262:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00100000:3.0:1783951855.090271:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447685248:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951855.090344:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447685248:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 74us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951855.090362:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 71 00010000:00010000:1.0:1783951855.137711:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951855.201855:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951855.201876:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465374592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951855.201942:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951855.201999:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465374592 00000100:00100000:3.0:1783951855.202006:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465374592 00000100:00100000:3.0:1783951855.202051:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:3.0:1783951855.202067:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465374592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951855.202099:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951855.202140:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465374592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951855.202147:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00100000:3.0:1783951855.202191:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465374592:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1783951855.208838:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951855.208845:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951855.208848:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951855.208855:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3564 00000100:00080000:1.0:1783951855.208868:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951855.208875:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951855.208899:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047acf800 x1870605465374848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951855.208925:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951855.208928:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951855.208930:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951855.208934:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3564 00000100:00080000:1.0:1783951855.208936:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951855.208939:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951855.208948:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047acea00 x1870605465375104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951855.208970:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951855.208973:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951855.208975:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951855.208978:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3564 00000100:00080000:1.0:1783951855.208980:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951855.208983:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951855.208994:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047acdc00 x1870605465375360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951855.209015:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951855.209018:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951855.209019:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951855.209022:0:48498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3564 00000100:00080000:1.0:1783951855.209042:0:48498:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951855.209047:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951855.209060:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b146bad880 x1870605465375744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951855.209079:0:48498:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783951855.209082:0:48498:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951855.209084:0:48498:0:(import.c:65:import_set_state_nolock()) ffff97b144574000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951855.209088:0:48498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b144574000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951855.209098:0:48498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b146bad180 x1870605465376128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951855.209126:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465374976:0@lo:400:kworker.0 00000100:00100000:1.0:1783951855.209191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.209223:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465375872:0@lo:400:kworker.0 00000100:00100000:1.0:1783951855.209250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.209283:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783951855.209289:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465374720:0@lo:400:kworker.0 00000100:00100000:1.0:1783951855.209318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.209341:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465375616:0@lo:400:kworker.0 00000100:00100000:1.0:1783951855.209376:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.209404:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465374848:0@lo:38:kworker.0 00000100:00100000:1.0:1783951855.209427:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.209442:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465375104:0@lo:38:kworker.0 00000100:00100000:0.0:1783951855.209720:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465375872 00000100:00100000:0.0:1783951855.209728:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465375872 00000100:00100000:0.0:1783951855.209776:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465375616 00000100:00100000:0.0:1783951855.209780:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465375616 00000100:00100000:0.0:1783951855.209805:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:0.0:1783951855.209822:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465375872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951855.209881:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465375872:12345-0@lo:400:kworker.0 Request processed in 61us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951855.209888:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:0.0:1783951855.209904:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:0.0:1783951855.209910:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465375616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951855.209936:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465375616:12345-0@lo:400:kworker.0 Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951855.209941:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1783951855.210571:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465375488:0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.210647:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951855.210680:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783951855.210686:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465375232:0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.210709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951855.210728:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465376000:0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.210747:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951855.210775:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465374976 00000100:00100000:2.0:1783951855.210780:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465374976 00000100:00100000:2.0:1783951855.210811:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465374848 00000100:00100000:2.0:1783951855.210814:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465374848 00000100:00100000:2.0:1783951855.210826:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465375232 00000100:00100000:2.0:1783951855.210828:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465375232 00000100:00100000:2.0:1783951855.210847:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1783951855.210853:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465374976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.210891:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465374976:12345-0@lo:400:kworker.0 Request processed in 38us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951855.210897:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1783951855.210911:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1783951855.210916:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465375232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.210948:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465375232:12345-0@lo:400:kworker.0 Request processed in 32us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951855.210964:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1783951855.210978:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1783951855.210982:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465374848:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783951855.211006:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3570 last 0 00000020:00000080:2.0:1783951855.211041:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x22c73c7857bb4108 00000004:00100000:2.0:1783951855.211059:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951855.211185:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b146943000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951855.211221:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870605465374848:12345-0@lo:38:kworker.0 Request processed in 238us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951855.211228:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1783951855.211248:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465374720 00000100:00100000:2.0:1783951855.211252:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465374720 00000100:00100000:2.0:1783951855.211285:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783951855.211292:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b167c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465374720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.211326:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b167c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465374720:12345-0@lo:400:kworker.0 Request processed in 35us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951855.211331:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1783951855.211370:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951855.211374:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951855.211377:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951855.211391:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465375488 00000100:00100000:2.0:1783951855.211394:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465375488 00000100:00100000:2.0:1783951855.211421:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465376000 00000100:00100000:2.0:1783951855.211424:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465376000 00000100:00100000:2.0:1783951855.211443:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1783951855.211461:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465375488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.211492:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465375488:12345-0@lo:400:kworker.0 Request processed in 44us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951855.211505:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1783951855.211517:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1783951855.211523:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465376000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.211554:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465376000:12345-0@lo:400:kworker.0 Request processed in 31us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951855.211559:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1783951855.211625:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465375232:0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.211638:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465376000:0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.211646:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465375488:0@lo:400:kworker.0 00000100:00080000:2.0:1783951855.211670:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951855.211673:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951855.212832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.212871:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465375360:0@lo:38:kworker.0 00000100:00100000:1.0:1783951855.212911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.212930:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465375744:0@lo:38:kworker.0 00000100:00100000:1.0:1783951855.212953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.212968:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465376128:0@lo:38:kworker.0 00000100:00100000:1.0:1783951855.212988:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783951855.213021:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b047acf800 x1870605465374848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951855.213038:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00100000:0.0:1783951855.213527:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465375104 00000100:00100000:0.0:1783951855.213534:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465375104 00000100:00100000:0.0:1783951855.213564:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465375744 00000100:00100000:0.0:1783951855.213567:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465375744 00000100:00100000:0.0:1783951855.213581:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465376128 00000100:00100000:0.0:1783951855.213584:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465376128 00000100:00100000:0.0:1783951855.213615:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1783951855.213932:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465375104:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783951855.213962:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3570 last 0 00000020:00000080:0.0:1783951855.213996:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x22c73c7857bb410f 00000004:00100000:0.0:1783951855.214012:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783951855.214044:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b17704d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951855.214099:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870605465375104:12345-0@lo:38:kworker.0 Request processed in 476us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951855.214106:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1783951855.214123:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1783951855.214126:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465375744:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783951855.214139:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3570 last 0 00000020:00000080:0.0:1783951855.214170:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x22c73c7857bb4116 00000004:00100000:0.0:1783951855.214178:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783951855.214191:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b048caa000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951855.214220:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870605465375744:12345-0@lo:38:kworker.0 Request processed in 92us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951855.214226:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1783951855.214240:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1783951855.214243:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465376128:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783951855.214256:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3570 last 0 00000020:00000080:0.0:1783951855.214275:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x22c73c7857bb411d 00000004:00100000:0.0:1783951855.214282:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783951855.214295:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b048cad000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951855.214323:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465376128:12345-0@lo:38:kworker.0 Request processed in 78us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951855.214330:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00080000:1.0:1783951855.217377:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff97b047acf800 x1870605465374848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951880 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951855.217391:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783951855.217397:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783951855.217401:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783951855.217408:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465374848:0@lo:38:kworker.0 00000100:00100000:0.0:1783951855.217570:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465374720:0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.217637:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465375360 00000100:00100000:2.0:1783951855.217645:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465375360 00000100:00100000:2.0:1783951855.217679:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:2.0:1783951855.217685:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465375360:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783951855.217714:0:26467:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff97b04965d000, cookie 0x22c73c7857bb3f72 00010000:00080000:2.0:1783951855.217719:0:26467:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378653 exp ffff97b04965d000 cur 3570 last 1783951849 00000004:00100000:2.0:1783951855.217737:0:26467:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951855.217763:0:26467:0:(import.c:65:import_set_state_nolock()) ffff97b146945800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1783951855.220445:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b047acea00 x1870605465375104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951855.220466:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000100:00080000:1.0:1783951855.221274:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff97b047acea00 x1870605465375104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951880 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951855.221285:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783951855.221289:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783951855.221293:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783951855.221299:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465375104:0@lo:38:kworker.0 00010000:00080000:1.0:1783951855.221326:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b146bad880 x1870605465375744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951855.221923:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00080000:1.0:1783951855.222981:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff97b146bad880 x1870605465375744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951880 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951855.222992:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783951855.222997:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783951855.223000:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783951855.223006:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465375744:0@lo:38:kworker.0 00010000:00080000:1.0:1783951855.223037:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b146bad180 x1870605465376128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951855.223051:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:1.0:1783951855.223057:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783951855.223062:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783951855.223064:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b144574000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783951855.223068:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465376128:0@lo:38:kworker.0 00000100:00100000:0.0:1783951855.224091:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465375616:0@lo:400:kworker.0 00000100:00100000:0.0:1783951855.224108:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465374976:0@lo:400:kworker.0 00000100:00100000:0.0:1783951855.224125:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465375872:0@lo:400:kworker.0 00000100:00100000:2.0:1783951855.224275:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465375360:12345-0@lo:38:kworker.0 Request processed in 6586us (11361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951855.224286:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00010000:00080000:2.0:1783951855.224324:0:85211:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783951855.224330:0:85211:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 98784247810 00000020:00080000:2.0:1783951855.224342:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951855.224344:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247810, next_transno: 98784247810 00010000:00080000:2.0:1783951855.224348:0:85211:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247810) 00000020:00080000:2.0:1783951855.224360:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951855.224371:0:85211:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447677184 t98784247810 from 192.168.202.48@tcp req@ffff97b14de1ed80 x1870605447677184/t0(98784247810) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:112/0 lens 528/0 e 0 to 0 dl 1783951862 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951855.224742:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:0.0:1783951855.224752:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1783951855.224756:0:3641:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783951855.224759:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:0.0:1783951855.224763:0:3641:0:(recover.c:53:ptlrpc_replay_next()) import ffff97b048caf800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:0.0:1783951855.224772:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000004:00080000:3.0:1783951855.227945:0:85211:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3512us 00000100:00100000:0.0:1783951855.236702:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465375360:0@lo:38:kworker.0 00010000:00080000:1.0:1783951855.236827:0:85416:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1783951855.236832:0:85416:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1783951855.236838:0:85416:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1783951855.237366:0:85416:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1783951855.237440:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465376256:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783951855.237872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951855.238710:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465376256 00000100:00100000:3.0:1783951855.238719:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465376256 00000100:00100000:3.0:1783951855.238798:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:3.0:1783951855.238809:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465376256:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1783951855.238830:0:8445:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b16dd6f480 x1870605465376256/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:116/0 lens 224/0 e 0 to 0 dl 1783951866 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951855.238843:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465376256:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 37us (973us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783951855.238851:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00010000:00010000:3.0:1783951855.276318:0:85211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4124 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.276341:0:85211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4124 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.276366:0:85211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4124 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.276383:0:85211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.276401:0:85211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.276407:0:85211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.278579:0:85211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4124 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.278617:0:85211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4124 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.278704:0:85211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4124 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.278712:0:85211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc72e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951855.278716:0:85211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4124 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.278724:0:85211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4124 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.278740:0:85211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b155cd6500) 00010000:00010000:3.0:1783951855.278744:0:85211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951855.278748:0:85211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4124 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.278754:0:85211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4124 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951855.278780:0:85211:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007662d959 reply state 000000006185ddf7 transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.278802:0:85211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.278809:0:85211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b155cd6d00) 00010000:00010000:3.0:1783951855.278812:0:85211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951855.278815:0:85211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783951855.278937:0:85211:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783951855.278957:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951855.278960:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000020:00080000:3.0:1783951855.278964:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951855.278967:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000100:00100000:3.0:1783951855.285386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951855.286887:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447677696 00000100:00100000:3.0:1783951855.286901:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447677696 00000100:00100000:3.0:1783951855.287264:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1064 00000100:00100000:3.0:1783951855.287280:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447677696:12345-192.168.202.48@tcp:36:rm.0 00010000:00080000:3.0:1783951855.287301:0:83761:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247811, current: 98784247811, replaying 00000100:00100000:3.0:1783951855.287323:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447677696:12345-192.168.202.48@tcp:36:rm.0 Request processed in 49us (1946us total) trans 0 rc 0/-999 00000020:00080000:2.0:1783951855.287368:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951855.287372:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247811, next_transno: 98784247811 00010000:00080000:2.0:1783951855.287377:0:85211:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247811) 00000020:00080000:2.0:1783951855.287380:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951855.287389:0:85211:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447677696 t98784247811 from 192.168.202.48@tcp req@ffff97b14de1dc00 x1870605447677696/t0(98784247811) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:116/0 lens 512/0 e 0 to 0 dl 1783951866 ref 2 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783951855.287484:0:85211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb4132 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287500:0:85211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb4132 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287511:0:85211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb4132 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287523:0:85211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287530:0:85211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287536:0:85211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287668:0:85211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4140 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287676:0:85211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4140 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287683:0:85211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4140 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287906:0:85211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4140 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287914:0:85211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4140 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287920:0:85211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4140 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287926:0:85211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216bc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951855.287932:0:85211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4140 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287938:0:85211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4140 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287950:0:85211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff97b04d802400) 00010000:00010000:2.0:1783951855.287953:0:85211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783951855.287957:0:85211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4140 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.287962:0:85211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4140 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.288001:0:85211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb4132 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.288007:0:85211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb4132 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.288013:0:85211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb4132 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.288018:0:85211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951855.288020:0:85211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb4132 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.288026:0:85211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb4132 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.288035:0:85211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d802900) 00010000:00010000:2.0:1783951855.288037:0:85211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951855.288040:0:85211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb4132 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.288045:0:85211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb4132 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951855.288055:0:85211:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ff25dc1 reply state 000000007f4643df transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.288065:0:85211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.288071:0:85211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b155cd6d00) 00010000:00010000:2.0:1783951855.288079:0:85211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951855.288082:0:85211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1783951855.288157:0:85211:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1783951855.288167:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951855.288169:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000020:00080000:2.0:1783951855.288172:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951855.288174:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000100:00100000:3.0:1783951855.297149:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1064 00000001:00080000:3.0:1783951855.297932:0:85179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247810 is committed 00010000:00010000:3.0:1783951855.297980:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.297992:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.298017:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.298024:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951855.298028:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.298037:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.298064:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b155cd6d00) 00010000:00010000:3.0:1783951855.298068:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951855.298073:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.298079:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73a00/0x22c73c7857bb412b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951855.298344:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951855.298432:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447678848 00000100:00100000:3.0:1783951855.298442:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447678848 00000100:00100000:3.0:1783951855.298501:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1065 00000100:00100000:3.0:1783951855.298512:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447678848:12345-192.168.202.48@tcp:101:lfs.0 00010000:00080000:3.0:1783951855.298530:0:66238:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247812, current: 98784247812, replaying 00000100:00100000:3.0:1783951855.298544:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447678848:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 35us (203us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783951855.298550:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1065 00000020:00080000:3.0:1783951855.298565:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951855.298569:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247812, next_transno: 98784247812 00010000:00080000:3.0:1783951855.298579:0:85211:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247812) 00000020:00080000:3.0:1783951855.298582:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951855.298784:0:85211:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447678848 t98784247812 from 192.168.202.48@tcp req@ffff97b16dd6fb80 x1870605447678848/t0(98784247812) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:116/0 lens 536/0 e 0 to 0 dl 1783951866 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1783951855.298809:0:85211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951855.298831:0:85211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4147 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a11d expref: -99 pid: 85211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299114:0:85211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73400/0x22c73c7857bb414e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299128:0:85211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73400/0x22c73c7857bb414e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299139:0:85211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73400/0x22c73c7857bb414e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299156:0:85211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299163:0:85211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299170:0:85211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951855.299854:0:85211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:3.0:1783951855.299874:0:85211:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x22c73c7857bb3eca 00000004:00080000:3.0:1783951855.299876:0:85211:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x22c73c7857bb3eca in new mfd 00010000:00010000:3.0:1783951855.299888:0:85211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73400/0x22c73c7857bb414e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299908:0:85211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73400/0x22c73c7857bb414e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299914:0:85211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73400/0x22c73c7857bb414e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299919:0:85211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951855.299922:0:85211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73400/0x22c73c7857bb414e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299929:0:85211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73400/0x22c73c7857bb414e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299939:0:85211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9e000) 00010000:00010000:3.0:1783951855.299942:0:85211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951855.299947:0:85211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73400/0x22c73c7857bb414e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.299953:0:85211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73400/0x22c73c7857bb414e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951855.299966:0:85211:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067452531 reply state 000000003fd6f9cc transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.300532:0:85211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.300540:0:85211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff97b150d9e100) 00010000:00010000:3.0:1783951855.300542:0:85211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951855.300546:0:85211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783951855.300576:0:85211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4147 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 10 pid: 85211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.300906:0:85211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9e000) 00010000:00010000:3.0:1783951855.300908:0:85211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951855.300913:0:85211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4147 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a11d expref: 10 pid: 85211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.300931:0:85211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14dc72e00, rc 0) 00010000:00080000:3.0:1783951855.301465:0:85211:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783951855.301487:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951855.301490:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000020:00080000:3.0:1783951855.301494:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951855.301496:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000100:00100000:1.0:1783951855.361501:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951855.361683:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447679104 00000100:00100000:3.0:1783951855.361696:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447679104 00000100:00100000:3.0:1783951855.361770:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1066 00000100:00100000:3.0:1783951855.361782:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:2397:x1870605447679104:12345-192.168.202.48@tcp:101:lfs.0 00010000:00080000:3.0:1783951855.361806:0:66236:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:3.0:1783951855.361822:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:2397:x1870605447679104:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 44us (331us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783951855.361829:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1066 00000020:00080000:3.0:1783951855.361846:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951855.361850:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:3.0:1783951855.361854:0:85211:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:3.0:1783951855.361857:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951855.361865:0:85211:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447679104 t98784247813 from 192.168.202.48@tcp req@ffff97b146bad880 x1870605447679104/t0(98784247813) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:116/0 lens 736/0 e 0 to 0 dl 1783951866 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1783951855.361903:0:85211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951855.361929:0:85211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a124 expref: -99 pid: 85211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951855.362552:0:85211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:3.0:1783951855.362818:0:85211:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x22c73c7857bb3edf 00000004:00080000:3.0:1783951855.362821:0:85211:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x22c73c7857bb3edf in new mfd 00010000:00010000:3.0:1783951855.362855:0:85211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4163 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a124 expref: 12 pid: 85211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.362870:0:85211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9e000) 00010000:00010000:3.0:1783951855.362873:0:85211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951855.362877:0:85211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc72e00/0x22c73c7857bb4163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a124 expref: 12 pid: 85211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.362894:0:85211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14dc72e00, rc 0) 00010000:00080000:3.0:1783951855.362953:0:85211:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783951855.362968:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951855.364063:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:3.0:1783951855.364074:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951855.364076:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:2.0:1783951855.373024:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951855.373184:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447679488 00000100:00100000:3.0:1783951855.373195:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447679488 00000100:00100000:3.0:1783951855.373253:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 216 00000100:00100000:3.0:1783951855.373264:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:2397:x1870605447679488:12345-192.168.202.48@tcp:35:lfs.0 00010000:00080000:3.0:1783951855.373284:0:66239:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:3.0:1783951855.373318:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:2397:x1870605447679488:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 56us (307us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783951855.373325:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 216 00000020:00080000:2.0:1783951855.373467:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951855.373471:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:2.0:1783951855.373476:0:85211:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:2.0:1783951855.373479:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951855.373489:0:85211:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447679488 t98784247814 from 192.168.202.48@tcp req@ffff97b047999f80 x1870605447679488/t0(98784247814) o35->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:116/0 lens 392/0 e 0 to 0 dl 1783951866 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783951855.373770:0:85211:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1783951855.373784:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951855.373786:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:2.0:1783951855.373790:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951855.373792:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:1.0:1783951855.405419:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951855.410442:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447679744 00000100:00100000:2.0:1783951855.410534:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447679744 00000100:00100000:2.0:1783951855.410607:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 217 00000100:00100000:2.0:1783951855.410618:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177063450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+12:2397:x1870605447679744:12345-192.168.202.48@tcp:35:lfs.0 00010000:00080000:2.0:1783951855.410838:0:66241:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:2.0:1783951855.410859:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177063450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+12:2397:x1870605447679744:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 243us (5448us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783951855.410867:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 217 00000020:00080000:0.0:1783951855.410954:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783951855.410959:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:0.0:1783951855.410963:0:85211:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:0.0:1783951855.410966:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783951855.411533:0:85211:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447679744 t98784247815 from 192.168.202.48@tcp req@ffff97b177063450 x1870605447679744/t0(98784247815) o35->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:116/0 lens 392/0 e 0 to 0 dl 1783951866 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783951855.411899:0:85211:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783951855.411932:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783951855.411935:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:0.0:1783951855.411939:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783951855.411941:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:1.0:1783951855.427929:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951855.428403:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447685504 00000100:00100000:0.0:1783951855.428414:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447685504 00000100:00100000:0.0:1783951855.428488:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1026 00000100:00100000:0.0:1783951855.428498:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+13:2397:x1870605447685504:12345-192.168.202.48@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1783951855.428524:0:66237:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b146baf100 x1870605447685504/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:116/0 lens 224/0 e 0 to 0 dl 1783951866 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951855.428550:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+13:2397:x1870605447685504:12345-192.168.202.48@tcp:400:ldlm_lock_repla.0 Request processed in 54us (630us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783951855.428557:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1026 00000020:00080000:1.0:1783951855.428646:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951855.428651:0:85211:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247816 00010000:00080000:1.0:1783951855.428660:0:85211:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1783951855.428663:0:85211:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951855.428669:0:85211:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783951855.428672:0:85211:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1783951855.428775:0:85211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:0.0:1783951855.431168:0:85179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00100000:0.0:1783951855.431180:0:85179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1783951855.431206:0:85179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00000001:00080000:3.0:1783951855.431303:0:85211:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783951855.431340:0:85211:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783951855.431364:0:85211:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff97b16dd6f480 x1870605465376256/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:116/0 lens 224/0 e 0 to 0 dl 1783951866 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783951855.431501:0:85211:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.48@tcp: req@ffff97b146baf100 x1870605447685504/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:116/0 lens 224/0 e 0 to 0 dl 1783951866 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783951855.431557:0:85211:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1783951855.432647:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1783951855.432659:0:3641:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff97b146bad180 x1870605465376256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951871 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951855.432671:0:3641:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff97b146bad180 x1870605465376256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951871 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951855.432678:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783951855.432689:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783951855.432694:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465376256:0@lo:400:ldlm_lock_repla.0 00010000:00010000:1.0:1783951855.433040:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433061:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433069:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433076:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216be00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951855.433081:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433090:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433113:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b155cd6d00) 00010000:00010000:1.0:1783951855.433116:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951855.433122:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433128:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4139 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433152:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433176:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433182:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433186:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951855.433190:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433196:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433204:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff97b150d9e100) 00010000:00010000:1.0:1783951855.433207:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951855.433210:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.433215:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14dc73000/0x22c73c7857bb4155 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951855.433300:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951855.433314:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465376384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951855.433384:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.433428:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465376384 00000100:00100000:1.0:1783951855.433435:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465376384 00000100:00100000:1.0:1783951855.434974:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:1.0:1783951855.434989:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465376384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951855.435026:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:1.0:1783951855.435124:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465376384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951855.435133:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:0.0:1783951855.448326:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465376384:0@lo:41:osp-pre-0-1.0 00000004:00000080:3.0:1783951855.468612:0:85211:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa80a41fe7e10 00100000:10000000:3.0:1783951855.468628:0:85211:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1783951855.470392:0:85197:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6a2:0x0] 00000100:00100000:1.0:1783951855.470464:0:85197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85197:1870605465376512:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783951855.470535:0:85197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.470572:0:85197:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434aa780 going to sleep for 11 seconds 00000004:00080000:1.0:1783951855.470612:0:85199:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x47c:0x0] 00000100:00100000:1.0:1783951855.470632:0:85199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85199:1870605465376640:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783951855.470658:0:85199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.470675:0:85199:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434aa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951855.470860:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465376512 00000100:00100000:0.0:1783951855.470868:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465376512 00000100:00100000:0.0:1783951855.470911:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465376640 00000100:00100000:0.0:1783951855.470914:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465376640 00000100:00100000:0.0:1783951855.470937:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4891 00000100:00100000:0.0:1783951855.470946:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:85197:x1870605465376512:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783951855.470986:0:26207:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -63 00002000:02000040:0.0:1783951855.470991:0:26207:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1699 to 0x280000401:1761) 00000100:00100000:1.0:1783951855.471139:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4892 00000100:00100000:1.0:1783951855.471148:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:85199:x1870605465376640:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783951855.471164:0:11961:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -613 00002000:02000040:1.0:1783951855.471168:0:11961:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1149 to 0x2c0000401:1761) 00002000:00010000:0.0:1783951855.479739:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.479753:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e83c5737/0x22c73c7857bb4171 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.479771:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.479776:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.479791:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e83c5737/0x22c73c7857bb4171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.479808:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e83c5737/0x22c73c7857bb4171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.479819:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e83c5737/0x22c73c7857bb4171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.479826:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e83c5737/0x22c73c7857bb4171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.479851:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.480881:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.480890:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e83c5737/0x22c73c7857bb4171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.480899:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.480904:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e83c5737/0x22c73c7857bb4171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.480914:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e83c5737/0x22c73c7857bb4171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.480930:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e83c5737/0x22c73c7857bb4171 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.480948:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e83c5737/0x22c73c7857bb4171 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.480968:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.480980:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.480982:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.483162:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.483175:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013344a6c/0x22c73c7857bb4178 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483190:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.483195:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.483201:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013344a6c/0x22c73c7857bb4178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483214:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013344a6c/0x22c73c7857bb4178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483223:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013344a6c/0x22c73c7857bb4178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483229:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013344a6c/0x22c73c7857bb4178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483258:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951855.483377:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.483382:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ffdef9/0x22c73c7857bb417f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483391:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.483394:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.483398:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ffdef9/0x22c73c7857bb417f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483406:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020ffdef9/0x22c73c7857bb417f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483413:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ffdef9/0x22c73c7857bb417f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483419:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020ffdef9/0x22c73c7857bb417f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483433:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951855.483442:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951855.483448:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013344a6c/0x22c73c7857bb4178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483456:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc72e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.483460:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013344a6c/0x22c73c7857bb4178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483480:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013344a6c/0x22c73c7857bb4178 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483496:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013344a6c/0x22c73c7857bb4178 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483504:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013344a6c/0x22c73c7857bb4178 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483524:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.483527:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020ffdef9/0x22c73c7857bb417f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483533:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.483537:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ffdef9/0x22c73c7857bb417f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483544:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ffdef9/0x22c73c7857bb417f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483554:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020ffdef9/0x22c73c7857bb417f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483561:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ffdef9/0x22c73c7857bb417f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483604:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.483607:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.483609:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.483660:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.483665:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b67f6dc/0x22c73c7857bb4186 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483673:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.483676:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.483680:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b67f6dc/0x22c73c7857bb4186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483689:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b67f6dc/0x22c73c7857bb4186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483697:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b67f6dc/0x22c73c7857bb4186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483704:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b67f6dc/0x22c73c7857bb4186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483719:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951855.483755:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.483760:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057ba8b00/0x22c73c7857bb418d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483778:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.483781:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.483785:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057ba8b00/0x22c73c7857bb418d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483794:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057ba8b00/0x22c73c7857bb418d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483801:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057ba8b00/0x22c73c7857bb418d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483808:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057ba8b00/0x22c73c7857bb418d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483820:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951855.483829:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951855.483834:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b67f6dc/0x22c73c7857bb4186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483841:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.483844:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b67f6dc/0x22c73c7857bb4186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483851:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b67f6dc/0x22c73c7857bb4186 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483873:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b67f6dc/0x22c73c7857bb4186 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483881:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b67f6dc/0x22c73c7857bb4186 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483895:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.483898:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057ba8b00/0x22c73c7857bb418d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483905:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.483909:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057ba8b00/0x22c73c7857bb418d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483917:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057ba8b00/0x22c73c7857bb418d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483927:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057ba8b00/0x22c73c7857bb418d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483934:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057ba8b00/0x22c73c7857bb418d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.483946:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.483948:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.483956:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.484016:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.484022:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4555373/0x22c73c7857bb4194 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484030:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.484034:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.484038:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4555373/0x22c73c7857bb4194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484047:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4555373/0x22c73c7857bb4194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484055:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4555373/0x22c73c7857bb4194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484062:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4555373/0x22c73c7857bb4194 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484075:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.484081:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.484085:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4555373/0x22c73c7857bb4194 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484092:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc72000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.484095:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4555373/0x22c73c7857bb4194 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484115:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4555373/0x22c73c7857bb4194 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484126:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4555373/0x22c73c7857bb4194 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484133:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4555373/0x22c73c7857bb4194 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484147:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.484149:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.484150:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.484193:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.484198:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6c43eaa/0x22c73c7857bb419b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484206:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.484210:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.484213:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c43eaa/0x22c73c7857bb419b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484222:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6c43eaa/0x22c73c7857bb419b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484230:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6c43eaa/0x22c73c7857bb419b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484243:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c43eaa/0x22c73c7857bb419b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484255:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.484261:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.484265:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6c43eaa/0x22c73c7857bb419b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484271:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc72800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.484274:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6c43eaa/0x22c73c7857bb419b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484281:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6c43eaa/0x22c73c7857bb419b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484291:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6c43eaa/0x22c73c7857bb419b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484298:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6c43eaa/0x22c73c7857bb419b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484310:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.484312:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.484314:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.484364:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.484375:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045810dfa/0x22c73c7857bb41a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484384:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.484387:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.484390:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045810dfa/0x22c73c7857bb41a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484398:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045810dfa/0x22c73c7857bb41a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484404:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045810dfa/0x22c73c7857bb41a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484410:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045810dfa/0x22c73c7857bb41a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484422:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.484428:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.484432:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045810dfa/0x22c73c7857bb41a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484438:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc72600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.484441:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045810dfa/0x22c73c7857bb41a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484449:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045810dfa/0x22c73c7857bb41a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484466:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045810dfa/0x22c73c7857bb41a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484473:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045810dfa/0x22c73c7857bb41a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484486:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.484488:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.484490:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.484533:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.484538:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b1043b/0x22c73c7857bb41a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484547:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.484550:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.484554:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056b1043b/0x22c73c7857bb41a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484562:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056b1043b/0x22c73c7857bb41a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484569:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b1043b/0x22c73c7857bb41a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484576:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056b1043b/0x22c73c7857bb41a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484618:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.484625:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.484628:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056b1043b/0x22c73c7857bb41a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484635:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.484638:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b1043b/0x22c73c7857bb41a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484645:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b1043b/0x22c73c7857bb41a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484655:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056b1043b/0x22c73c7857bb41a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484661:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056b1043b/0x22c73c7857bb41a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484673:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.484674:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.484676:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.484715:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.484719:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cdbf17b/0x22c73c7857bb41b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484726:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.484734:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.484738:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cdbf17b/0x22c73c7857bb41b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484746:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cdbf17b/0x22c73c7857bb41b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484753:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cdbf17b/0x22c73c7857bb41b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484760:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cdbf17b/0x22c73c7857bb41b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484772:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.484778:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.484782:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cdbf17b/0x22c73c7857bb41b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484789:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e5800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.484791:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cdbf17b/0x22c73c7857bb41b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484798:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cdbf17b/0x22c73c7857bb41b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484807:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cdbf17b/0x22c73c7857bb41b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484823:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cdbf17b/0x22c73c7857bb41b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484835:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.484836:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.484838:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.484882:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.484887:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a920008/0x22c73c7857bb41b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484894:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.484897:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.484901:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a920008/0x22c73c7857bb41b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484909:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a920008/0x22c73c7857bb41b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484916:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a920008/0x22c73c7857bb41b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484922:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a920008/0x22c73c7857bb41b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484950:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.484962:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.484966:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a920008/0x22c73c7857bb41b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484974:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.484977:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a920008/0x22c73c7857bb41b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484985:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a920008/0x22c73c7857bb41b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.484996:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a920008/0x22c73c7857bb41b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485003:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a920008/0x22c73c7857bb41b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485017:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485019:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485021:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.485066:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.485070:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ce0046/0x22c73c7857bb41be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485078:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.485080:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.485084:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ce0046/0x22c73c7857bb41be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485104:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5ce0046/0x22c73c7857bb41be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485112:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ce0046/0x22c73c7857bb41be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485119:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ce0046/0x22c73c7857bb41be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485131:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.485137:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.485140:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5ce0046/0x22c73c7857bb41be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485147:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ebc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.485150:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ce0046/0x22c73c7857bb41be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485157:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ce0046/0x22c73c7857bb41be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485166:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5ce0046/0x22c73c7857bb41be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485174:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5ce0046/0x22c73c7857bb41be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485194:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485196:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485198:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.485244:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.485248:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c815e8d2/0x22c73c7857bb41c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485255:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.485258:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.485262:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c815e8d2/0x22c73c7857bb41c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485270:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c815e8d2/0x22c73c7857bb41c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485277:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c815e8d2/0x22c73c7857bb41c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485284:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c815e8d2/0x22c73c7857bb41c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485298:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.485304:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.485308:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c815e8d2/0x22c73c7857bb41c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485325:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ea400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.485328:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c815e8d2/0x22c73c7857bb41c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485334:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c815e8d2/0x22c73c7857bb41c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485344:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c815e8d2/0x22c73c7857bb41c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485364:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c815e8d2/0x22c73c7857bb41c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485376:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485377:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485379:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.485419:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.485424:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3ad80d2/0x22c73c7857bb41cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485431:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.485434:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.485438:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ad80d2/0x22c73c7857bb41cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485446:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3ad80d2/0x22c73c7857bb41cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485460:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3ad80d2/0x22c73c7857bb41cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485467:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ad80d2/0x22c73c7857bb41cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485479:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.485487:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.485490:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3ad80d2/0x22c73c7857bb41cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485497:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eac00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.485500:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3ad80d2/0x22c73c7857bb41cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485507:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3ad80d2/0x22c73c7857bb41cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485519:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3ad80d2/0x22c73c7857bb41cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485526:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3ad80d2/0x22c73c7857bb41cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485539:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485547:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485548:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.485612:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.485617:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ab89ab/0x22c73c7857bb41d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485624:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.485627:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.485631:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028ab89ab/0x22c73c7857bb41d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485640:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028ab89ab/0x22c73c7857bb41d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485648:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ab89ab/0x22c73c7857bb41d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485655:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028ab89ab/0x22c73c7857bb41d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485667:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.485674:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.485677:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028ab89ab/0x22c73c7857bb41d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485683:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eb400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.485685:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ab89ab/0x22c73c7857bb41d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485704:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ab89ab/0x22c73c7857bb41d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485714:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028ab89ab/0x22c73c7857bb41d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485722:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028ab89ab/0x22c73c7857bb41d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485734:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485736:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485738:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.485780:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.485786:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000806e85e1/0x22c73c7857bb41da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485794:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.485797:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.485801:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000806e85e1/0x22c73c7857bb41da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485809:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000806e85e1/0x22c73c7857bb41da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485816:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000806e85e1/0x22c73c7857bb41da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485828:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000806e85e1/0x22c73c7857bb41da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485839:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.485846:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.485849:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000806e85e1/0x22c73c7857bb41da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485855:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eba00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.485857:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000806e85e1/0x22c73c7857bb41da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485864:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000806e85e1/0x22c73c7857bb41da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485875:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000806e85e1/0x22c73c7857bb41da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485883:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000806e85e1/0x22c73c7857bb41da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485896:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485898:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.485900:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.485945:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.485956:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9c0015/0x22c73c7857bb41e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485964:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.485967:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.485971:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9c0015/0x22c73c7857bb41e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485979:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9c0015/0x22c73c7857bb41e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485987:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9c0015/0x22c73c7857bb41e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.485994:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9c0015/0x22c73c7857bb41e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486006:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.486013:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.486017:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9c0015/0x22c73c7857bb41e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486023:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eb000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.486026:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9c0015/0x22c73c7857bb41e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486034:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9c0015/0x22c73c7857bb41e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486051:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9c0015/0x22c73c7857bb41e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486057:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9c0015/0x22c73c7857bb41e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486072:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.486074:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.486075:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.486117:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.486121:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bb695a7/0x22c73c7857bb41e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486129:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.486132:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.486136:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bb695a7/0x22c73c7857bb41e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486144:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bb695a7/0x22c73c7857bb41e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486152:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bb695a7/0x22c73c7857bb41e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486159:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bb695a7/0x22c73c7857bb41e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486181:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.486189:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.486193:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bb695a7/0x22c73c7857bb41e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486199:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ea000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.486202:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bb695a7/0x22c73c7857bb41e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486210:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bb695a7/0x22c73c7857bb41e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486221:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bb695a7/0x22c73c7857bb41e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486229:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bb695a7/0x22c73c7857bb41e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486241:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.486243:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.486245:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.486324:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.486329:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003113c082/0x22c73c7857bb41ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.486337:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:2.0:1783951855.488989:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783951855.493402:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783951855.493775:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.493791:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003113c082/0x22c73c7857bb41ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.493810:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003113c082/0x22c73c7857bb41ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.493821:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003113c082/0x22c73c7857bb41ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.493829:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003113c082/0x22c73c7857bb41ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.493848:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.493860:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.493866:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003113c082/0x22c73c7857bb41ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.493873:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eb800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.493877:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003113c082/0x22c73c7857bb41ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.493886:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003113c082/0x22c73c7857bb41ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.493901:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003113c082/0x22c73c7857bb41ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.493921:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003113c082/0x22c73c7857bb41ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.493945:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.493947:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.493949:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.494225:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.494231:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000761191a1/0x22c73c7857bb41f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.494240:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.494244:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.494248:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000761191a1/0x22c73c7857bb41f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.494258:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000761191a1/0x22c73c7857bb41f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.494266:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000761191a1/0x22c73c7857bb41f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.494274:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000761191a1/0x22c73c7857bb41f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.494288:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.494302:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.494306:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000761191a1/0x22c73c7857bb41f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.494313:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ea200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.494317:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000761191a1/0x22c73c7857bb41f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.494324:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000761191a1/0x22c73c7857bb41f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.494336:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000761191a1/0x22c73c7857bb41f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.494343:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000761191a1/0x22c73c7857bb41f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496150:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.496153:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.496155:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.496247:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.496254:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0f3493f/0x22c73c7857bb41fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496266:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.496270:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.496275:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0f3493f/0x22c73c7857bb41fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496302:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0f3493f/0x22c73c7857bb41fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496312:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0f3493f/0x22c73c7857bb41fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496319:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0f3493f/0x22c73c7857bb41fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496345:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951855.496409:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.496414:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d34a92f5/0x22c73c7857bb4204 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496422:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.496425:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.496429:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d34a92f5/0x22c73c7857bb4204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496438:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d34a92f5/0x22c73c7857bb4204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496458:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d34a92f5/0x22c73c7857bb4204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496477:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d34a92f5/0x22c73c7857bb4204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496492:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783951855.496500:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951855.496504:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0f3493f/0x22c73c7857bb41fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496511:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eb600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.496514:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0f3493f/0x22c73c7857bb41fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496523:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0f3493f/0x22c73c7857bb41fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496537:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0f3493f/0x22c73c7857bb41fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496544:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0f3493f/0x22c73c7857bb41fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496558:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.496561:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d34a92f5/0x22c73c7857bb4204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496577:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eb200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.496580:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d34a92f5/0x22c73c7857bb4204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496605:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d34a92f5/0x22c73c7857bb4204 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496617:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d34a92f5/0x22c73c7857bb4204 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496624:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d34a92f5/0x22c73c7857bb4204 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496637:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.496639:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.496641:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.496685:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.496690:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b38c1a1e/0x22c73c7857bb420b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496697:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.496700:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.496704:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b38c1a1e/0x22c73c7857bb420b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496713:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b38c1a1e/0x22c73c7857bb420b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496727:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b38c1a1e/0x22c73c7857bb420b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496734:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b38c1a1e/0x22c73c7857bb420b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496745:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.496751:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.496754:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b38c1a1e/0x22c73c7857bb420b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496760:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ea800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.496764:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b38c1a1e/0x22c73c7857bb420b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496771:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b38c1a1e/0x22c73c7857bb420b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496781:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b38c1a1e/0x22c73c7857bb420b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496788:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b38c1a1e/0x22c73c7857bb420b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496799:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.496806:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.496808:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.496903:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.496908:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f83504/0x22c73c7857bb4212 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496916:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.496919:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.496923:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030f83504/0x22c73c7857bb4212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496932:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030f83504/0x22c73c7857bb4212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496939:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f83504/0x22c73c7857bb4212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496945:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030f83504/0x22c73c7857bb4212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.496956:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.496961:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.496964:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030f83504/0x22c73c7857bb4212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498142:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eae00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.498148:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f83504/0x22c73c7857bb4212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498177:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f83504/0x22c73c7857bb4212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498193:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030f83504/0x22c73c7857bb4212 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498201:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030f83504/0x22c73c7857bb4212 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498225:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.498227:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.498229:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.498314:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.498320:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b420490/0x22c73c7857bb4219 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498329:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.498332:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.498337:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b420490/0x22c73c7857bb4219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498358:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b420490/0x22c73c7857bb4219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498367:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b420490/0x22c73c7857bb4219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498382:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b420490/0x22c73c7857bb4219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498402:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.498410:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.498414:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b420490/0x22c73c7857bb4219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498421:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762eaa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.498424:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b420490/0x22c73c7857bb4219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498432:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b420490/0x22c73c7857bb4219 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.498443:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b420490/0x22c73c7857bb4219 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951855.498737:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951855.498743:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb4220 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.498752:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:1.0:1783951855.498755:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951855.498758:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb4220 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.498769:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb4220 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.498788:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb4220 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.498794:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb4220 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.498810:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.499169:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b420490/0x22c73c7857bb4219 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499189:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.499192:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb4220 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499208:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.499211:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb4220 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499217:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb4220 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499228:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb4220 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499234:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb4220 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499247:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.499249:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.499251:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.499300:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.499304:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c2f2eb/0x22c73c7857bb4227 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499312:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.499314:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.499317:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c2f2eb/0x22c73c7857bb4227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499325:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c2f2eb/0x22c73c7857bb4227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499339:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c2f2eb/0x22c73c7857bb4227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499345:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013c2f2eb/0x22c73c7857bb4227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499371:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.499378:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.499382:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013c2f2eb/0x22c73c7857bb4227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499387:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ebe00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.499390:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c2f2eb/0x22c73c7857bb4227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499397:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c2f2eb/0x22c73c7857bb4227 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499407:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013c2f2eb/0x22c73c7857bb4227 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499414:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c2f2eb/0x22c73c7857bb4227 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499429:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.499436:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.499437:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.499492:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.499497:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a5d667/0x22c73c7857bb422e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499505:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.499508:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.499512:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a5d667/0x22c73c7857bb422e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499519:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a5d667/0x22c73c7857bb422e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499526:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a5d667/0x22c73c7857bb422e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499532:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a5d667/0x22c73c7857bb422e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499544:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.499550:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.499553:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a5d667/0x22c73c7857bb422e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499558:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ea600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.499561:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a5d667/0x22c73c7857bb422e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499576:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a5d667/0x22c73c7857bb422e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499600:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a5d667/0x22c73c7857bb422e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499608:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a5d667/0x22c73c7857bb422e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499621:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.499623:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.499625:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.499669:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.499674:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007b81132/0x22c73c7857bb4235 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499681:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.499684:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.499688:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007b81132/0x22c73c7857bb4235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499696:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007b81132/0x22c73c7857bb4235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499703:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007b81132/0x22c73c7857bb4235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499717:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007b81132/0x22c73c7857bb4235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499730:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.499737:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.499741:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007b81132/0x22c73c7857bb4235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499747:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.499751:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007b81132/0x22c73c7857bb4235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499758:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007b81132/0x22c73c7857bb4235 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499769:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007b81132/0x22c73c7857bb4235 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499775:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007b81132/0x22c73c7857bb4235 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499789:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.499790:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.499792:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.499834:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.499844:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb423c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499851:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.499854:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.499857:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb423c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499865:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb423c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499872:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb423c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499880:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb423c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499891:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951855.499898:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.499901:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb423c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499908:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.499911:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb423c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499918:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb423c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499936:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb423c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499943:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb423c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.499956:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.499958:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.499960:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951855.500001:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.500006:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4243 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.500013:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.500016:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.500020:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.500028:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.500035:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.500042:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500321:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.500328:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951855.500393:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951855.500399:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb424a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500407:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:1.0:1783951855.500410:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951855.500414:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb424a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500423:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb424a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500429:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb424a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500435:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb424a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500518:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951855.500549:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951855.500554:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb424a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500560:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ac00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.500563:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb424a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500571:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb424a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500582:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb424a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500605:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb424a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.500619:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.500621:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.500622:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.501167:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783951855.501223:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.501229:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4251 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.501238:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.501241:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.501245:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.501254:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.501261:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.501268:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.501281:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783951855.501320:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951855.501325:0:26207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb4258 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.501332:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:3.0:1783951855.501340:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951855.501344:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb4258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951855.501752:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.501758:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb425f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501767:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.501770:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.501774:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb425f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501784:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb425f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501791:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb425f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501806:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb425f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501821:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783951855.501868:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.501873:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057c22afc/0x22c73c7857bb4266 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501880:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.501882:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.501886:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057c22afc/0x22c73c7857bb4266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501893:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057c22afc/0x22c73c7857bb4266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501901:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057c22afc/0x22c73c7857bb4266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501908:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057c22afc/0x22c73c7857bb4266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501917:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1783951855.501952:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.501957:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087138c2a/0x22c73c7857bb426d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501981:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.501985:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.501988:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087138c2a/0x22c73c7857bb426d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.501997:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087138c2a/0x22c73c7857bb426d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502005:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087138c2a/0x22c73c7857bb426d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502011:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087138c2a/0x22c73c7857bb426d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502019:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1783951855.502165:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.502171:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dab8ad2/0x22c73c7857bb4274 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502178:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.502181:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.502185:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dab8ad2/0x22c73c7857bb4274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502193:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dab8ad2/0x22c73c7857bb4274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502213:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dab8ad2/0x22c73c7857bb4274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502221:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dab8ad2/0x22c73c7857bb4274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502229:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1783951855.502269:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.502274:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009af16ec7/0x22c73c7857bb427b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502282:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.502285:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.502289:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009af16ec7/0x22c73c7857bb427b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502298:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009af16ec7/0x22c73c7857bb427b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502307:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009af16ec7/0x22c73c7857bb427b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502314:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009af16ec7/0x22c73c7857bb427b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502333:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1783951855.502436:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.502441:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eae6d272/0x22c73c7857bb4282 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502524:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.502527:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.502531:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eae6d272/0x22c73c7857bb4282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502541:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eae6d272/0x22c73c7857bb4282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502548:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eae6d272/0x22c73c7857bb4282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502554:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eae6d272/0x22c73c7857bb4282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502562:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1783951855.502631:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.502636:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4289 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502644:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.502653:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.502657:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502667:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502675:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502682:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502691:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1783951855.502731:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.502736:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb4290 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502743:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.502746:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.502750:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb4290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502758:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb4290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502765:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb4290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502778:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb4290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502786:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1783951855.502824:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.502829:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4297 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502837:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.502839:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.502842:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502850:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502857:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502863:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502871:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1783951855.502921:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.502926:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb429e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502939:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.502942:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.502946:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb429e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502955:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb429e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.502964:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb429e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503144:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1783951855.503151:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503159:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503169:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503179:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4243 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503195:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4243 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503203:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4243 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503222:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1783951855.503226:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503231:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ffc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503234:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503240:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4251 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503248:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4251 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503254:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4251 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503273:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1783951855.503276:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb425f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503283:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503286:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb425f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503293:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb425f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503304:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb425f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503311:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb3ebaf3/0x22c73c7857bb425f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503324:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1783951855.503327:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057c22afc/0x22c73c7857bb4266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503333:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503336:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057c22afc/0x22c73c7857bb4266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503367:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057c22afc/0x22c73c7857bb4266 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503378:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057c22afc/0x22c73c7857bb4266 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503384:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057c22afc/0x22c73c7857bb4266 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503398:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783951855.503401:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087138c2a/0x22c73c7857bb426d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503406:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503409:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087138c2a/0x22c73c7857bb426d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503415:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087138c2a/0x22c73c7857bb426d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503422:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087138c2a/0x22c73c7857bb426d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503429:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087138c2a/0x22c73c7857bb426d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503465:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783951855.503469:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dab8ad2/0x22c73c7857bb4274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503476:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503478:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dab8ad2/0x22c73c7857bb4274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503485:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dab8ad2/0x22c73c7857bb4274 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503494:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dab8ad2/0x22c73c7857bb4274 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503500:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dab8ad2/0x22c73c7857bb4274 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503510:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783951855.503513:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009af16ec7/0x22c73c7857bb427b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503519:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f8e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503522:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009af16ec7/0x22c73c7857bb427b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503538:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009af16ec7/0x22c73c7857bb427b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503547:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009af16ec7/0x22c73c7857bb427b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503553:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009af16ec7/0x22c73c7857bb427b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503564:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783951855.503567:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eae6d272/0x22c73c7857bb4282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503572:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503575:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eae6d272/0x22c73c7857bb4282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503582:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eae6d272/0x22c73c7857bb4282 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503610:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eae6d272/0x22c73c7857bb4282 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503616:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eae6d272/0x22c73c7857bb4282 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503640:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783951855.503644:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503650:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cd400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503653:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503660:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503669:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4289 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503677:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4289 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503688:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951855.503691:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb4290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503698:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cda00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503701:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb4290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503719:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb4290 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503728:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb4290 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503735:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb4290 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503747:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951855.503750:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503757:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cd200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.503760:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503767:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503776:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4297 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503782:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4297 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.503803:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.503805:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.503807:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.503814:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.503834:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951855.504186:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb429e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.504209:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951855.504283:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.504289:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb42a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.504298:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.504302:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.504307:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb42a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.504316:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb42a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.504337:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb42a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.504344:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb42a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.504368:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951855.504410:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.504416:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb42ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.504423:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.504426:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.504429:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb42ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.504437:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb42ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.504544:0:26207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb4258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.504552:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb4258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.504558:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb4258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.504569:0:26207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1783951855.504855:0:26207:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1698 00000100:00100000:3.0:1783951855.504942:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:85197:x1870605465376512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 33993us (34402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951855.504952:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4891 00000100:00100000:1.0:1783951855.505225:0:85197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85197:1870605465376512:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783951855.505243:0:85197:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6e1:0x0] from OST, last_created [0x280000401:0x6e1:0x0]last_used is [0x280000401:0x6a2:0x0] 00000100:00100000:1.0:1783951855.505324:0:85197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85197:1870605465376896:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783951855.505375:0:85197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.505399:0:85197:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434aa780 going to sleep for 11 seconds 00010000:00010000:0.0:1783951855.505556:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb42ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505568:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb42ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505608:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1783951855.505672:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.505677:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb42b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505685:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.505688:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.505693:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb42b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505702:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb42b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505710:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb42b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505716:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb42b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505724:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1783951855.505758:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.505763:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb42ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505769:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.505777:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.505782:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb42ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505791:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb42ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505799:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb42ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505807:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb42ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505814:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1783951855.505856:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.505861:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb42c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505868:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.505871:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.505875:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb42c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505884:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb42c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505891:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb42c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505904:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb42c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505912:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1783951855.505949:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.505954:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb42c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.505962:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.505965:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.505968:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb42c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951855.506136:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465376896 00000100:00100000:3.0:1783951855.506143:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465376896 00000100:00100000:3.0:1783951855.506187:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4893 00000100:00100000:3.0:1783951855.506196:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:85197:x1870605465376896:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783951855.506235:0:26207:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1762 00010000:00010000:2.0:1783951855.507151:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783951855.507159:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb429e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507169:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951855.507173:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb429e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507183:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb429e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507201:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb429e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507209:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb429e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507228:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783951855.507232:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb42a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507237:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951855.507240:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb42a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507246:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb42a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507269:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb42a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507276:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb42a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507288:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783951855.507292:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb4258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507298:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951855.507301:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb4258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507308:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb4258 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507317:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb4258 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507323:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb4258 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507337:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783951855.507341:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb42ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507365:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951855.507368:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb42ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507376:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb42ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507386:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb42ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507393:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb42ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507406:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951855.507410:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb42b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507416:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951855.507419:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb42b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507426:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb42b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.507436:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb42b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951855.507713:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951855.507734:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465376768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951855.507794:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.507841:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465376768 00000100:00100000:1.0:1783951855.507847:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465376768 00000100:00100000:1.0:1783951855.507880:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:1.0:1783951855.507887:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465376768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951855.507908:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951855.507948:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465376768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951855.507955:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00010000:00010000:0.0:1783951855.508140:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb42c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508150:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb42c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508158:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb42c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508169:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783951855.508252:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.508258:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb42cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508276:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.508280:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.508285:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb42cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508294:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb42cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508302:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb42cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508309:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb42cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508317:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1783951855.508365:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.508370:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb42d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508377:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.508380:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.508384:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb42d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508393:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb42d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508413:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb42d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508420:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb42d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.508428:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1783951855.509180:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465376768:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1783951855.509242:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1783951855.509255:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783951855.509267:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb42ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509276:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.509280:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb42ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509288:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb42ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509301:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb42ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509308:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb42ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509327:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783951855.509331:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb42c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509337:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.509340:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb42c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509355:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb42c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509377:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb42c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509383:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb42c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509395:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783951855.509398:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb42c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509404:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.509406:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb42c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509413:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb42c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509422:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb42c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509429:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb42c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.509440:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951855.509443:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb42cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.509542:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb42b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.509560:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951855.509564:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb42d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.509570:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951855.509573:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb42d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.509581:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb42d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.509606:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb42d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.509613:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb42d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951855.509626:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951855.509628:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951855.509630:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951855.510180:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.510188:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb42dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510199:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.510203:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.510208:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb42dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510219:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb42dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510227:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb42dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510234:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb42dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510270:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951855.510325:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.510331:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb42e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510338:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.510341:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.510345:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb42e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510367:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb42e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510375:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb42e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510382:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb42e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510390:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951855.510426:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.510431:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb42eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.510438:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:1.0:1783951855.511139:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.511143:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb42cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511153:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb42cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511167:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb42cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511173:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb42cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511193:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951855.511197:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb42dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511203:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.511206:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb42dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511213:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb42dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511223:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb42dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511238:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb42dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511251:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951855.511254:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb42e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511260:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.511263:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb42e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511271:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb42e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511280:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb42e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511286:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb42e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.511297:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.511299:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.511301:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.511312:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.511332:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951855.511403:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951855.511537:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.511544:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb42eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511555:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb42eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511564:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb42eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511572:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb42eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511609:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951855.511668:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.511674:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb42f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511681:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.511684:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.511688:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb42f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511696:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb42f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511703:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb42f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511716:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb42f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511727:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783951855.511787:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.511792:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb42f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511801:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.511804:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.511808:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb42f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511817:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb42f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511824:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb42f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511831:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb42f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511842:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783951855.511878:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.511883:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb4300 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511896:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.511899:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.511903:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb4300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511912:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb4300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511920:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb4300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511927:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb4300 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.511945:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1783951855.512148:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783951855.512154:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb42eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512173:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.512177:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb42eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512184:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb42eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512196:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb42eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512204:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb42eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512219:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783951855.512222:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb42f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512229:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.512232:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb42f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512239:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb42f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512249:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb42f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512262:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb42f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512276:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951855.512279:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb42f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512286:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.512289:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb42f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512298:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb42f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512308:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb42f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512314:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb42f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512323:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951855.512326:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb4300 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512332:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951855.512340:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb4300 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512360:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb4300 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512372:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb4300 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512379:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb4300 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951855.512394:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.512395:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951855.512397:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.512558:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.512564:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.512567:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951855.515266:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.515279:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb4307 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515296:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.515301:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.515307:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb4307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515320:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb4307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515341:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb4307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515360:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb4307 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515387:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951855.515555:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.515561:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ebb55c1/0x22c73c7857bb430e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515569:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.515572:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.515575:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ebb55c1/0x22c73c7857bb430e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515584:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ebb55c1/0x22c73c7857bb430e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515614:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ebb55c1/0x22c73c7857bb430e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515621:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ebb55c1/0x22c73c7857bb430e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515645:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783951855.515657:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951855.515663:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb4307 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515670:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951855.515675:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb4307 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515684:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb4307 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515699:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb4307 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515706:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb4307 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515723:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951855.515726:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ebb55c1/0x22c73c7857bb430e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515733:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951855.515736:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ebb55c1/0x22c73c7857bb430e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515754:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ebb55c1/0x22c73c7857bb430e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515763:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ebb55c1/0x22c73c7857bb430e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515769:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ebb55c1/0x22c73c7857bb430e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515783:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951855.515784:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951855.515786:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951855.515834:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.515839:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000885e1df7/0x22c73c7857bb4315 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515846:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.515850:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.515854:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000885e1df7/0x22c73c7857bb4315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515862:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000885e1df7/0x22c73c7857bb4315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515869:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000885e1df7/0x22c73c7857bb4315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515883:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000885e1df7/0x22c73c7857bb4315 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515897:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951855.515905:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951855.515909:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000885e1df7/0x22c73c7857bb4315 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515915:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbda00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951855.515919:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000885e1df7/0x22c73c7857bb4315 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515925:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000885e1df7/0x22c73c7857bb4315 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515935:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000885e1df7/0x22c73c7857bb4315 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515941:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000885e1df7/0x22c73c7857bb4315 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.515954:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951855.515956:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951855.515957:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.516565:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951855.517265:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:85197:x1870605465376896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11065us (11885us total) trans 4294968950 rc 0/0 00000100:00100000:3.0:1783951855.517277:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4893 00002000:00010000:0.0:1783951855.517428:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.517441:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb431c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951855.517645:0:85197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85197:1870605465376896:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783951855.517661:0:85197:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6e1:0x0]-[0x280000401:0x701:0x0] 00010000:00010000:0.0:1783951855.517798:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.517802:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.517808:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb431c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.517824:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb431c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.517832:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb431c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.517839:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb431c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.517862:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783951855.517909:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.517915:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb4323 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.517922:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.517924:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.517928:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb4323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.517936:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb4323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.517950:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb4323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.517957:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb4323 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.518548:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951855.522653:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951855.522668:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb431c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.522684:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.522690:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb431c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.522702:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb431c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.522724:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb431c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.522733:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb431c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.522754:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951855.522758:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb4323 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.522782:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.522785:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb4323 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.522793:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb4323 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.522804:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb4323 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.522812:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb4323 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.522825:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.522828:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.522830:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951855.522944:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951855.523161:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951855.523167:0:11961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034b3e46b/0x22c73c7857bb432a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.523179:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=3570s v=(0 0) 00010000:00010000:0.0:1783951855.523184:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951855.523191:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034b3e46b/0x22c73c7857bb432a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.523204:0:11961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034b3e46b/0x22c73c7857bb432a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.523213:0:11961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034b3e46b/0x22c73c7857bb432a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.523221:0:11961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034b3e46b/0x22c73c7857bb432a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951855.523257:0:11961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951855.526703:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951855.526717:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034b3e46b/0x22c73c7857bb432a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.526730:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951855.526735:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034b3e46b/0x22c73c7857bb432a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.526746:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034b3e46b/0x22c73c7857bb432a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.526775:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034b3e46b/0x22c73c7857bb432a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.526783:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034b3e46b/0x22c73c7857bb432a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951855.526809:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.526811:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951855.526813:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783951855.528222:0:11961:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1148 00000100:00100000:0.0:1783951855.528391:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:85199:x1870605465376640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 57239us (57726us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951855.528403:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4892 00000100:00100000:1.0:1783951855.531199:0:85199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85199:1870605465376640:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783951855.531218:0:85199:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6e1:0x0] from OST, last_created [0x2c0000401:0x6e1:0x0]last_used is [0x2c0000401:0x47c:0x0] 00000100:00100000:1.0:1783951855.531289:0:85199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85199:1870605465377152:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783951855.531338:0:85199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.531374:0:85199:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434aa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951855.531455:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465377024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951855.531484:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951855.531631:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465377024 00000100:00100000:1.0:1783951855.531637:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465377024 00000100:00100000:1.0:1783951855.531688:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1783951855.531696:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465377024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951855.531725:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951855.531761:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465377024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951855.531768:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:0.0:1783951855.531836:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465377024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951855.531961:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465377152 00000100:00100000:2.0:1783951855.532505:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465377152 00000100:00100000:2.0:1783951855.532538:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4894 00000100:00100000:2.0:1783951855.532544:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:85199:x1870605465377152:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783951855.532576:0:26205:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1762 00000100:00100000:2.0:1783951855.534008:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:85199:x1870605465377152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1460us (2665us total) trans 4294968950 rc 0/0 00000100:00100000:2.0:1783951855.534022:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4894 00000100:00100000:2.0:1783951855.534089:0:85199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85199:1870605465377152:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783951855.534102:0:85199:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6e1:0x0]-[0x2c0000401:0x701:0x0] 00000001:02000400:3.0:1783951855.919046:0:85465:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783951856.161971:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951856.225560:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951856.225764:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465377280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951856.225865:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951856.225916:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465377280 00000100:00100000:1.0:1783951856.225925:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465377280 00000100:00100000:1.0:1783951856.225975:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:1.0:1783951856.225984:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465377280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951856.226009:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951856.226069:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465377280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951856.226077:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00100000:1.0:1783951856.226126:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465377280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951856.234100:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465377408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951856.235289:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951856.235389:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465377408 00000100:00100000:3.0:1783951856.235398:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465377408 00000100:00100000:3.0:1783951856.235452:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:3.0:1783951856.235462:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465377408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951856.235490:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951856.235542:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465377408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951856.235549:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:3.0:1783951856.237278:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465377408:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1783951856.240276:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783951857.149108:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951857.149164:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951857.149194:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951857.149227:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447685632 00000100:00100000:2.0:1783951857.149236:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447685632 00000100:00100000:2.0:1783951857.149287:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 73 00000100:00100000:2.0:1783951857.149297:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447685632:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951857.149378:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447685632:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951857.149386:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 73 00000100:00100000:2.0:1783951857.149421:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447685760 00000100:00100000:2.0:1783951857.149425:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447685760 00000100:00100000:1.0:1783951857.149529:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447685888 00000100:00100000:1.0:1783951857.149534:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447685888 00000100:00100000:1.0:1783951857.149574:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1027 00000100:00100000:1.0:1783951857.149582:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447685888:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951857.149647:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447685888:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 65us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951857.149654:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1027 00000100:00080000:3.0:1783951857.151147:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951857.153018:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1028 00000100:00100000:2.0:1783951857.153037:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447685760:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951857.153123:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447685760:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 93us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951857.153147:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1028 00000100:00080000:3.0:1783951857.154457:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783951857.188105:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783951857.243105:0:85517:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783951857.243367:0:85517:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951858.209123:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783951858.354061:0:85568:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783951858.354288:0:85568:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783951859.237206:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951860.257564:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951860.320807:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465377536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951860.320893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951860.320939:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951860.320945:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465377664:0@lo:400:kworker.0 00000100:00100000:2.0:1783951860.320976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951860.321006:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465378048:0@lo:400:kworker.0 00000100:00100000:2.0:1783951860.321032:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951860.321048:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465378560:0@lo:400:kworker.0 00000100:00100000:2.0:1783951860.321071:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951860.321087:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783951860.321093:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465378176:0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.321104:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465378048 00000100:00100000:0.0:1783951860.321112:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465378048 00000100:00100000:2.0:1783951860.321114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951860.321128:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465378688:0@lo:400:kworker.0 00000100:00100000:2.0:1783951860.321145:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951860.321166:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465378176 00000100:00100000:0.0:1783951860.321169:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465378176 00000100:00100000:2.0:1783951860.321170:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465377664 00000100:00100000:2.0:1783951860.321173:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465377664 00000100:00100000:0.0:1783951860.321187:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465378688 00000100:00100000:0.0:1783951860.321190:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465378688 00000100:00100000:2.0:1783951860.321200:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783951860.321207:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465377664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.321207:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1783951860.321212:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465378048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951860.321253:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465377664:12345-0@lo:400:kworker.0 Request processed in 45us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951860.321260:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783951860.321286:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465377536 00000100:00100000:3.0:1783951860.321300:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465377536 00000100:00100000:3.0:1783951860.321387:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:3.0:1783951860.321395:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465377536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951860.321422:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783951860.324704:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465378048:12345-0@lo:400:kworker.0 Request processed in 3480us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951860.324722:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1783951860.324763:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:0.0:1783951860.324778:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465378176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951860.324782:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465378048:0@lo:400:kworker.0 00000100:00100000:2.0:1783951860.324826:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465377664:0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.324848:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465378176:12345-0@lo:400:kworker.0 Request processed in 73us (3727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951860.324854:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:0.0:1783951860.324879:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1783951860.324885:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465378688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.325113:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465378688:12345-0@lo:400:kworker.0 Request processed in 228us (3966us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951860.325121:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1783951860.325218:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465378560 00000100:00100000:0.0:1783951860.325227:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465378560 00000100:00100000:0.0:1783951860.325288:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:0.0:1783951860.325523:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465378560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.325662:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465378560:12345-0@lo:400:kworker.0 Request processed in 141us (4588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951860.325670:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:0.0:1783951860.325701:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951860.325718:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465379072:0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.325760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951860.325790:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465379072 00000100:00100000:0.0:1783951860.325794:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465379072 00000100:00100000:0.0:1783951860.325816:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1783951860.325822:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465379072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.325854:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465379072:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951860.325861:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1783951860.325892:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465379072:0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.325965:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465377920:0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.326075:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951860.326098:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465378432:0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.326134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951860.326449:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465378944:0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.326474:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951860.326496:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783951860.326503:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465377792:0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.326525:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951860.326550:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465378304:0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.326572:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951860.326613:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465378816:0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.326636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951860.326677:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465377920 00000100:00100000:0.0:1783951860.326682:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465377920 00000100:00100000:0.0:1783951860.326711:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465377792 00000100:00100000:0.0:1783951860.326714:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465377792 00000100:00100000:0.0:1783951860.326735:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1783951860.326741:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465377920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.326781:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465377920:12345-0@lo:400:kworker.0 Request processed in 40us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951860.326787:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1783951860.326799:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1783951860.326805:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465377792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.326833:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465377792:12345-0@lo:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951860.326838:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1783951860.326856:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465378432 00000100:00100000:0.0:1783951860.326859:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465378432 00000100:00100000:0.0:1783951860.326895:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465378944 00000100:00100000:0.0:1783951860.326898:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465378944 00000100:00100000:0.0:1783951860.326916:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465378816 00000100:00100000:0.0:1783951860.326919:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465378816 00000100:00100000:0.0:1783951860.326936:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:0.0:1783951860.326941:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465378432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951860.326973:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465378432:12345-0@lo:400:kworker.0 Request processed in 32us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951860.326979:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:0.0:1783951860.326988:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:0.0:1783951860.326994:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465378944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951860.327507:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1783951860.327517:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465378816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951860.327557:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465378816:12345-0@lo:400:kworker.0 Request processed in 44us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951860.327574:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1783951860.327651:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465378304 00000100:00100000:1.0:1783951860.327656:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465378304 00000100:00100000:1.0:1783951860.327681:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:1.0:1783951860.327687:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465378304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951860.327720:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465378304:12345-0@lo:400:kworker.0 Request processed in 32us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951860.327726:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:1.0:1783951860.327773:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465377792:0@lo:400:kworker.0 00000100:00100000:1.0:1783951860.327784:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465378304:0@lo:400:kworker.0 00000100:00100000:1.0:1783951860.327793:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465378816:0@lo:400:kworker.0 00000100:00100000:1.0:1783951860.327803:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465377920:0@lo:400:kworker.0 00000100:00100000:1.0:1783951860.327811:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465378432:0@lo:400:kworker.0 00000100:00080000:1.0:1783951860.327864:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951860.327869:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951860.327872:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951860.327874:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951860.328343:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465378944:12345-0@lo:400:kworker.0 Request processed in 1008us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951860.328463:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1783951860.329030:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465378944:0@lo:400:kworker.0 00000100:00100000:3.0:1783951860.331250:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465377536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9846us (10347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951860.331265:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1783951860.333079:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465377536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951860.333125:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465378176:0@lo:400:kworker.0 00000100:00100000:2.0:1783951860.333139:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465378688:0@lo:400:kworker.0 00000100:00100000:2.0:1783951860.333150:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465378560:0@lo:400:kworker.0 00000100:00100000:2.0:1783951860.834102:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951860.834125:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465379200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951860.834286:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951860.834505:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465379200 00000100:00100000:1.0:1783951860.834513:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465379200 00000100:00100000:1.0:1783951860.834800:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:1.0:1783951860.834810:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465379200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951860.834846:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:1.0:1783951860.834894:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465379200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951860.834914:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:1.0:1783951860.834941:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465379328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951860.834971:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951860.834994:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951860.834999:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465379456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951860.835028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951860.835052:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465379328 00000100:00100000:1.0:1783951860.835056:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465379328 00000100:00100000:1.0:1783951860.835078:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465379456 00000100:00100000:1.0:1783951860.835081:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465379456 00000100:00100000:1.0:1783951860.835093:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:1.0:1783951860.835098:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465379328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951860.835120:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951860.835349:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465379328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951860.835805:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465379328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 704us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951860.835813:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:1.0:1783951860.835830:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:1.0:1783951860.835838:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465379456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951860.835856:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951860.835890:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465379456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951860.835896:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00100000:0.0:1783951860.836879:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465379456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951860.836971:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465379200:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1783951860.838498:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968950 is committed 00000001:00080000:0.0:1783951860.840362:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968950 is committed 00000100:00100000:3.0:1783951861.102033:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951861.102204:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447686016 00000100:00100000:0.0:1783951861.102215:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447686016 00000100:00100000:0.0:1783951861.102306:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1067 00000100:00100000:0.0:1783951861.102317:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:65253:x1870605447686016:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1783951861.102336:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951861.102361:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a147 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951861.102425:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4338 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951861.102452:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951861.102465:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783951861.102519:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783951861.102523:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783951861.102543:0:66238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951861.102566:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a147 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951861.102627:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4338 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a147 expref: 7 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951861.102638:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0c00) 00010000:00010000:0.0:1783951861.102640:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783951861.102644:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc200, rc 0) 00000100:00100000:0.0:1783951861.102700:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:65253:x1870605447686016:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 384us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951861.102707:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1067 00000100:00080000:1.0:1783951861.102833:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951861.111441:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951861.111534:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447686144 00000100:00100000:0.0:1783951861.111544:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447686144 00000100:00100000:0.0:1783951861.111663:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1068 00000100:00100000:0.0:1783951861.111674:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+7:65253:x1870605447686144:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:0.0:1783951861.111714:0:68591:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:0.0:1783951861.111801:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+7:65253:x1870605447686144:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 128us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951861.111809:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1068 00000100:00100000:3.0:1783951861.116679:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951861.117091:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447686272 00000100:00100000:1.0:1783951861.117101:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447686272 00000100:00100000:1.0:1783951861.117189:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1069 00000100:00100000:1.0:1783951861.117199:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:65253:x1870605447686272:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:1.0:1783951861.117237:0:67035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:1.0:1783951861.117324:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:65253:x1870605447686272:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 127us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951861.117333:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1069 00000100:00080000:3.0:1783951861.117688:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951861.146748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951861.147846:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447686400 00000100:00100000:2.0:1783951861.147861:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447686400 00000100:00100000:2.0:1783951861.147912:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4895 00000100:00100000:2.0:1783951861.147919:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2397:x1870605447686400:12345-192.168.202.48@tcp:8:lfs.0 00010000:00080000:2.0:1783951861.147953:0:26208:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp t0 exp 0000000000000000 cur 3576 last 0 00000020:00000080:2.0:1783951861.147980:0:26208:0:(genops.c:1406:class_connect()) connect: client 458183b2-4c6d-478c-9fed-a955779e6611, cookie 0x22c73c7857bb433f 00002000:00100000:2.0:1783951861.147990:0:26208:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 458183b2-4c6d-478c-9fed-a955779e6611/ffff97b046619000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783951861.148010:0:26208:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783951861.148087:0:26208:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783951861.148118:0:26208:0:(import.c:65:import_set_state_nolock()) ffff97b046619800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951861.148185:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447686400:12345-192.168.202.48@tcp:8:lfs.0 Request processed in 265us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951861.148193:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4895 00000100:00100000:2.0:1783951861.156665:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951861.156942:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447686528 00000100:00100000:1.0:1783951861.156952:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447686528 00000100:00100000:1.0:1783951861.157044:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2001 00000100:00100000:1.0:1783951861.157056:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:65253:x1870605447686528:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:1.0:1783951861.157083:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951861.157151:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:65253:x1870605447686528:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 97us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951861.157159:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2001 00000100:00080000:3.0:1783951861.157312:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951861.164614:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951861.166280:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447686656 00000100:00100000:0.0:1783951861.166310:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447686656 00000100:00100000:0.0:1783951861.166378:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4896 00000100:00100000:0.0:1783951861.166387:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1870605447686656:12345-192.168.202.48@tcp:8:lfs.0 00010000:00080000:0.0:1783951861.166427:0:8436:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp t0 exp 0000000000000000 cur 3576 last 0 00000020:00000080:0.0:1783951861.166462:0:8436:0:(genops.c:1406:class_connect()) connect: client 458183b2-4c6d-478c-9fed-a955779e6611, cookie 0x22c73c7857bb4346 00002000:00100000:0.0:1783951861.166476:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 458183b2-4c6d-478c-9fed-a955779e6611/ffff97b04b213000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783951861.166487:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783951861.166570:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783951861.166633:0:8436:0:(import.c:65:import_set_state_nolock()) ffff97b04b214800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951861.166710:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447686656:12345-192.168.202.48@tcp:8:lfs.0 Request processed in 322us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951861.166718:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4896 00000100:00100000:0.0:1783951861.184766:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951861.184868:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447686784 00000100:00100000:3.0:1783951861.184878:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447686784 00000100:00100000:3.0:1783951861.184957:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2002 00000100:00100000:3.0:1783951861.184968:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:65253:x1870605447686784:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783951861.185021:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951861.185093:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:65253:x1870605447686784:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 127us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951861.185101:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2002 00000100:00080000:1.0:1783951861.186338:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783951861.280829:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951861.345095:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951861.345119:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465379584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951861.345186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951861.345232:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465379584 00000100:00100000:3.0:1783951861.345239:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465379584 00000100:00100000:3.0:1783951861.345282:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:3.0:1783951861.345290:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465379584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951861.345331:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951861.345375:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465379584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951861.345382:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:3.0:1783951861.345426:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465379584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951861.345851:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951861.345863:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465379712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951861.345897:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951861.345979:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465379712 00000100:00100000:1.0:1783951861.345985:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465379712 00000100:00100000:1.0:1783951861.346027:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1783951861.346035:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465379712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951861.346048:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951861.346095:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465379712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951861.346102:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:0.0:1783951861.346150:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465379712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951862.256444:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951862.256491:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951862.256524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951862.256544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951862.256568:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951862.256623:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447687296 00000100:00100000:3.0:1783951862.256631:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447687296 00000100:00100000:3.0:1783951862.256679:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447687424 00000100:00100000:3.0:1783951862.256682:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447687424 00000100:00100000:3.0:1783951862.256705:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2574 00000100:00100000:3.0:1783951862.256714:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447687296:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951862.256792:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447687296:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 79us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951862.256800:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2574 00000100:00100000:3.0:1783951862.256816:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2575 00000100:00100000:3.0:1783951862.256822:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447687424:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951862.256845:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447687424:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951862.256852:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2575 00000100:00100000:3.0:1783951862.256869:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447686912 00000100:00100000:3.0:1783951862.256873:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447686912 00000100:00100000:3.0:1783951862.256899:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:3.0:1783951862.256905:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447686912:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951862.256929:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447686912:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951862.256936:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:1.0:1783951862.257202:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447687040 00000100:00100000:1.0:1783951862.257207:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447687040 00000100:00100000:1.0:1783951862.257240:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447687168 00000100:00100000:1.0:1783951862.257242:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447687168 00000100:00100000:1.0:1783951862.257272:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1035 00000100:00100000:1.0:1783951862.257279:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447687040:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951862.257324:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447687040:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 45us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951862.257329:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1035 00000100:00100000:1.0:1783951862.257341:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1036 00000100:00100000:1.0:1783951862.257347:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447687168:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951862.257368:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447687168:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 22us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951862.257373:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1036 00010000:00010000:3.0:1783951862.307524:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951863.330717:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951864.357142:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951865.379293:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951865.443490:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465379840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951865.443559:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951865.444091:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465379840 00000100:00100000:1.0:1783951865.444098:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465379840 00000100:00100000:1.0:1783951865.444136:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:1.0:1783951865.444145:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465379840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951865.444180:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:1.0:1783951865.444229:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465379840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951865.444236:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:1.0:1783951865.444275:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465380096:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951865.444329:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465380608:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444349:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951865.444364:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465381120:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444385:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951865.444417:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783951865.444423:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465380224:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444445:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951865.444463:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465380736:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444483:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951865.444499:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465381248:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444519:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951865.444548:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465380096 00000100:00100000:1.0:1783951865.444553:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465380096 00000100:00100000:1.0:1783951865.444613:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465380224 00000100:00100000:1.0:1783951865.444617:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465380224 00000100:00100000:1.0:1783951865.444638:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1783951865.444645:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465380096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444683:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465380096:12345-0@lo:400:kworker.0 Request processed in 40us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951865.444690:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1783951865.444702:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1783951865.444708:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465380224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444732:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465380224:12345-0@lo:400:kworker.0 Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951865.444737:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1783951865.444754:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465380608 00000100:00100000:1.0:1783951865.444757:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465380608 00000100:00100000:1.0:1783951865.444777:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:1.0:1783951865.444782:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465380608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444810:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465380608:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951865.444825:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:1.0:1783951865.444846:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465381120 00000100:00100000:1.0:1783951865.444849:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465381120 00000100:00100000:1.0:1783951865.444874:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465380736 00000100:00100000:1.0:1783951865.444877:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465380736 00000100:00100000:1.0:1783951865.444892:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465381248 00000100:00100000:1.0:1783951865.444895:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465381248 00000100:00100000:1.0:1783951865.444913:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:1.0:1783951865.444918:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465381120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444949:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465381120:12345-0@lo:400:kworker.0 Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951865.444955:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:1.0:1783951865.444967:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:1.0:1783951865.444972:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465380736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.444996:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465380736:12345-0@lo:400:kworker.0 Request processed in 25us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951865.445002:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:1.0:1783951865.445012:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1783951865.445018:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465381248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.445042:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465381248:12345-0@lo:400:kworker.0 Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951865.445047:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00080000:1.0:1783951865.445065:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951865.445070:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951865.445072:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951865.445074:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951865.445107:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465380224:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.445127:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465380736:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.445135:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968950 gen 2 00000100:00100000:1.0:1783951865.445149:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465381248:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.445159:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465380096:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.445167:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465380608:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.445175:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968950 gen 2 00000100:00100000:1.0:1783951865.445184:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465381120:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446018:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465379968:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446068:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951865.446101:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465380480:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951865.446146:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465380992:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951865.446205:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783951865.446211:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465380352:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446232:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951865.446249:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465380864:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446282:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951865.446300:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465381376:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446325:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951865.446373:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465379840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951865.446528:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465380480 00000100:00100000:3.0:1783951865.446534:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465380480 00000100:00100000:3.0:1783951865.446575:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465380992 00000100:00100000:3.0:1783951865.446578:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465380992 00000100:00100000:3.0:1783951865.446611:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465380352 00000100:00100000:3.0:1783951865.446615:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465380352 00000100:00100000:3.0:1783951865.446628:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465381376 00000100:00100000:3.0:1783951865.446630:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465381376 00000100:00100000:3.0:1783951865.446643:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1783951865.446650:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465380480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446698:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465380480:12345-0@lo:400:kworker.0 Request processed in 48us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951865.446706:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1783951865.446722:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1783951865.446728:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465380992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446756:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465380992:12345-0@lo:400:kworker.0 Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951865.446772:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1783951865.446784:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1783951865.446790:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465380352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446817:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465380352:12345-0@lo:400:kworker.0 Request processed in 28us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951865.446822:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1783951865.446832:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1783951865.446838:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465381376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446862:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465381376:12345-0@lo:400:kworker.0 Request processed in 25us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951865.446867:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1783951865.446894:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465380864 00000100:00100000:3.0:1783951865.446898:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465380864 00000100:00100000:3.0:1783951865.446924:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1783951865.446929:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465380864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.446955:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465380864:12345-0@lo:400:kworker.0 Request processed in 26us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951865.446960:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00080000:3.0:1783951865.447044:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951865.447049:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951865.447051:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951865.447079:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465380352:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.447088:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465380864:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.447095:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465381376:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.447113:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465380480:0@lo:400:kworker.0 00000100:00100000:3.0:1783951865.447121:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465380992:0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.447431:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465379968 00000100:00100000:1.0:1783951865.447437:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465379968 00000100:00100000:1.0:1783951865.447469:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783951865.447476:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465379968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951865.447529:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465379968:12345-0@lo:400:kworker.0 Request processed in 54us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951865.447534:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783951865.447828:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465379968:0@lo:400:kworker.0 00000100:00100000:0.0:1783951865.954037:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465381504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951865.954104:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951865.954157:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465381504 00000100:00100000:0.0:1783951865.954165:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465381504 00000100:00100000:0.0:1783951865.954226:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:0.0:1783951865.954234:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465381504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951865.954284:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:0.0:1783951865.954330:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465381504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951865.954338:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00100000:0.0:1783951865.954398:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465381504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951865.955845:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465381760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951865.955902:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951865.955934:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951865.955940:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465381632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951865.955959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951865.955994:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465381760 00000100:00100000:2.0:1783951865.956001:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465381760 00000100:00100000:2.0:1783951865.956038:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465381632 00000100:00100000:2.0:1783951865.956041:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465381632 00000100:00100000:2.0:1783951865.956056:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:2.0:1783951865.956062:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465381760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951865.956088:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951865.956127:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465381760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951865.956133:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:2.0:1783951865.956148:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1783951865.956154:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465381632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951865.956169:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951865.956195:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465381632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951865.956201:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1783951865.956237:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465381632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951865.956278:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465381760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783951866.400795:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951866.465520:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951866.465546:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465381888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951866.465647:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951866.465707:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465381888 00000100:00100000:3.0:1783951866.465716:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465381888 00000100:00100000:3.0:1783951866.465779:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:3.0:1783951866.465789:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465381888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951866.465813:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951866.465863:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465381888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951866.465870:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:2.0:1783951866.465913:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951866.465923:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465382016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951866.465968:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951866.465985:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465382016 00000100:00100000:0.0:1783951866.465990:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465382016 00000100:00100000:0.0:1783951866.466022:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1783951866.466028:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465382016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951866.466040:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951866.466080:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465382016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951866.466086:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1783951866.466125:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465381888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951866.466822:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465382016:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1783951866.978495:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00100000:0.0:1783951866.979762:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000100:00100000:0.0:1783951867.390420:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951867.390464:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951867.390493:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951867.390513:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951867.390536:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951867.390799:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447687808 00000100:00100000:3.0:1783951867.390809:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447687808 00000100:00100000:3.0:1783951867.390877:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447687680 00000100:00100000:3.0:1783951867.390880:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447687680 00000100:00100000:3.0:1783951867.390906:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1043 00000100:00100000:3.0:1783951867.390916:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447687808:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951867.390987:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447687808:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 73us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951867.390994:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1043 00000100:00100000:3.0:1783951867.391009:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1044 00000100:00100000:3.0:1783951867.391016:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447687680:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951867.391038:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447687680:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951867.391043:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1044 00000100:00080000:2.0:1783951867.391211:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951867.391216:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951867.391712:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447687552 00000100:00100000:1.0:1783951867.391718:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447687552 00000100:00100000:1.0:1783951867.391759:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:1.0:1783951867.391767:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447687552:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951867.391809:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447687552:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 43us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951867.391818:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:1.0:1783951867.391851:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447688064 00000100:00100000:1.0:1783951867.391861:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447688064 00000100:00100000:1.0:1783951867.391896:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447687936 00000100:00100000:1.0:1783951867.391899:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447687936 00000100:00100000:1.0:1783951867.391921:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2580 00000100:00100000:1.0:1783951867.391928:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447688064:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951867.391967:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447688064:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 39us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951867.391974:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2580 00000100:00100000:1.0:1783951867.391985:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2581 00000100:00100000:1.0:1783951867.391991:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447687936:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951867.392013:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447687936:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 22us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951867.392020:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2581 00000100:00080000:3.0:1783951867.392082:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951867.392086:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783951867.424795:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951868.462168:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783951868.543650:0:85761:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:0.0:1783951869.472800:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951870.501397:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783951870.524844:0:85809:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1783951870.562581:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465382528:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.562682:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.562718:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465383040:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.562745:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.562764:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465383552:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.562786:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.562812:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783951870.562817:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465382400:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.562838:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.562857:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465382912:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.562877:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.562894:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465383424:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.562934:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.562979:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465382528 00000100:00100000:0.0:1783951870.562987:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465382528 00000100:00100000:0.0:1783951870.563042:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465382400 00000100:00100000:0.0:1783951870.563046:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465382400 00000100:00100000:0.0:1783951870.563074:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1783951870.563084:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465382528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.563141:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465382528:12345-0@lo:400:kworker.0 Request processed in 59us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951870.563163:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1783951870.563181:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1783951870.563192:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465382400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.563232:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465382400:12345-0@lo:400:kworker.0 Request processed in 40us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951870.563238:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1783951870.563258:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465383040 00000100:00100000:0.0:1783951870.563261:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465383040 00000100:00100000:0.0:1783951870.563280:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465383552 00000100:00100000:0.0:1783951870.563282:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465383552 00000100:00100000:0.0:1783951870.563301:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465382912 00000100:00100000:0.0:1783951870.563304:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465382912 00000100:00100000:2.0:1783951870.563533:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465382144:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.563574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.563625:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465383424 00000100:00100000:0.0:1783951870.563630:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465383424 00000100:00100000:2.0:1783951870.563631:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465382656:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.563661:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:2.0:1783951870.563664:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.563673:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465383040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.563687:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465383168:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.563725:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465383040:12345-0@lo:400:kworker.0 Request processed in 53us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951870.563726:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.563736:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:2.0:1783951870.563753:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465383680:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.563754:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1783951870.563764:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465383552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.563792:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.563803:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465383552:12345-0@lo:400:kworker.0 Request processed in 39us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951870.563810:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:2.0:1783951870.563817:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783951870.563826:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1783951870.563828:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465382272:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.563836:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465382912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.563856:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951870.563874:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465382784:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.563880:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465382912:12345-0@lo:400:kworker.0 Request processed in 45us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951870.563887:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1783951870.563904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951870.563911:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:0.0:1783951870.563919:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465383424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.563928:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465383296:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.563957:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951870.563991:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465382144 00000100:00100000:2.0:1783951870.563995:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465382144 00000100:00100000:2.0:1783951870.564033:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783951870.564039:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465382144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564073:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465382144:12345-0@lo:400:kworker.0 Request processed in 34us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951870.564079:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783951870.564109:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465382656 00000100:00100000:2.0:1783951870.564113:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465382656 00000100:00100000:2.0:1783951870.564131:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465383168 00000100:00100000:2.0:1783951870.564133:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465383168 00000100:00100000:2.0:1783951870.564144:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465383680 00000100:00100000:2.0:1783951870.564146:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465383680 00000100:00100000:2.0:1783951870.564156:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465382272 00000100:00100000:2.0:1783951870.564157:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465382272 00000100:00100000:2.0:1783951870.564170:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1783951870.564176:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465382656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564206:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465382656:12345-0@lo:400:kworker.0 Request processed in 30us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951870.564229:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1783951870.564242:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1783951870.564247:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465383168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564276:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465383168:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951870.564282:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1783951870.564294:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1783951870.564300:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465383680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564327:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465383680:12345-0@lo:400:kworker.0 Request processed in 27us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951870.564342:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1783951870.564355:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1783951870.564361:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465382272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564390:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465382272:12345-0@lo:400:kworker.0 Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951870.564396:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1783951870.564401:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465383424:12345-0@lo:400:kworker.0 Request processed in 480us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951870.564410:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1783951870.564424:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465382784 00000100:00100000:2.0:1783951870.564429:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465382784 00000100:00080000:0.0:1783951870.564451:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951870.564456:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951870.564460:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465383296 00000100:00080000:0.0:1783951870.564461:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951870.564465:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465383296 00000100:00080000:0.0:1783951870.564465:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951870.564491:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:2.0:1783951870.564499:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465382784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.564520:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465382400:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564536:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465382784:12345-0@lo:400:kworker.0 Request processed in 37us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951870.564539:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465382912:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564548:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00100000:0.0:1783951870.564555:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465383424:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564567:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:0.0:1783951870.564572:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465382528:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564577:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465383296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.564611:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465383040:0@lo:400:kworker.0 00000100:00100000:0.0:1783951870.564627:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465383552:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564634:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465383296:12345-0@lo:400:kworker.0 Request processed in 59us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951870.564641:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:2.0:1783951870.564692:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465382272:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564702:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465382784:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564710:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465383296:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564717:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465382144:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564737:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465382656:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564747:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465383168:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.564755:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465383680:0@lo:400:kworker.0 00000100:00100000:2.0:1783951870.565268:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951870.565278:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465383808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951870.565307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951870.565330:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465383808 00000100:00100000:2.0:1783951870.565334:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465383808 00000100:00100000:2.0:1783951870.565359:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:2.0:1783951870.565365:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465383808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951870.565390:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951870.565435:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465383808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951870.565441:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00100000:1.0:1783951870.566534:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465383808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951871.072857:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951871.072892:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465383936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951871.072976:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951871.073255:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465383936 00000100:00100000:0.0:1783951871.073263:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465383936 00000100:00100000:0.0:1783951871.073324:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:0.0:1783951871.073334:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465383936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951871.073370:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:0.0:1783951871.073439:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465383936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951871.073446:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:1.0:1783951871.073635:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465383936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951871.080199:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465384064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951871.080307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951871.080490:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465384064 00000100:00100000:3.0:1783951871.080499:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465384064 00000100:00100000:3.0:1783951871.080558:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:3.0:1783951871.080568:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465384064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951871.080628:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951871.080690:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465384064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951871.080697:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1783951871.080786:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465384064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951871.082685:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465384192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951871.082748:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951871.082841:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465384192 00000100:00100000:3.0:1783951871.082849:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465384192 00000100:00100000:3.0:1783951871.082914:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1783951871.082929:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465384192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951871.082956:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951871.084249:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465384192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1316us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951871.084260:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:2.0:1783951871.084387:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465384192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951871.520844:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951871.585437:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465384320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951871.585538:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951871.585539:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465384448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951871.585705:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465384320 00000100:00100000:3.0:1783951871.585714:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465384320 00000100:00100000:3.0:1783951871.585775:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:3.0:1783951871.585785:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465384320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951871.585809:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951871.586090:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951871.586214:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465384448 00000100:00100000:2.0:1783951871.586286:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465384448 00000100:00100000:2.0:1783951871.586335:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:2.0:1783951871.586342:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465384448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951871.586354:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951871.586403:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465384448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951871.586410:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:1.0:1783951871.586498:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465384448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951871.597054:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465384320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 11260us (11506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951871.597071:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00100000:0.0:1783951871.597146:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465384320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951872.502230:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951872.502273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951872.502303:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447688192 00000100:00100000:0.0:1783951872.502307:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951872.502315:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447688192 00000100:00100000:0.0:1783951872.502342:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951872.502376:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:3.0:1783951872.502388:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447688192:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951872.502395:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951872.502470:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447688704 00000100:00100000:3.0:1783951872.502475:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447688192:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951872.502484:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447688704 00000100:00100000:3.0:1783951872.502485:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:1.0:1783951872.502524:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447688576 00000100:00100000:1.0:1783951872.502527:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447688576 00000100:00100000:3.0:1783951872.502550:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2586 00000100:00100000:1.0:1783951872.502557:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2587 00000100:00100000:3.0:1783951872.502563:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447688704:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951872.502570:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447688576:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951872.502638:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447688704:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 80us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951872.502644:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2586 00000100:00100000:2.0:1783951872.502675:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447688448 00000100:00100000:2.0:1783951872.502680:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447688448 00000100:00100000:3.0:1783951872.502696:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447688320 00000100:00100000:3.0:1783951872.502702:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447688320 00000100:00100000:2.0:1783951872.502716:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1051 00000100:00100000:2.0:1783951872.502726:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447688448:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951872.502738:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1052 00000100:00100000:3.0:1783951872.502748:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447688320:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951872.509059:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447688576:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 6477us (6652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951872.509075:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2587 00000100:00080000:1.0:1783951872.509160:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951872.509165:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951872.509169:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951872.509171:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951872.510455:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447688448:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 7724us (8173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951872.510468:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1051 00000100:00100000:3.0:1783951872.524665:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447688320:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 21906us (22309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951872.524681:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1052 00010000:00010000:3.0:1783951872.545111:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951872.774338:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951872.774432:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447688832 00000100:00100000:3.0:1783951872.774443:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447688832 00000100:00100000:3.0:1783951872.774508:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1070 00000100:00100000:3.0:1783951872.774518:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+7:65723:x1870605447688832:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:3.0:1783951872.774556:0:83761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:3.0:1783951872.774671:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+7:65723:x1870605447688832:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 154us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951872.774679:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1070 00000100:00100000:0.0:1783951872.779439:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951872.784532:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447688960 00000100:00100000:1.0:1783951872.784547:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447688960 00000100:00100000:1.0:1783951872.784648:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1071 00000100:00100000:1.0:1783951872.784659:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:65723:x1870605447688960:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:1.0:1783951872.784698:0:68591:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:1.0:1783951872.784779:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:65723:x1870605447688960:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 122us (5350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951872.784787:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1071 00000100:00100000:0.0:1783951872.790501:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951872.794639:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447689088 00000100:00100000:2.0:1783951872.794656:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447689088 00000100:00100000:2.0:1783951872.794738:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2013 00000100:00100000:2.0:1783951872.794749:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:65723:x1870605447689088:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:2.0:1783951872.794778:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951872.794863:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:65723:x1870605447689088:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 115us (4372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951872.794870:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2013 00000100:00100000:3.0:1783951872.797792:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951872.802263:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447689216 00000100:00100000:0.0:1783951872.802278:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447689216 00000100:00100000:0.0:1783951872.803056:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2014 00000100:00100000:0.0:1783951872.803074:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:65723:x1870605447689216:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783951872.803103:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951872.803563:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:65723:x1870605447689216:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 493us (5777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951872.803573:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2014 00000100:00100000:0.0:1783951872.881065:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951872.881252:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447689472 00000100:00100000:2.0:1783951872.881265:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447689472 00000100:00100000:2.0:1783951872.881351:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1072 00000100:00100000:2.0:1783951872.881362:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+7:65739:x1870605447689472:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783951872.881386:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951872.881408:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb434d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a14e expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881506:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881522:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881533:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881551:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb435b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881559:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb435b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881566:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb435b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881673:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881682:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881688:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881695:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881701:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ba00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951872.881711:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881719:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881732:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0c00) 00010000:00010000:2.0:1783951872.881735:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951872.881740:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881746:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4354 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881759:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb435b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881765:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb435b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881770:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb435b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881775:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951872.881778:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb435b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881784:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb435b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881791:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff97b04d803100) 00010000:00010000:2.0:1783951872.881793:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951872.881802:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb435b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881807:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb435b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881838:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb434d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a14e expref: 8 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881848:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0c00) 00010000:00010000:2.0:1783951872.881851:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951872.881855:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb434d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a14e expref: 8 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951872.881864:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b800, rc 0) 00000100:00100000:2.0:1783951872.881928:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+7:65739:x1870605447689472:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 568us (872us total) trans 0 rc 301/301 00000100:00100000:2.0:1783951872.881936:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1072 00000100:00100000:2.0:1783951872.894513:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951872.894633:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447689600 00000100:00100000:3.0:1783951872.894643:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447689600 00000100:00100000:3.0:1783951872.894729:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1073 00000100:00100000:3.0:1783951872.894739:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+7:65739:x1870605447689600:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:3.0:1783951872.894805:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb4362 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.894821:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb4362 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.894833:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb4362 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.894847:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4369 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.894853:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4369 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.894860:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4369 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.894936:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.894944:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.894968:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951872.895011:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951872.895024:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895037:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb4362 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895043:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb4362 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895049:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb4362 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895055:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951872.895059:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb4362 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895067:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb4362 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895079:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0c00) 00010000:00010000:3.0:1783951872.895082:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951872.895086:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb4362 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895091:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb4362 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895102:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4369 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895114:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4369 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895120:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4369 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895125:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951872.895127:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4369 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895134:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4369 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895142:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff97b16e21f800) 00010000:00010000:3.0:1783951872.895144:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951872.895147:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4369 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895152:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4369 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895168:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895174:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895179:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895184:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951872.895204:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895210:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895231:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff97b16e21f400) 00010000:00010000:3.0:1783951872.895234:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951872.895236:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951872.895242:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb4370 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951872.895307:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+7:65739:x1870605447689600:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 569us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951872.895315:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1073 00010000:00010000:0.0:1783951873.570553:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951874.595735:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951875.617477:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951875.681442:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465384576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951875.681530:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951875.681564:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465384832:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.681583:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465385088:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.681635:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951875.681664:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465385344:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.681667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951875.681695:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465385600:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.681703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951875.681729:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465385856:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.681734:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951875.681763:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465386112:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.681764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951875.681795:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1783951875.681800:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951875.681807:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465384704:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.681824:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783951875.681833:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465384960:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.681845:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951875.681882:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951875.681891:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465385216:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.681907:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465385472:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.681923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951875.681942:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951875.681949:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465385728:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.681967:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465385984:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.681979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951875.682000:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951875.682004:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465386240:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.682032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951875.682047:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465384832 00000100:00100000:0.0:1783951875.682055:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465384832 00000100:00100000:2.0:1783951875.682066:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465384576 00000100:00100000:2.0:1783951875.682072:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465384576 00000100:00100000:0.0:1783951875.682105:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465385088 00000100:00100000:2.0:1783951875.682110:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465385344 00000100:00100000:0.0:1783951875.682111:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465385088 00000100:00100000:2.0:1783951875.682116:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465385344 00000100:00100000:0.0:1783951875.682134:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465384960 00000100:00100000:2.0:1783951875.682139:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465385856 00000100:00100000:0.0:1783951875.682139:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465384960 00000100:00100000:2.0:1783951875.682144:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465385856 00000100:00100000:2.0:1783951875.682181:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:0.0:1783951875.682188:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465385216 00000100:00100000:2.0:1783951875.682190:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465384576:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951875.682194:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465385216 00000100:00100000:0.0:1783951875.682215:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465385728 00000100:00100000:0.0:1783951875.682218:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465385728 00000004:00000024:2.0:1783951875.682228:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783951875.682231:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465386240 00000100:00100000:0.0:1783951875.682236:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465386240 00000100:00100000:0.0:1783951875.682251:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1783951875.682259:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465384832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.682280:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465384576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951875.682288:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00100000:2.0:1783951875.682312:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:0.0:1783951875.682314:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465384832:12345-0@lo:400:kworker.0 Request processed in 54us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951875.682322:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465385344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.682336:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1783951875.682357:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1783951875.682363:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465385344:12345-0@lo:400:kworker.0 Request processed in 42us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951875.682369:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465385088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.682375:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00100000:2.0:1783951875.682391:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:2.0:1783951875.682399:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465385856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.682412:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465385088:12345-0@lo:400:kworker.0 Request processed in 48us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951875.682421:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1783951875.682437:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465385856:12345-0@lo:400:kworker.0 Request processed in 37us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951875.682441:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1783951875.682450:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465384960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.682457:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00100000:2.0:1783951875.682486:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465384704 00000100:00100000:2.0:1783951875.682491:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465384704 00000100:00100000:0.0:1783951875.682492:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465384960:12345-0@lo:400:kworker.0 Request processed in 43us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951875.682501:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1783951875.682518:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1783951875.682528:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783951875.682529:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465385216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.682541:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465384704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.682565:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465385216:12345-0@lo:400:kworker.0 Request processed in 39us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951875.682573:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1783951875.682612:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465384704:12345-0@lo:400:kworker.0 Request processed in 49us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951875.682616:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1783951875.682625:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783951875.682629:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465385728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.682663:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1783951875.682668:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465385728:12345-0@lo:400:kworker.0 Request processed in 42us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951875.682674:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465386240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.682681:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1783951875.682710:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465385600 00000100:00100000:2.0:1783951875.682714:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465386240:12345-0@lo:400:kworker.0 Request processed in 43us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951875.682715:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465385600 00000100:00100000:2.0:1783951875.682724:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1783951875.682756:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465386112 00000100:00100000:0.0:1783951875.682760:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465386112 00000100:00100000:2.0:1783951875.682767:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465385472 00000100:00100000:2.0:1783951875.682772:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465385472 00000100:00100000:0.0:1783951875.682796:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465385984 00000100:00100000:0.0:1783951875.682801:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465385984 00000100:00100000:2.0:1783951875.682805:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:2.0:1783951875.682815:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465385600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.682835:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1783951875.682844:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465386112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.682853:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465385600:12345-0@lo:400:kworker.0 Request processed in 39us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951875.682860:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:2.0:1783951875.682876:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:2.0:1783951875.682884:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465385472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.682889:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465386112:12345-0@lo:400:kworker.0 Request processed in 45us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951875.682897:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1783951875.682915:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:2.0:1783951875.682922:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465385472:12345-0@lo:400:kworker.0 Request processed in 38us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951875.682927:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465385984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.682934:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1783951875.682967:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465385984:12345-0@lo:400:kworker.0 Request processed in 43us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951875.682973:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:0.0:1783951875.683024:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465384704:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.683036:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465384960:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.683044:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465385216:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.683055:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465385472:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.683064:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465385728:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.683075:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465385984:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.683082:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465386240:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.683093:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465385088:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.683101:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465384832:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.683112:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465385600:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.683121:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465385344:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.683131:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465386112:0@lo:400:kworker.0 00000100:00100000:0.0:1783951875.683141:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465385856:0@lo:400:kworker.0 00000100:00100000:2.0:1783951875.683155:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465384576:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1783951875.683308:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951875.683314:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951875.683317:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951875.683319:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951876.193142:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951876.193198:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465386368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951876.193280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951876.193515:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465386368 00000100:00100000:0.0:1783951876.193523:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465386368 00000100:00100000:0.0:1783951876.193583:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:0.0:1783951876.193616:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465386368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951876.193667:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445249024 avail 1299009536 00000100:00100000:0.0:1783951876.194336:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465386368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 720us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951876.194346:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00100000:3.0:1783951876.194560:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465386368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951876.195060:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14474d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465386624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951876.195103:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951876.195135:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951876.195141:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465386496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951876.195173:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951876.195249:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465386624 00000100:00100000:1.0:1783951876.195255:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465386624 00000100:00100000:1.0:1783951876.195302:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465386496 00000100:00100000:1.0:1783951876.195305:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465386496 00000100:00100000:1.0:1783951876.195336:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:1.0:1783951876.195343:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465386624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951876.195369:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951876.195414:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465386624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951876.195420:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00100000:1.0:1783951876.195434:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1783951876.195440:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465386496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951876.195456:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951876.195481:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465386496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951876.195486:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1783951876.195529:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465386496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951876.195544:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14474d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465386624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783951876.641189:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951876.705234:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465386752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951876.705329:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951876.705377:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951876.705384:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465386880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951876.705407:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951876.710630:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465386752 00000100:00100000:0.0:1783951876.710645:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465386752 00000100:00100000:0.0:1783951876.710711:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465386880 00000100:00100000:0.0:1783951876.710715:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465386880 00000100:00100000:0.0:1783951876.710734:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:0.0:1783951876.710744:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465386752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951876.710774:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951876.710865:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465386752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (5536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951876.710872:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:0.0:1783951876.710888:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:0.0:1783951876.710894:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465386880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951876.710905:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951876.710933:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465386880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (5525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951876.710938:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:0.0:1783951876.711010:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465386880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951876.711024:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465386752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951877.612445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951877.612498:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951877.612545:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951877.612632:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951877.612657:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951877.612818:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447690240 00000100:00100000:1.0:1783951877.612829:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447690240 00000100:00100000:1.0:1783951877.612891:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447690112 00000100:00100000:1.0:1783951877.612894:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447690112 00000100:00100000:1.0:1783951877.612917:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2592 00000100:00100000:1.0:1783951877.612927:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447690240:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951877.612999:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447690240:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 72us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951877.613007:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2592 00000100:00100000:1.0:1783951877.613023:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2593 00000100:00100000:1.0:1783951877.613029:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04796e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447690112:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951877.613062:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04796e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447690112:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 33us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951877.613068:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2593 00000100:00080000:3.0:1783951877.613199:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951877.613203:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951877.613320:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447689984 00000100:00100000:0.0:1783951877.613325:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447689984 00000100:00100000:0.0:1783951877.613377:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447689856 00000100:00100000:0.0:1783951877.613380:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447689856 00000100:00100000:0.0:1783951877.613403:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1059 00000100:00100000:0.0:1783951877.613411:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447689984:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951877.613442:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447689984:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 32us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951877.613448:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1059 00000100:00100000:0.0:1783951877.613461:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1060 00000100:00100000:0.0:1783951877.613467:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+7:2399:x1870605447689856:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951877.613500:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+7:2399:x1870605447689856:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 33us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951877.613506:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1060 00000100:00080000:3.0:1783951877.613642:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951877.613645:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951877.614863:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447689728 00000100:00100000:2.0:1783951877.614873:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447689728 00000100:00100000:2.0:1783951877.614930:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:2.0:1783951877.614939:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2399:x1870605447689728:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951877.614989:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2399:x1870605447689728:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 51us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951877.614995:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 81 00010000:00010000:0.0:1783951877.670431:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951878.688786:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951879.713622:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951880.738145:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951880.800864:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951880.801112:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465387520:0@lo:400:kworker.0 00000100:00100000:0.0:1783951880.801211:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465387264:0@lo:400:kworker.0 00000100:00100000:1.0:1783951880.801228:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951880.801293:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465387136:0@lo:400:kworker.0 00000100:00100000:1.0:1783951880.801344:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465388032:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.818148:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951880.818255:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465387648:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.818298:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951880.818327:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465388160:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.818351:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951880.818374:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465388672:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.818416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951880.818438:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465387008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951880.818469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951880.818532:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465387392:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.818563:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951880.818584:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465387904:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.818639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951880.818661:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465388416:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.818683:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951880.818724:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465387136 00000100:00100000:2.0:1783951880.818745:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465387136 00000100:00100000:2.0:1783951880.818808:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783951880.818818:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465387136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.818895:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465387136:12345-0@lo:400:kworker.0 Request processed in 77us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951880.818902:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783951880.818941:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465387520 00000100:00100000:2.0:1783951880.818946:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465387520 00000100:00100000:2.0:1783951880.818984:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465387648 00000100:00100000:2.0:1783951880.818987:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465387648 00000100:00100000:2.0:1783951880.819001:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465388160 00000100:00100000:2.0:1783951880.819003:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465388160 00000100:00100000:2.0:1783951880.819014:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465388672 00000100:00100000:2.0:1783951880.819016:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465388672 00000100:00100000:2.0:1783951880.819025:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465387392 00000100:00100000:2.0:1783951880.819027:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465387392 00000100:00100000:2.0:1783951880.819042:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1783951880.819048:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465387520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819099:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465387520:12345-0@lo:400:kworker.0 Request processed in 51us (17873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951880.819106:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1783951880.819129:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1783951880.819136:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465387648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819168:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465387648:12345-0@lo:400:kworker.0 Request processed in 32us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951880.819174:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1783951880.819186:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:2.0:1783951880.819191:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465388160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819219:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465388160:12345-0@lo:400:kworker.0 Request processed in 27us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951880.819224:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:2.0:1783951880.819236:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:2.0:1783951880.819242:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465388672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819269:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465388672:12345-0@lo:400:kworker.0 Request processed in 28us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951880.819276:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:2.0:1783951880.819287:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1783951880.819294:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465387392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819327:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465387392:12345-0@lo:400:kworker.0 Request processed in 34us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951880.819333:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1783951880.819362:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465387008 00000100:00100000:2.0:1783951880.819365:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465387008 00000100:00100000:2.0:1783951880.819405:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:2.0:1783951880.819412:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465387008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951880.819446:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951880.819481:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465387008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951880.819487:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00100000:2.0:1783951880.819511:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465387904 00000100:00100000:2.0:1783951880.819514:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465387904 00000100:00100000:2.0:1783951880.819541:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465388416 00000100:00100000:2.0:1783951880.819544:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465388416 00000100:00100000:2.0:1783951880.819565:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:2.0:1783951880.819571:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465387904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819633:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465387904:12345-0@lo:400:kworker.0 Request processed in 62us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951880.819639:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:2.0:1783951880.819650:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1783951880.819655:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465388416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819680:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465388416:12345-0@lo:400:kworker.0 Request processed in 25us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951880.819685:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00080000:2.0:1783951880.819711:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951880.819716:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951880.819718:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951880.819777:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465387392:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819791:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465387904:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819801:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465388416:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819852:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465387136:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819865:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465387648:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819875:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465388160:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819885:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465388672:0@lo:400:kworker.0 00000100:00100000:2.0:1783951880.819902:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465387008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951880.820740:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951880.820784:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465388544:0@lo:400:kworker.0 00000100:00100000:1.0:1783951880.821386:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951880.821450:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465387520:0@lo:400:kworker.0 00000100:00100000:1.0:1783951880.821514:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465388032 00000100:00100000:1.0:1783951880.821521:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465388032 00000100:00100000:1.0:1783951880.821575:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465388544 00000100:00100000:1.0:1783951880.821578:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465388544 00000100:00100000:1.0:1783951880.822150:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1783951880.822160:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465388032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951880.822545:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465388032:12345-0@lo:400:kworker.0 Request processed in 386us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951880.822554:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1783951880.822575:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1783951880.822582:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465388544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951880.822643:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465388544:12345-0@lo:400:kworker.0 Request processed in 62us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951880.822649:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1783951880.822706:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465388032:0@lo:400:kworker.0 00000100:00100000:1.0:1783951880.822718:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465388544:0@lo:400:kworker.0 00000100:00080000:2.0:1783951880.825478:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951880.828934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951880.829131:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465387776:0@lo:400:kworker.0 00000100:00100000:0.0:1783951880.829440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951880.829471:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465388288:0@lo:400:kworker.0 00000100:00100000:1.0:1783951880.829499:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465387776 00000100:00100000:0.0:1783951880.829500:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951880.829512:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465387776 00000100:00100000:0.0:1783951880.829532:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465388288 00000100:00100000:0.0:1783951880.829546:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465388288 00000100:00100000:1.0:1783951880.829581:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:1.0:1783951880.829627:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465387776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951880.829703:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465387776:12345-0@lo:400:kworker.0 Request processed in 79us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951880.835537:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:0.0:1783951880.835577:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465388288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951880.835742:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465388288:12345-0@lo:400:kworker.0 Request processed in 179us (6233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951880.835751:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:0.0:1783951880.835842:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465388288:0@lo:400:kworker.0 00000100:00100000:0.0:1783951880.836023:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465387776:0@lo:400:kworker.0 00000100:00100000:3.0:1783951880.838475:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465387264 00000100:00100000:3.0:1783951880.838495:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465387264 00000100:00100000:3.0:1783951880.838581:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1783951880.838618:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465387264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951880.838805:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465387264:12345-0@lo:400:kworker.0 Request processed in 214us (9881us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951880.838814:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00080000:3.0:1783951880.838849:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951880.840327:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465387264:0@lo:400:kworker.0 00000100:00100000:1.0:1783951880.852936:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000001:02000400:1.0:1783951881.004537:0:86005:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 10:11:20 (1783951880) 00000100:00100000:0.0:1783951881.118338:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951881.118938:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447690368 00000100:00100000:1.0:1783951881.118954:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447690368 00000100:00100000:1.0:1783951881.119048:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1074 00000100:00100000:1.0:1783951881.119061:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:66328:x1870605447690368:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1783951881.119093:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951881.119134:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb4377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a155 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119225:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119258:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119273:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119300:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb4385 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119307:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb4385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119489:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb4385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119557:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119565:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119572:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119578:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.119584:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951881.120033:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120044:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120062:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0c00) 00010000:00010000:1.0:1783951881.120065:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951881.120071:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120089:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb437e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120110:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb4385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120126:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb4385 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120132:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb4385 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120137:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86aa00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951881.120140:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb4385 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120146:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb4385 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120154:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff97b14531cb00) 00010000:00010000:1.0:1783951881.120157:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951881.120159:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb4385 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120165:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb4385 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120214:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb4377 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a155 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120253:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0c00) 00010000:00010000:1.0:1783951881.120256:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951881.120260:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb4377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a155 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951881.120271:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a600, rc 0) 00000100:00100000:1.0:1783951881.120379:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:66328:x1870605447690368:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1320us (2067us total) trans 0 rc 301/301 00000100:00100000:1.0:1783951881.120389:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1074 00000100:00080000:3.0:1783951881.121625:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951881.128490:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951881.128898:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447690624 00000100:00100000:2.0:1783951881.128912:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447690624 00000100:00100000:2.0:1783951881.128985:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1075 00000100:00100000:2.0:1783951881.128996:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+7:66328:x1870605447690624:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1783951881.129077:0:67035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951881.129122:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4338 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a147 expref: 7 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.129145:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0c00) 00010000:00010000:2.0:1783951881.129159:0:67035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951881.129252:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.129269:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.129281:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.129295:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.129322:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.129330:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130642:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130666:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130677:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951881.130696:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000941f886a reply state 00000000cb2da630 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130709:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130715:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b04d803300) 00010000:00010000:2.0:1783951881.130718:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951881.130722:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783951881.130728:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783951881.130739:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130747:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130753:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130768:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130775:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951881.130780:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130790:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130801:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803100) 00010000:00010000:2.0:1783951881.130804:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951881.130808:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130815:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb438c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951881.130832:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000941f886a reply state 00000000cb2da630 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130841:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.130846:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff97b04d803b00) 00010000:00010000:2.0:1783951881.130849:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951881.130851:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783951881.130969:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+8:66328:x1870605447690624:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 1969us (2490us total) trans 103079215105 rc 0/0 00000100:00100000:2.0:1783951881.130980:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1075 00000100:00100000:1.0:1783951881.157815:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951881.157905:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447690752 00000100:00100000:2.0:1783951881.157918:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447690752 00000100:00100000:2.0:1783951881.157994:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1076 00000100:00100000:2.0:1783951881.158006:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:66329:x1870605447690752:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783951881.158053:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951881.158085:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb43a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a15c expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.158191:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb43a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.158211:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb43a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.158225:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb43a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951881.158288:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783951881.158293:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951881.158321:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb43a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.158352:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb43a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a15c expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.158374:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb43a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a15c expref: 9 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.158385:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803100) 00010000:00010000:2.0:1783951881.158388:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951881.158409:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216be00, rc 0) 00000100:00100000:2.0:1783951881.158496:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:66329:x1870605447690752:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 492us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951881.158504:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1076 00000100:00100000:0.0:1783951881.164904:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951881.165162:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447690880 00000100:00100000:2.0:1783951881.165177:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447690880 00000100:00100000:2.0:1783951881.165259:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1077 00000100:00100000:2.0:1783951881.165272:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+9:66329:x1870605447690880:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783951881.165304:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951881.165333:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a163 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165434:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165461:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165474:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165487:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ac00/0x22c73c7857bb43bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165494:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ac00/0x22c73c7857bb43bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165500:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ac00/0x22c73c7857bb43bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165653:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a600/0x22c73c7857bb43c4 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165683:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a600/0x22c73c7857bb43c4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165691:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a600/0x22c73c7857bb43c4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951881.165755:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783951881.165760:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951881.165786:0:66238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a600/0x22c73c7857bb43c4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165801:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165808:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165815:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165821:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165828:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ae00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951881.165833:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165840:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165855:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803100) 00010000:00010000:2.0:1783951881.165864:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951881.165870:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165877:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb43b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165892:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ac00/0x22c73c7857bb43bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165897:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ac00/0x22c73c7857bb43bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165902:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ac00/0x22c73c7857bb43bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165907:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ac00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951881.165909:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ac00/0x22c73c7857bb43bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165914:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ac00/0x22c73c7857bb43bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165921:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff97b04d803b00) 00010000:00010000:2.0:1783951881.165924:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951881.165927:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ac00/0x22c73c7857bb43bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165933:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ac00/0x22c73c7857bb43bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165963:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a163 expref: 11 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165989:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a600/0x22c73c7857bb43c4 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a163 expref: 10 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.165996:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b04d803300) 00010000:00010000:2.0:1783951881.165999:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951881.166001:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a600, rc 0) 00000100:00100000:2.0:1783951881.166088:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+10:66329:x1870605447690880:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 819us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951881.166096:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1077 00000100:00100000:0.0:1783951881.172926:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951881.173309:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447691136 00000100:00100000:2.0:1783951881.173325:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447691136 00000100:00100000:2.0:1783951881.173418:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1078 00000100:00100000:2.0:1783951881.173431:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+10:66329:x1870605447691136:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783951881.173562:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951881.174102:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb43cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a16a expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951881.174265:0:68591:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783951881.174417:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb43cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a16a expref: 12 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.174435:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803100) 00010000:00010000:2.0:1783951881.174439:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951881.174445:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb43cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a16a expref: 12 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.174508:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a000, rc 0) 00000100:00100000:2.0:1783951881.174622:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+11:66329:x1870605447691136:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1191us (1709us total) trans 103079215106 rc 301/301 00000100:00100000:2.0:1783951881.174631:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1078 00000100:00100000:3.0:1783951881.181627:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951881.181705:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447691392 00000100:00100000:2.0:1783951881.181719:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447691392 00000100:00100000:2.0:1783951881.181803:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1079 00000100:00100000:2.0:1783951881.181815:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+11:66329:x1870605447691392:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1783951881.181898:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951881.181935:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a600/0x22c73c7857bb43c4 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a163 expref: 11 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.181957:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b04d803300) 00010000:00010000:2.0:1783951881.181963:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951881.181991:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.182009:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.182021:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951881.182233:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002dc22a56 reply state 000000002a345362 transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.182248:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951881.182274:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b04d803300) 00010000:00010000:2.0:1783951881.182276:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1783951881.182280:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783951881.182290:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000100:00100000:2.0:1783951881.182398:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+12:66329:x1870605447691392:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 584us (815us total) trans 103079215107 rc 0/0 00000100:00100000:2.0:1783951881.182406:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1079 00000100:00100000:2.0:1783951881.193536:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951881.193761:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447691648 00000100:00100000:0.0:1783951881.193774:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447691648 00000100:00100000:0.0:1783951881.193848:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 218 00000100:00100000:0.0:1783951881.193860:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:66329:x1870605447691648:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1783951881.194171:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+13:66329:x1870605447691648:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 312us (651us total) trans 103079215108 rc 0/0 00000100:00100000:0.0:1783951881.194179:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 218 00000100:00100000:3.0:1783951881.318479:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951881.318512:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465388800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951881.318784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951881.318947:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465388800 00000100:00100000:0.0:1783951881.318956:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465388800 00000100:00100000:0.0:1783951881.319235:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:0.0:1783951881.319248:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465388800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951881.319299:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1783951881.319398:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465388800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951881.319407:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:2.0:1783951881.319516:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465388800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951881.320702:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951881.320723:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465388928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951881.320793:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951881.320842:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465388928 00000100:00100000:0.0:1783951881.320849:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465388928 00000100:00100000:0.0:1783951881.320895:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:0.0:1783951881.320903:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465388928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951881.320935:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951881.320976:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465388928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951881.320983:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:0.0:1783951881.321044:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465388928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951881.322151:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465389056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951881.322221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951881.322301:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465389056 00000100:00100000:2.0:1783951881.322309:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465389056 00000100:00100000:2.0:1783951881.322358:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:2.0:1783951881.322709:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465389056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951881.323694:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951881.323861:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465389056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1154us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951881.323871:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1783951881.323916:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465389056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783951881.762814:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951881.825012:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951881.825047:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465389184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951881.825159:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951881.825222:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465389184 00000100:00100000:0.0:1783951881.825231:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465389184 00000100:00100000:0.0:1783951881.825296:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:0.0:1783951881.825306:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465389184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951881.825341:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951881.825392:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465389184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951881.825400:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:0.0:1783951881.825483:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465389184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951881.825978:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951881.826100:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465389312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951881.826217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951881.826295:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465389312 00000100:00100000:1.0:1783951881.826301:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465389312 00000100:00100000:1.0:1783951881.826348:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:1.0:1783951881.826358:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465389312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951881.826378:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951881.826427:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465389312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951881.826434:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:2.0:1783951881.826539:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465389312:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1783951882.182090:0:85179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215108 is committed 00010000:00010000:3.0:1783951882.182206:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182223:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182232:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182239:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951882.182245:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182264:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182287:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff97b04d803b00) 00010000:00010000:3.0:1783951882.182291:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951882.182297:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182304:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a400/0x22c73c7857bb4393 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182328:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182336:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182341:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182347:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216bc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951882.182349:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182356:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182364:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b04d803300) 00010000:00010000:3.0:1783951882.182367:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951882.182370:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182383:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb439a lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182400:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182407:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182413:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182419:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951882.182422:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182429:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182439:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b04d803300) 00010000:00010000:3.0:1783951882.182441:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783951882.182444:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.182450:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb43d9 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951882.238782:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951882.238949:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447691776 00000100:00100000:2.0:1783951882.238962:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447691776 00000100:00100000:2.0:1783951882.239155:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1080 00000100:00100000:2.0:1783951882.239179:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:66338:x1870605447691776:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:2.0:1783951882.239247:0:66238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1783951882.239335:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:66338:x1870605447691776:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 159us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951882.239343:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1080 00000100:00100000:1.0:1783951882.244448:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951882.248125:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447691904 00000100:00100000:3.0:1783951882.248142:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447691904 00000100:00100000:3.0:1783951882.248280:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1081 00000100:00100000:3.0:1783951882.248294:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:66338:x1870605447691904:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:3.0:1783951882.248364:0:68591:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951882.248466:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:66338:x1870605447691904:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 177us (4026us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951882.248474:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1081 00000100:00080000:0.0:1783951882.249332:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951882.251501:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951882.251651:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447692032 00000100:00100000:0.0:1783951882.251662:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447692032 00000100:00100000:0.0:1783951882.251790:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2023 00000100:00100000:0.0:1783951882.251801:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:66338:x1870605447692032:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783951882.251837:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951882.251907:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:66338:x1870605447692032:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 110us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951882.251913:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2023 00000100:00080000:3.0:1783951882.251941:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951882.253478:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951882.253560:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447692160 00000100:00100000:0.0:1783951882.253571:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447692160 00000100:00100000:0.0:1783951882.253690:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2024 00000100:00100000:0.0:1783951882.253698:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:66338:x1870605447692160:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783951882.253728:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951882.253797:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:66338:x1870605447692160:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951882.253802:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2024 00000100:00080000:3.0:1783951882.253862:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951882.317315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951882.317444:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447692416 00000100:00100000:3.0:1783951882.317455:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447692416 00000100:00100000:3.0:1783951882.317515:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1082 00000100:00100000:3.0:1783951882.317525:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+7:66345:x1870605447692416:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00010000:3.0:1783951882.317579:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951882.317624:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb43a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a15c expref: 7 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.317642:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803100) 00010000:00010000:3.0:1783951882.317652:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951882.317711:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb43e0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.317726:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb43e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.317737:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb43e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.317749:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.317756:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.317771:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.318100:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb43e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.318120:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb43e0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.318126:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb43e0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.318132:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951882.318135:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb43e0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.318142:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb43e0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.318149:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b16e21fd00) 00010000:00010000:3.0:1783951882.318152:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951882.318155:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb43e0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.318160:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb43e0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951882.318174:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f004448 reply state 000000000a9d56be transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.318184:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.318194:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b16e21fc00) 00010000:00010000:3.0:1783951882.318196:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951882.318199:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951882.318269:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:66345:x1870605447692416:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 746us (964us total) trans 103079215109 rc 0/0 00000100:00100000:3.0:1783951882.318276:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1082 00000100:00100000:1.0:1783951882.351379:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951882.351569:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447692544 00000100:00100000:2.0:1783951882.351776:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447692544 00000100:00100000:2.0:1783951882.351840:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1083 00000100:00100000:2.0:1783951882.351851:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:66348:x1870605447692544:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:2.0:1783951882.351882:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951882.351908:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b600/0x22c73c7857bb43ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a171 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.351980:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb43f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.351995:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb43f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.352007:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb43f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951882.352066:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783951882.352070:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951882.352091:0:66238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb43f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.352126:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b600/0x22c73c7857bb43ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a171 expref: 10 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.352165:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb43f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a171 expref: 9 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.352174:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803600) 00010000:00010000:2.0:1783951882.352176:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951882.352179:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a800, rc 0) 00000100:00100000:2.0:1783951882.352360:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+9:66348:x1870605447692544:12345-192.168.202.48@tcp:101:rm.0 Request processed in 509us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951882.352368:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1083 00000100:00100000:3.0:1783951882.359639:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951882.359768:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447692672 00000100:00100000:2.0:1783951882.359780:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447692672 00000100:00100000:2.0:1783951882.359836:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1084 00000100:00100000:2.0:1783951882.359846:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+9:66348:x1870605447692672:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:2.0:1783951882.359868:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951882.359892:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216aa00/0x22c73c7857bb43fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a178 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.359951:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.359965:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.359976:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.359986:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb440a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360006:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb440a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360013:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb440a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360110:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb4411 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360118:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb4411 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360124:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb4411 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951882.360173:0:68591:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783951882.360177:0:68591:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951882.360196:0:68591:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb4411 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360208:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb4411 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360217:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360222:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360228:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360244:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360249:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ba00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951882.360253:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360261:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360272:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803600) 00010000:00010000:2.0:1783951882.360275:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951882.360279:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360286:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4403 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360299:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb440a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360305:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb440a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360311:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb440a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360316:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951882.360320:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb440a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360336:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb440a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360343:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b16e21fc00) 00010000:00010000:2.0:1783951882.360346:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951882.360349:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb440a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360354:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb440a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360379:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216aa00/0x22c73c7857bb43fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a178 expref: 11 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360392:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb4411 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a178 expref: 10 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951882.360400:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff97b04d803500) 00010000:00010000:2.0:1783951882.360403:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951882.360405:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b800, rc 0) 00000100:00100000:2.0:1783951882.360477:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+10:66348:x1870605447692672:12345-192.168.202.48@tcp:101:rm.0 Request processed in 632us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951882.360485:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1084 00000100:00100000:1.0:1783951882.365312:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951882.365408:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447692928 00000100:00100000:3.0:1783951882.365428:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447692928 00000100:00100000:3.0:1783951882.365504:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1085 00000100:00100000:3.0:1783951882.365519:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+10:66348:x1870605447692928:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:3.0:1783951882.365633:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783951882.365670:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb4411 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a178 expref: 10 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.365698:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff97b04d803500) 00010000:00010000:3.0:1783951882.365738:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb43f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a171 expref: 9 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.365751:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803600) 00010000:00010000:3.0:1783951882.365761:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951882.365793:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4418 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.365927:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4418 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.365940:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4418 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.365973:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.365983:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.365989:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.366099:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb4426 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.366118:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb4426 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.366125:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb4426 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367146:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367170:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367180:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367188:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367194:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367222:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367242:0:83761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951882.367274:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb4426 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367281:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb4426 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367286:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb4426 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367293:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fea00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951882.367298:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb4426 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367307:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb4426 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367319:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff97b16e21f000) 00010000:00010000:3.0:1783951882.367322:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783951882.367326:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb4426 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367332:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb4426 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367355:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4418 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367360:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4418 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367372:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4418 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367377:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951882.367381:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4418 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367387:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4418 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367396:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b16e21fd00) 00010000:00010000:3.0:1783951882.367398:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951882.367402:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4418 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367408:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4418 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951882.367409:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:3.0:1783951882.367430:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cfdc72a8 reply state 00000000dfbd7410 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951882.367436:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367447:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951882.367455:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951882.367460:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b16e21fc00) 00010000:00010000:0.0:1783951882.367463:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951882.367467:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951882.367506:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783951882.367509:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951882.367531:0:15262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff97b16e21f000) 00010000:00010000:0.0:1783951882.367535:0:15262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783951882.367540:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951882.367547:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb442d lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951882.367575:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951882.367577:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951882.367624:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951882.367647:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+10:66348:x1870605447692928:12345-192.168.202.48@tcp:36:rm.0 Request processed in 2127us (2339us total) trans 103079215110 rc 0/0 00000100:00100000:3.0:1783951882.367658:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1085 00000100:00100000:3.0:1783951882.738397:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951882.738446:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951882.738480:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951882.738513:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951882.738558:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951882.738561:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447693312 00000100:00100000:0.0:1783951882.738571:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447693312 00000100:00100000:3.0:1783951882.738579:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447693184 00000100:00100000:3.0:1783951882.738582:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447693184 00000100:00100000:1.0:1783951882.738668:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447693568 00000100:00100000:1.0:1783951882.738672:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447693568 00000100:00100000:1.0:1783951882.738705:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447693440 00000100:00100000:1.0:1783951882.738709:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447693440 00000100:00100000:1.0:1783951882.738730:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2598 00000100:00100000:1.0:1783951882.738740:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447693568:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951882.738811:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447693568:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 72us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951882.738820:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2598 00000100:00100000:1.0:1783951882.738836:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2599 00000100:00100000:1.0:1783951882.738842:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447693440:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951882.738866:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447693440:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951882.738872:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2599 00000100:00100000:3.0:1783951882.739188:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1067 00000100:00100000:3.0:1783951882.739198:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+10:2401:x1870605447693184:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951882.739241:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+10:2401:x1870605447693184:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 46us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951882.739248:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1067 00000100:00100000:2.0:1783951882.739434:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447693056 00000100:00100000:2.0:1783951882.739439:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447693056 00000100:00100000:2.0:1783951882.739481:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:2.0:1783951882.739488:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447693056:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951882.739528:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447693056:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 41us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951882.739535:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:0.0:1783951882.744276:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1068 00000100:00100000:0.0:1783951882.744295:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447693312:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951882.744381:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447693312:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 93us (5934us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951882.744388:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1068 00010000:00010000:0.0:1783951882.789769:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951883.809559:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951884.836097:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951885.860273:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951885.920782:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465389440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951885.920843:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951885.920972:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465389440 00000100:00100000:2.0:1783951885.920979:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465389440 00000100:00100000:2.0:1783951885.921023:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:2.0:1783951885.921032:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465389440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951885.921067:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951885.921133:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465389440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.921138:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:1.0:1783951885.921521:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465389440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951885.924271:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465389824:0@lo:400:kworker.0 00000100:00100000:1.0:1783951885.924339:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951885.924386:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465390336:0@lo:400:kworker.0 00000100:00100000:1.0:1783951885.924420:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951885.924455:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465390848:0@lo:400:kworker.0 00000100:00100000:1.0:1783951885.924477:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951885.924500:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783951885.924506:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465389952:0@lo:400:kworker.0 00000100:00100000:1.0:1783951885.924526:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951885.924542:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465390464:0@lo:400:kworker.0 00000100:00100000:1.0:1783951885.924562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951885.924579:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465390976:0@lo:400:kworker.0 00000100:00100000:1.0:1783951885.924629:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951885.925058:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465389824 00000100:00100000:2.0:1783951885.925065:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465389824 00000100:00100000:2.0:1783951885.925126:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465389952 00000100:00100000:2.0:1783951885.925130:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465389952 00000100:00100000:2.0:1783951885.925147:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465390976 00000100:00100000:2.0:1783951885.925149:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465390976 00000100:00100000:2.0:1783951885.925166:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1783951885.925186:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465389824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.925241:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465389824:12345-0@lo:400:kworker.0 Request processed in 58us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.925249:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1783951885.925265:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1783951885.925270:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465389952:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951885.925283:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e5b800 x1870605465389952/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:146/0 lens 224/224 e 0 to 0 dl 1783951896 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951885.925324:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465389952:12345-0@lo:400:kworker.0 Request processed in 54us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.925330:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1783951885.925342:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1783951885.925347:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465390976:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951885.925356:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e5bb80 x1870605465390976/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:146/0 lens 224/224 e 0 to 0 dl 1783951896 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951885.925380:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465390976:12345-0@lo:400:kworker.0 Request processed in 32us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.925385:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00080000:2.0:1783951885.925401:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951885.925405:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951885.925435:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465389952:0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.925445:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465390976:0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.925453:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465389824:0@lo:400:kworker.0 00000100:00100000:3.0:1783951885.925621:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465389696:0@lo:400:kworker.0 00000100:00100000:3.0:1783951885.925656:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951885.925685:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465390208:0@lo:400:kworker.0 00000100:00100000:3.0:1783951885.925708:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951885.925724:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465390720:0@lo:400:kworker.0 00000100:00100000:3.0:1783951885.925745:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951885.925836:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783951885.925844:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465389568:0@lo:400:kworker.0 00000100:00100000:3.0:1783951885.925872:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951885.925896:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465390080:0@lo:400:kworker.0 00000100:00100000:3.0:1783951885.925918:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951885.925931:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465390592:0@lo:400:kworker.0 00000100:00100000:3.0:1783951885.925952:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951885.926038:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465390336 00000100:00100000:1.0:1783951885.926043:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465390336 00000100:00100000:1.0:1783951885.926087:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465390848 00000100:00100000:1.0:1783951885.926091:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465390848 00000100:00100000:1.0:1783951885.926107:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465390464 00000100:00100000:1.0:1783951885.926110:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465390464 00000100:00100000:1.0:1783951885.926124:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465390720 00000100:00100000:1.0:1783951885.926126:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465390720 00000100:00100000:1.0:1783951885.926144:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1783951885.926150:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465390336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.926898:0:85184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465389568 00000100:00100000:2.0:1783951885.926905:0:85184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465389568 00000100:00100000:2.0:1783951885.926942:0:85184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783951885.926950:0:85184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465389568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927003:0:85184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465389568:12345-0@lo:400:kworker.0 Request processed in 54us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.927010:0:85184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783951885.927043:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1783951885.927050:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465390848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927108:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465390848:12345-0@lo:400:kworker.0 Request processed in 58us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.927114:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1783951885.927129:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1783951885.927134:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465390464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927161:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465390464:12345-0@lo:400:kworker.0 Request processed in 27us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.927167:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1783951885.927190:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1783951885.927196:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465390720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927225:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465390720:12345-0@lo:400:kworker.0 Request processed in 29us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.927231:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1783951885.927251:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465389696 00000100:00100000:2.0:1783951885.927255:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465389696 00000100:00100000:2.0:1783951885.927275:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465390080 00000100:00100000:2.0:1783951885.927277:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465390080 00000100:00100000:2.0:1783951885.927287:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465390592 00000100:00100000:2.0:1783951885.927290:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465390592 00000100:00100000:2.0:1783951885.927301:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1783951885.927307:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465389696:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951885.927320:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dee300 x1870605465389696/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:146/0 lens 224/224 e 0 to 0 dl 1783951896 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951885.927347:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465389696:12345-0@lo:400:kworker.0 Request processed in 41us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.927353:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1783951885.927372:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1783951885.927378:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465390080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927408:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465390080:12345-0@lo:400:kworker.0 Request processed in 30us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.927413:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1783951885.927424:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1783951885.927430:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465390592:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951885.927441:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dedc00 x1870605465390592/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:146/0 lens 224/224 e 0 to 0 dl 1783951896 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951885.927468:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465390592:12345-0@lo:400:kworker.0 Request processed in 38us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951885.927474:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1783951885.927506:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465389568:0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927519:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465390080:0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927529:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465390592:0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927539:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465389696:0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927548:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465390720:0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927612:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465390464:0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.927626:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465390848:0@lo:400:kworker.0 00000100:00080000:3.0:1783951885.927706:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951885.927710:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783951885.927713:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951885.927715:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951885.928048:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465390336:12345-0@lo:400:kworker.0 Request processed in 1897us (3626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951885.928056:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1783951885.928920:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465390208 00000100:00100000:0.0:1783951885.928930:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465390208 00000100:00100000:0.0:1783951885.928983:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:0.0:1783951885.928992:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465390208:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783951885.929015:0:26467:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dedf80 x1870605465390208/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:146/0 lens 224/224 e 0 to 0 dl 1783951896 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951885.929097:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465390208:12345-0@lo:400:kworker.0 Request processed in 107us (3387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951885.929104:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00100000:1.0:1783951885.929910:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465390208:0@lo:400:kworker.0 00000100:00100000:2.0:1783951885.933204:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465390336:0@lo:400:kworker.0 00000100:00100000:2.0:1783951886.444468:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465391104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951886.444554:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951886.444619:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951886.444626:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465391232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951886.444651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951886.444685:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465391104 00000100:00100000:2.0:1783951886.444692:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465391104 00000100:00100000:2.0:1783951886.444737:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:2.0:1783951886.444744:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465391104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951886.444789:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951886.444832:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465391104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951886.444839:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:2.0:1783951886.444861:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465391232 00000100:00100000:2.0:1783951886.444865:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465391232 00000100:00100000:2.0:1783951886.444891:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:2.0:1783951886.444897:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465391232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951886.444920:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00010000:00000080:2.0:1783951886.444934:0:8445:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14de96680 x1870605465391232/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:147/0 lens 224/368 e 0 to 0 dl 1783951897 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951886.444963:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465391232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951886.444969:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:2.0:1783951886.445012:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465391232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951886.445024:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465391104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951886.445779:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951886.445793:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465391360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951886.445834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951886.445960:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465391360 00000100:00100000:3.0:1783951886.445965:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465391360 00000100:00100000:3.0:1783951886.446005:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:3.0:1783951886.446013:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465391360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951886.446033:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951886.446088:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465391360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951886.446095:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00100000:3.0:1783951886.446133:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465391360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783951886.892796:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951886.954147:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951886.954180:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465391488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951886.954256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951886.954303:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465391488 00000100:00100000:2.0:1783951886.954310:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465391488 00000100:00100000:2.0:1783951886.954355:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:2.0:1783951886.954364:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465391488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951886.954388:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951886.954431:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465391488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951886.954438:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:2.0:1783951886.954484:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465391488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951886.959328:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465391616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951886.959415:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951886.959640:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465391616 00000100:00100000:1.0:1783951886.959649:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465391616 00000100:00100000:1.0:1783951886.959698:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:1.0:1783951886.959708:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465391616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951886.959747:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951886.959800:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465391616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951886.959807:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1783951886.959968:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465391616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951887.852848:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951887.852888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951887.852928:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951887.852955:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951887.852984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951887.853012:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447693952 00000100:00100000:1.0:1783951887.853022:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447693952 00000100:00100000:1.0:1783951887.853095:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447693824 00000100:00100000:1.0:1783951887.853099:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447693824 00000100:00100000:1.0:1783951887.853123:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1075 00000100:00100000:1.0:1783951887.853133:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447693952:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951887.853223:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447693952:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 91us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951887.853231:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1075 00000100:00100000:1.0:1783951887.853248:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1076 00000100:00100000:1.0:1783951887.853255:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:2400:x1870605447693824:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000080:1.0:1783951887.853267:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e5a300 x1870605447693824/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:148/0 lens 224/224 e 0 to 0 dl 1783951898 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951887.853293:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:2400:x1870605447693824:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 39us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951887.853299:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1076 00000100:00080000:1.0:1783951887.853332:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951887.853335:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951887.853656:0:85183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447693696 00000100:00100000:2.0:1783951887.853662:0:85183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447693696 00000100:00100000:2.0:1783951887.853695:0:85183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:2.0:1783951887.853702:0:85183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447693696:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951887.853739:0:85183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447693696:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 38us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951887.853757:0:85183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:2.0:1783951887.853790:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447694208 00000100:00100000:2.0:1783951887.853793:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447694208 00000100:00100000:2.0:1783951887.853824:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447694080 00000100:00100000:2.0:1783951887.853826:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447694080 00000100:00100000:2.0:1783951887.853847:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2604 00000100:00100000:2.0:1783951887.853853:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447694208:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951887.853890:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447694208:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 37us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951887.853897:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2604 00000100:00100000:2.0:1783951887.853909:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2605 00000100:00100000:2.0:1783951887.853915:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447694080:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951887.853936:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447694080:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 21us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951887.853942:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2605 00000100:00080000:1.0:1783951887.854565:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951887.854580:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783951887.911165:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783951888.473121:0:85179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:1.0:1783951888.473190:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473205:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473213:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473219:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951888.473225:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473233:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473255:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b16e21fc00) 00010000:00010000:1.0:1783951888.473259:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951888.473265:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473272:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb43e7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473292:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473299:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473313:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473318:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951888.473322:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473328:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473337:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b16e21fc00) 00010000:00010000:1.0:1783951888.473339:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951888.473342:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951888.473347:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb441f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951888.930970:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783951889.640650:0:86401:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1783951889.748073:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951889.750250:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447694336 00000100:00100000:3.0:1783951889.750266:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447694336 00000100:00100000:3.0:1783951889.750358:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1086 00000100:00100000:3.0:1783951889.750370:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:66415:x1870605447694336:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783951889.750389:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951889.750414:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a17f expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.750475:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb443b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.750488:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb443b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.750500:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb443b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951889.750554:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951889.750558:0:67035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951889.750622:0:67035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb443b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.750647:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff400/0x22c73c7857bb4434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a17f expref: 8 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.750666:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb443b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a17f expref: 7 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.750673:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b16e21f600) 00010000:00010000:3.0:1783951889.750676:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951889.750679:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1444fea00, rc 0) 00010000:00000080:3.0:1783951889.750687:0:67035:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e5b480 x1870605447694336/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:150/0 lens 576/688 e 0 to 0 dl 1783951900 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00080000:1.0:1783951889.750842:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951889.750938:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+7:66415:x1870605447694336:12345-192.168.202.48@tcp:101:touch.0 Request processed in 570us (2873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951889.750945:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1086 00000100:00100000:1.0:1783951889.754130:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951889.754310:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447694464 00000100:00100000:3.0:1783951889.754320:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447694464 00000100:00100000:3.0:1783951889.754377:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1087 00000100:00100000:3.0:1783951889.754388:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+7:66415:x1870605447694464:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783951889.754408:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951889.754427:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fec00/0x22c73c7857bb4442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a186 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754513:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754526:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754537:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754552:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff200/0x22c73c7857bb4450 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754560:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff200/0x22c73c7857bb4450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754567:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff200/0x22c73c7857bb4450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754673:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff000/0x22c73c7857bb4457 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754682:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff000/0x22c73c7857bb4457 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754689:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff000/0x22c73c7857bb4457 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951889.754864:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783951889.754868:0:66237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951889.754890:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff000/0x22c73c7857bb4457 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754920:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754926:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754931:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754938:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754944:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fee00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951889.754948:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754954:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754967:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b16e21f600) 00010000:00010000:3.0:1783951889.754970:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951889.754975:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754980:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fee00/0x22c73c7857bb4449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754992:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff200/0x22c73c7857bb4450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.754997:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff200/0x22c73c7857bb4450 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.755009:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff200/0x22c73c7857bb4450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.755014:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951889.755016:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff200/0x22c73c7857bb4450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.755021:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff200/0x22c73c7857bb4450 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.755030:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff97b16e21f900) 00010000:00010000:3.0:1783951889.755044:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951889.755047:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff200/0x22c73c7857bb4450 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.755052:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff200/0x22c73c7857bb4450 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.755082:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fec00/0x22c73c7857bb4442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a186 expref: 9 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.755093:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff000/0x22c73c7857bb4457 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a186 expref: 8 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.755099:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b16e21f500) 00010000:00010000:3.0:1783951889.755101:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783951889.755103:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1444ff000, rc 0) 00010000:00000080:3.0:1783951889.755110:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b047ace300 x1870605447694464/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:150/0 lens 592/688 e 0 to 0 dl 1783951900 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783951889.755219:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:66415:x1870605447694464:12345-192.168.202.48@tcp:101:touch.0 Request processed in 833us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951889.755227:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1087 00000100:00100000:1.0:1783951889.782759:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951889.782836:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447694720 00000100:00100000:0.0:1783951889.782846:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447694720 00000100:00100000:0.0:1783951889.782905:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1088 00000100:00100000:0.0:1783951889.782915:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:66415:x1870605447694720:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783951889.782936:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951889.782956:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb445e lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a18d expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783070:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783085:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783097:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783112:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783119:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783145:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783536:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783546:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783554:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951889.783625:0:68591:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1783951889.783629:0:68591:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 0 -> 1783951890 00000004:00010000:0.0:1783951889.783631:0:68591:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 0 -> 1783951890 00000004:00010000:0.0:1783951889.783634:0:68591:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 0 -> 1783951890 00000004:00010000:0.0:1783951889.783636:0:68591:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1783951889.783639:0:68591:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1783951889.783646:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783653:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783661:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783668:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783674:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783951889.783684:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783692:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 5/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783703:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b16e21f500) 00010000:00010000:0.0:1783951889.783706:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951889.783710:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 3/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783717:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4465 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951889.783729:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005931b90a reply state 00000000803f19c6 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783739:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783746:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff97b048b52100) 00010000:00010000:0.0:1783951889.783748:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951889.783750:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783951889.783777:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb445e lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 11 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783789:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 10 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.783795:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff97b048b52e00) 00010000:00010000:0.0:1783951889.783797:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1783951889.783806:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbcc00, rc 0) 00010000:00000080:0.0:1783951889.783814:0:68591:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b047ace680 x1870605447694720/t103079215111(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:150/0 lens 752/824 e 0 to 0 dl 1783951900 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783951889.783873:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+11:66415:x1870605447694720:12345-192.168.202.48@tcp:101:touch.0 Request processed in 959us (1123us total) trans 103079215111 rc 0/0 00000100:00100000:0.0:1783951889.783879:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1088 00000100:00100000:1.0:1783951889.787434:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951889.787518:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447694976 00000100:00100000:0.0:1783951889.787529:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447694976 00000100:00100000:0.0:1783951889.787628:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1089 00000100:00100000:0.0:1783951889.787638:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:66415:x1870605447694976:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:0.0:1783951889.787760:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.787777:0:66236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 11 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.787786:0:66236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.787817:0:66236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 11 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.787829:0:66236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 11 pid: 68591 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951889.787843:0:66236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd42d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66236:1870605465391744:192.168.202.48@tcp:104: 00000100:00100000:0.0:1783951889.787912:0:66236:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1749b6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951889.791302:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951889.791618:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447695104 00000100:00100000:3.0:1783951889.791628:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447695104 00010000:00010000:3.0:1783951889.791665:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 12 pid: 68591 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951889.791700:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2541 00000100:00100000:3.0:1783951889.791709:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458183b2-4c6d-478c-9fed-a955779e6611+12:2401:x1870605447695104:12345-192.168.202.48@tcp:102:ldlm_bl.0 00010000:00010000:3.0:1783951889.791725:0:6503:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 12 pid: 68591 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.791748:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 12 pid: 68591 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.791759:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 12 pid: 68591 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.791768:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff97b048b52e00) 00010000:00010000:3.0:1783951889.791771:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1783951889.791775:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.791784:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.791806:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951889.791828:0:6503:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 12 pid: 68591 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951889.791879:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458183b2-4c6d-478c-9fed-a955779e6611+12:2401:x1870605447695104:12345-192.168.202.48@tcp:102:ldlm_bl.0 Request processed in 171us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951889.791886:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2541 00000100:00100000:0.0:1783951889.792445:0:66236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd42d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66236:1870605465391744:192.168.202.48@tcp:104: 00010000:00010000:0.0:1783951889.792476:0:66236:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.792485:0:66236:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.792491:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783951889.792627:0:66236:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1783951889.792631:0:66236:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 1783951890 -> 1783951890 00000004:00010000:0.0:1783951889.792633:0:66236:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 1783951890 -> 1783951890 00000004:00010000:0.0:1783951889.792635:0:66236:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 1783951890 -> 1783951890 00000004:00010000:0.0:1783951889.792638:0:66236:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1783951889.792644:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000689e2f79 reply state 000000006346fd02 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.792658:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951889.792665:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff97b048b52e00) 00010000:00010000:0.0:1783951889.792668:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783951889.792670:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1783951889.792718:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b17300d180 x1870605447694976/t103079215112(0) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:150/0 lens 488/456 e 0 to 0 dl 1783951900 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951889.792769:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+13:66415:x1870605447694976:12345-192.168.202.48@tcp:36:touch.0 Request processed in 5134us (5346us total) trans 103079215112 rc 0/0 00000100:00100000:0.0:1783951889.792776:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1089 00000100:00100000:3.0:1783951889.804569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951889.804745:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447695360 00000100:00100000:0.0:1783951889.804768:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447695360 00000100:00100000:0.0:1783951889.804822:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 219 00000100:00100000:0.0:1783951889.804831:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+13:66415:x1870605447695360:12345-192.168.202.48@tcp:35:touch.0 00010000:00000080:0.0:1783951889.805004:0:66241:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049defb80 x1870605447695360/t103079215113(0) o35->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:150/0 lens 392/456 e 0 to 0 dl 1783951900 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783951889.805074:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+14:66415:x1870605447695360:12345-192.168.202.48@tcp:35:touch.0 Request processed in 244us (514us total) trans 103079215113 rc 0/0 00000100:00100000:0.0:1783951889.805081:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 219 00010000:00010000:0.0:1783951889.952756:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951890.990891:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951891.049445:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465391872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951891.049519:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951891.049576:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465391872 00000100:00100000:2.0:1783951891.049583:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465391872 00000100:00100000:2.0:1783951891.049650:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:2.0:1783951891.049658:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465391872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951891.049691:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951891.049748:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465391872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951891.049754:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00100000:2.0:1783951891.051768:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465391872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951891.058306:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465392128:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.058373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.058408:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465392640:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.058433:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.058451:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465393152:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.058474:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.058499:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783951891.058506:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465392000:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.058534:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.058560:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465392512:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.058580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.058631:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465393024:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.058652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.058675:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465392256:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.058707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951891.059577:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465392128 00000100:00100000:0.0:1783951891.059597:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465392128 00000100:00100000:0.0:1783951891.059653:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465392512 00000100:00100000:0.0:1783951891.059656:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465392512 00000100:00100000:0.0:1783951891.059674:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465393024 00000100:00100000:0.0:1783951891.059677:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465393024 00000100:00100000:0.0:1783951891.059688:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465392256 00000100:00100000:0.0:1783951891.059691:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465392256 00000100:00100000:0.0:1783951891.059707:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1783951891.059716:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465392128:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783951891.059873:0:68591:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050d2c000 x1870605465392128/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:152/0 lens 224/224 e 0 to 0 dl 1783951902 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951891.059998:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465392128:12345-0@lo:400:kworker.0 Request processed in 283us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951891.060007:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1783951891.060033:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1783951891.060040:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465392512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.060070:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465392512:12345-0@lo:400:kworker.0 Request processed in 30us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951891.060085:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1783951891.060097:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1783951891.060102:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465393024:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783951891.060112:0:68591:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b047ac5880 x1870605465393024/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:152/0 lens 224/224 e 0 to 0 dl 1783951902 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951891.060138:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465393024:12345-0@lo:400:kworker.0 Request processed in 36us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951891.060143:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1783951891.060985:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1783951891.060996:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465392256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.061990:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465392384:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.062050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.062070:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465392896:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.062092:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.062117:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465393408:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.062135:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.062178:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465392384 00000100:00100000:3.0:1783951891.062186:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465392384 00000100:00100000:3.0:1783951891.062223:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465393408 00000100:00100000:3.0:1783951891.062227:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465393408 00000100:00100000:3.0:1783951891.062241:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:3.0:1783951891.062249:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465392384:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783951891.062271:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b047ac6300 x1870605465392384/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:152/0 lens 224/224 e 0 to 0 dl 1783951902 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951891.062312:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465392384:12345-0@lo:400:kworker.0 Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951891.062319:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:3.0:1783951891.062336:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1783951891.062342:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465393408:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783951891.062354:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b047ac4380 x1870605465393408/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:152/0 lens 224/224 e 0 to 0 dl 1783951902 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951891.062378:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465393408:12345-0@lo:400:kworker.0 Request processed in 36us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951891.062385:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1783951891.062438:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465392384:0@lo:400:kworker.0 00000100:00100000:3.0:1783951891.062450:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465393408:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.062973:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465392256:12345-0@lo:400:kworker.0 Request processed in 1977us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951891.062980:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00080000:0.0:1783951891.063002:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951891.063007:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951891.063047:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465392512:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063059:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465393024:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063071:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465392128:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063103:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465392256:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063111:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465392768:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951891.063163:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465393280:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063195:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951891.063232:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465393152 00000100:00100000:0.0:1783951891.063237:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465393152 00000100:00100000:0.0:1783951891.063289:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465392896 00000100:00100000:0.0:1783951891.063292:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465392896 00000100:00100000:0.0:1783951891.063307:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465392768 00000100:00100000:0.0:1783951891.063310:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465392768 00000100:00100000:0.0:1783951891.063326:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465393280 00000100:00100000:0.0:1783951891.063328:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465393280 00000100:00100000:0.0:1783951891.063347:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:0.0:1783951891.063354:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465393152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063394:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465393152:12345-0@lo:400:kworker.0 Request processed in 41us (4918us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951891.063400:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:0.0:1783951891.063412:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:0.0:1783951891.063418:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465392896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063449:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465392896:12345-0@lo:400:kworker.0 Request processed in 31us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951891.063454:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:0.0:1783951891.063464:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:0.0:1783951891.063469:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465392768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063493:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465392768:12345-0@lo:400:kworker.0 Request processed in 25us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951891.063499:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:0.0:1783951891.063509:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1783951891.063515:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465393280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063539:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465393280:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951891.063551:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1783951891.063684:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465392896:0@lo:400:kworker.0 00000100:00080000:0.0:1783951891.063699:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951891.063702:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951891.063715:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465393152:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063734:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465392768:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.063742:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465393280:0@lo:400:kworker.0 00000100:00100000:2.0:1783951891.063923:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465392640 00000100:00100000:2.0:1783951891.063928:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465392640 00000100:00100000:2.0:1783951891.063968:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1783951891.063976:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465392640:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951891.064000:0:8445:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050d2d500 x1870605465392640/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:152/0 lens 224/224 e 0 to 0 dl 1783951902 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951891.064050:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465392640:12345-0@lo:400:kworker.0 Request processed in 75us (5615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951891.064056:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1783951891.064077:0:85185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465392000 00000100:00100000:2.0:1783951891.064080:0:85185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465392000 00000100:00100000:2.0:1783951891.064108:0:85185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783951891.064114:0:85185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14472e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465392000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951891.064145:0:85185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14472e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465392000:12345-0@lo:400:kworker.0 Request processed in 32us (5610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951891.064151:0:85185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783951891.066441:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465392000:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.066462:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465392640:0@lo:400:kworker.0 00000100:00100000:0.0:1783951891.553862:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465393664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951891.553931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951891.553973:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951891.553979:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465393536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951891.554005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951891.554049:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465393536 00000100:00100000:0.0:1783951891.554055:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465393536 00000100:00100000:0.0:1783951891.554097:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:0.0:1783951891.554106:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465393536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951891.554134:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951891.554175:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465393536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951891.554183:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:0.0:1783951891.554225:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465393536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783951891.554340:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465393664 00000100:00100000:2.0:1783951891.554344:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465393664 00000100:00100000:2.0:1783951891.554383:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:2.0:1783951891.554390:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465393664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951891.554414:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00010000:00000080:2.0:1783951891.554427:0:26467:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd41c00 x1870605465393664/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:152/0 lens 224/368 e 0 to 0 dl 1783951902 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951891.554462:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465393664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951891.554469:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00100000:0.0:1783951891.554531:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465393664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951891.555339:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465393792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951891.555374:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.555431:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465393792 00000100:00100000:3.0:1783951891.555436:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465393792 00000100:00100000:3.0:1783951891.555467:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:3.0:1783951891.555475:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465393792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951891.555496:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951891.555961:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465393792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 486us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951891.555969:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:0.0:1783951891.557359:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465393792:0@lo:13:osp-pre-1-0.0 00000020:01000004:0.0:1783951891.824013:0:86498:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783951891.824078:0:86498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.824092:0:86498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.824100:0:86498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.824108:0:86498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.824130:0:86498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783951891.824135:0:86498:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783951891.824167:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951891.824171:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783951891.824177:0:86498:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783951891.824200:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b144574000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783951891.824231:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465393920:0@lo:39:umount.0 00000100:00100000:0.0:1783951891.824298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951891.824391:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951891.824399:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.824422:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4e00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783951891.824426:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.824434:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951891.824441:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951891.824447:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951891.824449:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783951891.824452:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783951891.824477:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.824483:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951891.824508:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.824516:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1767e4e00/0x22c73c7857bb3ffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4005 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.824527:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951891.824529:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951891.824531:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951891.824538:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951891.824547:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465394048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951891.824580:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.827396:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465393920 00000100:00100000:3.0:1783951891.827408:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465393920 00000100:00100000:3.0:1783951891.827469:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1783951891.827479:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465393920:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783951891.827507:0:66237:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb411d 00000100:00080000:3.0:1783951891.827523:0:66237:0:(import.c:65:import_set_state_nolock()) ffff97b048cad000 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1783951891.827614:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd41180 x1870605465393920/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:152/0 lens 224/224 e 0 to 0 dl 1783951902 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951891.827692:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1870605465393920:12345-0@lo:39:umount.0 Request processed in 215us (3394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951891.827699:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000020:00000080:3.0:1783951891.827710:0:66237:0:(genops.c:906:class_export_put()) final put ffff97b048caa800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1783951891.827741:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465394048 00000100:00100000:3.0:1783951891.827745:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465394048 00000100:00100000:3.0:1783951891.827776:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1783951891.827782:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1472be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465394048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951891.827809:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951891.827834:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1413ab200/0x22c73c7857bb4005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3ffe expref: 24 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951891.827851:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951891.827883:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1472be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3642:x1870605465394048:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (3302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951891.827890:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00080000:3.0:1783951891.827967:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b144574000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783951891.827977:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465393920:0@lo:39:umount.0 00000020:00000080:3.0:1783951891.828002:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b048caa800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783951891.828078:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b048cad000 for lustre-MDT0000 00000100:00100000:3.0:1783951891.828105:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465394048:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1783951891.832517:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951891.832524:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951891.832544:0:86498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783951891.833452:0:86498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.833467:0:86498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.833474:0:86498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.833480:0:86498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.833776:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951891.833784:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.833793:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783951891.833796:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.833805:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951891.833812:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951891.833817:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951891.833821:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1783951891.837464:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951891.837480:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951891.837514:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951891.837532:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951891.837552:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465394176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951891.837632:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.837689:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465394176 00000100:00100000:3.0:1783951891.837695:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465394176 00000100:00100000:3.0:1783951891.837743:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1783951891.837753:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3645:x1870605465394176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951891.837781:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951891.837800:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1767e5000/0x22c73c7857bb3f2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3f25 expref: 23 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951891.837816:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951891.837864:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3645:x1870605465394176:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951891.837873:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1783951891.837912:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465394176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951891.837933:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951891.837935:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951891.837937:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951891.838231:0:86498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783951891.838239:0:86498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1767e4400/0x22c73c7857bb3f25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3f2c expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.838254:0:86498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.838262:0:86498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.838270:0:86498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.838276:0:86498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.838329:0:86498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951891.838345:0:86498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.838351:0:86498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.838357:0:86498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.838362:0:86498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.843333:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951891.843348:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.843361:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1772f9c00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783951891.843365:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.843375:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951891.843381:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951891.843386:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951891.843400:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783951891.843403:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783951891.843444:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.843450:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951891.843473:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.843480:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1772f9c00/0x22c73c7857bb4028 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb402f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.843494:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951891.843498:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.843503:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14dc73600 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783951891.843506:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.843530:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951891.843535:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951891.843539:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783951891.843542:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1783951891.843554:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.843559:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951891.843580:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.843602:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951891.843603:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951891.843605:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951891.843614:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951891.843634:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465394304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951891.843694:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951891.844294:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951891.844305:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465394432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951891.844332:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951891.844360:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465394304 00000100:00100000:1.0:1783951891.844366:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465394304 00000100:00100000:1.0:1783951891.844407:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465394432 00000100:00100000:1.0:1783951891.844410:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465394432 00000100:00100000:1.0:1783951891.844433:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1783951891.844441:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3644:x1870605465394304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951891.844452:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951891.844467:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1413aac00/0x22c73c7857bb402f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4028 expref: 23 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.844481:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951891.844515:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3644:x1870605465394304:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951891.844522:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1783951891.844539:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1783951891.844546:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3643:x1870605465394432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951891.844553:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951891.844570:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc72200/0x22c73c7857bb3ff7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3ff0 expref: 21 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.844578:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951891.844627:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3643:x1870605465394432:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951891.844633:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1783951891.844669:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465394304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951891.844691:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465394432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783951891.847212:0:86498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783951891.847225:0:86498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14dc73600/0x22c73c7857bb3ff0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3ff7 expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951891.847241:0:86498:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783951891.847254:0:86498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.847261:0:86498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.847267:0:86498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.847274:0:86498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.847301:0:86498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783951891.847305:0:86498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1783951891.847320:0:86498:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1783951891.847356:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000004:0.0:1783951891.847359:0:86498:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:3.0:1783951891.847363:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1783951891.847364:0:86498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1783951891.847369:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1783951891.847370:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1767e4200 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783951891.847374:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:0.0:1783951891.847374:0:86498:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1783951891.847382:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951891.847388:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951891.847394:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783951891.847396:0:15262:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783951891.847398:0:15262:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783951891.848829:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951891.848863:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951891.848872:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951891.848894:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951891.848903:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1767e4200/0x22c73c7857bb3f10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb3f1e expref: -99 pid: 85178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951891.848914:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951891.848916:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951891.848917:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951891.850994:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465394560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951891.851076:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951891.851148:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951891.851169:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465394560 00000100:00100000:1.0:1783951891.851186:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465394560 00000100:00100000:1.0:1783951891.851235:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1783951891.851244:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3643:x1870605465394560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951891.851259:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951891.851278:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1767e5400/0x22c73c7857bb3f1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb3f10 expref: 20 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951891.851294:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951891.851328:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3643:x1870605465394560:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951891.851335:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1783951891.851370:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465394560:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1783951891.855731:0:86498:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1783951891.857384:0:85179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:0.0:1783951891.858537:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858551:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858559:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858565:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbce00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783951891.858569:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858577:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858607:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff97b048b52100) 00010000:00010000:0.0:1783951891.858610:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951891.858615:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858621:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb446c lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858647:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858666:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858672:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858677:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbde00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783951891.858680:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858686:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858693:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff97b048b52e00) 00010000:00010000:0.0:1783951891.858695:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783951891.858698:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951891.858704:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb4481 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783951891.860374:0:86498:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1783951891.860388:0:86498:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b17704d000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951891.860394:0:86498:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b17704c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951891.860411:0:86498:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b146946000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951891.860414:0:86498:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b04965d000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951891.860420:0:86498:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b04965f000 458183b2-4c6d-478c-9fed-a955779e6611 192.168.202.48@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 103079215113 stale:0 00000020:00080000:2.0:1783951891.860426:0:86498:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff97b0465d4d40) has exports, disconnecting them 00000020:00080000:2.0:1783951891.860430:0:86498:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b17704d000), last request at 1783951855 00000020:00000080:2.0:1783951891.860437:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4116 00000100:00080000:2.0:1783951891.860447:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b048caa000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951891.860476:0:86498:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b17704d000): rc 0 00000020:00000080:2.0:1783951891.860479:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b17704d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1783951891.860490:0:86498:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b17704c800), last request at 1783951891 00000020:00000080:2.0:1783951891.860493:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb410f 00000100:00080000:2.0:1783951891.860497:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b17704d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951891.860505:0:86498:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b17704c800): rc 0 00000020:00000080:2.0:1783951891.860506:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b17704c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1783951891.860510:0:86498:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b146946000), last request at 1783951891 00000020:00000080:2.0:1783951891.860512:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4108 00000100:00080000:2.0:1783951891.860516:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b146943000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951891.860523:0:86498:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b146946000): rc 0 00000020:00000080:2.0:1783951891.860525:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b146946000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1783951891.860528:0:86498:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b04965d000), last request at 1783951849 00000020:00000080:2.0:1783951891.860537:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f72 00000100:00080000:2.0:1783951891.860547:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b146945800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951891.860604:0:86498:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b04965d000): rc 0 00000020:00000080:2.0:1783951891.860606:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b04965d000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1783951891.860610:0:86498:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.48@tcp (ffff97b04965f000), last request at 1783951889 00000020:00000080:2.0:1783951891.860614:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f6b 00000020:00010000:2.0:1783951891.860626:0:86498:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b04965f000: total 4 00000100:00080000:2.0:1783951891.860629:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b146947800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951891.860637:0:86498:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b04965f000): rc 0 00000004:00000080:2.0:1783951891.860642:0:86498:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa80a41463ae0 00000100:00080000:2.0:1783951891.860660:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783951891.860664:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783951891.861444:0:86498:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783951891.861471:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b049659000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00010000:2.0:1783951891.861522:0:6505:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b04965f000: total 4 00010000:00010000:2.0:1783951891.861571:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b04965f000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1783951891.861627:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fea00/0x22c73c7857bb443b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a17f expref: 4 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951891.861657:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4473 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 3 pid: 68591 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951891.861675:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff000/0x22c73c7857bb4457 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a186 expref: 2 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951891.861687:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b04965f000, canceled 3 locks, left on hash table 0. 00000020:00000080:3.0:1783951891.864158:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17704d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783951891.864230:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17704c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783951891.864249:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b146946000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783951891.864269:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783951891.864293:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b048caa000 for lustre-MDT0000 00000020:00000080:3.0:1783951891.864298:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b17704d800 for lustre-MDT0000 00000020:00000080:3.0:1783951891.864301:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b146943000 for lustre-MDT0000 00000020:00000080:3.0:1783951891.864304:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b146945800 for lustre-MDT0000 00000100:00100000:3.0:1783951891.864326:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465394688:0@lo:39:umount.0 00000100:00100000:3.0:1783951891.864397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951891.864453:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465394688 00000100:00100000:3.0:1783951891.864461:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465394688 00000100:00100000:3.0:1783951891.864504:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:3.0:1783951891.864512:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465394688:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783951891.864542:0:8445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3fb1 00000100:00080000:3.0:1783951891.864562:0:8445:0:(import.c:65:import_set_state_nolock()) ffff97b18160e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783951891.864576:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411434 00000100:00100000:3.0:1783951891.864738:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3641:x1870605465394688:12345-0@lo:39:umount.0 Request processed in 226us (340us total) trans 77309411435 rc 0/0 00000100:00100000:3.0:1783951891.864746:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00080000:3.0:1783951891.864786:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b049659000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783951891.864794:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465394688:0@lo:39:umount.0 00010000:00010000:3.0:1783951891.864806:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951891.864811:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951891.868658:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783951891.870959:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783951891.870967:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968950 gen 3 00000004:00080000:3.0:1783951891.870998:0:86498:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783951891.871069:0:86498:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783951891.871099:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b18160d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783951891.871124:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783951891.871127:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968950 gen 3 00000004:00080000:3.0:1783951891.871141:0:86498:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783951891.871200:0:86498:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783951891.871209:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b174b31800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783951891.871247:0:86498:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b0465d4d40) has no exports 00000100:00100000:1.0:1783951891.871283:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465394816:0@lo:9:umount.0 00000100:00100000:1.0:1783951891.871363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951891.871402:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465394944:0@lo:9:umount.0 00000100:00100000:1.0:1783951891.871428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951891.871463:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465394816 00000100:00100000:1.0:1783951891.871469:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465394816 00000100:00100000:1.0:1783951891.871524:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465394944 00000100:00100000:1.0:1783951891.871527:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465394944 00000100:00100000:1.0:1783951891.871545:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4897 00000100:00100000:1.0:1783951891.871553:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465394816:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783951891.871575:0:26204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3fbf 00000100:00080000:1.0:1783951891.871582:0:26204:0:(import.c:65:import_set_state_nolock()) ffff97b14de86000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951891.871641:0:26204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968950 00000100:00100000:1.0:1783951891.872305:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465394816:12345-0@lo:9:umount.0 Request processed in 751us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951891.872313:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4897 00000100:00100000:1.0:1783951891.872331:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4898 00000100:00100000:1.0:1783951891.872337:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465394944:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783951891.872349:0:26204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3fdb 00000100:00080000:1.0:1783951891.872354:0:26204:0:(import.c:65:import_set_state_nolock()) ffff97b176bcd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951891.872379:0:26204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968950 00000100:00100000:1.0:1783951891.872453:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465394944:12345-0@lo:9:umount.0 Request processed in 117us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951891.872459:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4898 00000100:00080000:1.0:1783951891.873244:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b18160d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783951891.873263:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783951891.873265:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951891.873269:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465394816:0@lo:9:umount.0 00000100:00080000:1.0:1783951891.873302:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b174b31800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783951891.873305:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783951891.873306:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951891.873309:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465394944:0@lo:9:umount.0 00010000:00010000:1.0:1783951891.873336:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951891.873341:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783951891.886171:0:86498:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b0465d4d40) has no exports 00000020:00000080:2.0:1783951891.913321:0:6505:0:(genops.c:906:class_export_put()) final put ffff97b04965f000/458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:0.0:1783951891.913416:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965f000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-MDT0000 00000020:00000080:0.0:1783951891.913482:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b146947800 for lustre-MDT0000 00010000:00010000:0.0:1783951891.913493:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951891.913495:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951891.913498:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783951891.995965:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f87 00000020:00000080:3.0:1783951891.995982:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b1447cf800/lustre-QMT0000_UUID 00000020:01000000:3.0:1783951891.996007:0:86498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783951891.996047:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1447cf800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783951891.996119:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951891.996132:0:86498:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951891.996137:0:86498:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff97b174b3cd40) has no exports 00000020:00000080:0.0:1783951892.002698:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f80 00000020:00000080:0.0:1783951892.002844:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b1447cd000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783951892.002923:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1447cd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783951892.003005:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951892.003028:0:86498:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783951892.003032:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b1447c9800/lustre-QMT0000_UUID 00000020:00000080:0.0:1783951892.003034:0:86498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1447c9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783951892.003045:0:86498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1783951892.003191:0:86498:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b15f1bb1e0 - data ffff97b181d5bca8/ffff97b1449e4800 00010000:00010000:1.0:1783951892.008091:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783951892.010379:0:86498:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b15f1bb180 - data ffff97b181d37bd0/ffff97b0459d6000 00000100:00100000:2.0:1783951892.065959:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465395072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951892.066037:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951892.066172:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465395072 00000100:00100000:3.0:1783951892.066180:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465395072 00000100:00100000:3.0:1783951892.066229:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:3.0:1783951892.066239:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465395072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951892.066277:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951892.066323:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465395072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951892.066330:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:3.0:1783951892.066694:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465395072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951892.068678:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465395200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951892.068743:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951892.068798:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465395200 00000100:00100000:0.0:1783951892.068807:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465395200 00000100:00100000:0.0:1783951892.068860:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1783951892.068871:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465395200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951892.068896:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951892.068947:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465395200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951892.068955:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1783951892.068997:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465395200:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783951892.096086:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783951892.096096:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783951892.096110:0:86498:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff97b1518e2a00 x1870605465394688/t77309411435(77309411435) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951901 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951892.096136:0:86498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783951892.097900:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783951892.097906:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968950 gen 4 00000004:00080000:1.0:1783951892.097916:0:86498:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951892.097919:0:86498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783951892.098220:0:85196:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783951892.098225:0:85196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:2.0:1783951892.098233:0:85196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:1.0:1783951892.099216:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783951892.099220:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968950 gen 4 00000004:00080000:1.0:1783951892.099239:0:86498:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951892.099243:0:86498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783951892.099716:0:85198:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783951892.099721:0:85198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:3.0:1783951892.099728:0:85198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:1.0:1783951892.101436:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f41 00000020:00000080:1.0:1783951892.101446:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b04965a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951892.101894:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783951892.102556:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f56 00000020:00000080:1.0:1783951892.102562:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b144462000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783951892.102579:0:86498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783951892.102614:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951892.102625:0:86498:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783951892.102630:0:86498:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff97b1454599c0) has no exports 00000004:01000000:1.0:1783951892.102794:0:86498:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783951892.102803:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3fd4 00000020:00000080:1.0:1783951892.102807:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b17407c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783951892.102811:0:86498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783951892.102814:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951892.102822:0:86498:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783951892.102825:0:86498:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff97b1449b3380) has no exports 00000020:00000080:1.0:1783951892.102851:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3fcd 00000020:00000080:1.0:1783951892.102855:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b174b34800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1783951892.103181:0:86498:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783951892.103186:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783951892.103190:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968950 gen 5 00000004:00080000:1.0:1783951892.103196:0:86498:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951892.103198:0:86498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951892.103226:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951892.103234:0:86498:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951892.103239:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3fb8 00000020:00000080:1.0:1783951892.103243:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b047adf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783951892.103246:0:86498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783951892.103250:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951892.103254:0:86498:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783951892.103257:0:86498:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff97b0476a99c0) has no exports 00000020:00000080:1.0:1783951892.103260:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3faa 00000020:00000080:1.0:1783951892.103263:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b14374f000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1783951892.103535:0:86498:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783951892.103538:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783951892.103541:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968950 gen 5 00000004:00080000:1.0:1783951892.103544:0:86498:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951892.103545:0:86498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783951892.103568:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951892.103574:0:86498:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1783951892.103582:0:86498:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783951892.103617:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f9c 00000020:00000080:1.0:1783951892.103621:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b142e2d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783951892.103625:0:86498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1783951892.103628:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783951892.103633:0:86498:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783951892.103635:0:86498:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff97b174b399c0) has no exports 00000020:00000080:1.0:1783951892.103638:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f95 00000020:00000080:1.0:1783951892.103640:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b04965a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951892.105032:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144462000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1783951892.105044:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783951892.105049:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b34800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783951892.105055:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b174b31800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783951892.105124:0:40998:0:(genops.c:906:class_export_put()) final put ffff97b047ade000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951892.105127:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b047ade000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783951892.105132:0:40998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951892.105217:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b047adf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783951892.105221:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14374f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783951892.105226:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b18160d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783951892.105231:0:40998:0:(genops.c:906:class_export_put()) final put ffff97b142e2a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951892.105232:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b142e2a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783951892.105235:0:40998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951892.105265:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b142e2d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783951892.105278:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783951892.105643:0:86498:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783951892.105647:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783951892.105656:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783951892.105662:0:86498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783951892.105701:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951892.105712:0:86498:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951892.105736:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951892.105740:0:86498:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951892.105743:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b144766000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783951892.105746:0:86498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144766000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783951892.105750:0:86498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951892.105819:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f5d 00000020:00000080:2.0:1783951892.105824:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b144467800/lustre-MDD0000_UUID 00000020:01000000:2.0:1783951892.105843:0:86498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783951892.105847:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951892.105852:0:86498:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783951892.105855:0:86498:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff97b174b3b380) has no exports 00000020:00000080:2.0:1783951892.105873:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951892.105876:0:86498:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783951892.105879:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f64 00000020:00000080:2.0:1783951892.105882:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b144463000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783951892.105888:0:86498:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b174696000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783951892.105891:0:86498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174696000 3 00000020:01000004:2.0:1783951892.105894:0:86498:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b174696000 from lustre-MDT0000 00000020:00000080:2.0:1783951892.105908:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951892.105911:0:86498:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783951892.105913:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b04965f800/lustre-MDT0000_UUID 00000020:00000080:2.0:1783951892.105915:0:86498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783951892.105921:0:86498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783951892.105949:0:86498:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783951892.105952:0:86498:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783951892.105955:0:86498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783951892.105957:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951892.105960:0:86498:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1783951892.105973:0:86498:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b04d9f7800 e66faa19-2cbc-412c-8aef-9c55427739f8 192.168.202.48@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951892.105979:0:86498:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b04d9f2800 75da5dc4-aa7e-42cf-a965-1b5f01232c6f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951892.105984:0:86498:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff97b14545b380) has exports, disconnecting them 00000020:00080000:2.0:1783951892.105988:0:86498:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.48@tcp (ffff97b04d9f7800), last request at 1783951849 00000020:00000080:2.0:1783951892.106009:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4021 00000020:00010000:2.0:1783951892.106024:0:86498:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b04d9f7800: total 2 00000100:00080000:2.0:1783951892.106028:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b04d9f3800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951892.106041:0:86498:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b04d9f7800): rc 0 00000020:00080000:2.0:1783951892.106044:0:86498:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97b04d9f2800), last request at 1783951849 00000020:00000080:2.0:1783951892.106445:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3f02 00000020:00010000:2.0:1783951892.106449:0:86498:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b04d9f2800: total 2 00000100:00080000:2.0:1783951892.106451:0:86498:0:(import.c:65:import_set_state_nolock()) ffff97b04d9f3000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951892.106461:0:86498:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b04d9f2800): rc 0 00000020:00080000:2.0:1783951892.106465:0:86498:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff97b14545b380) has no exports 00000100:00100000:2.0:1783951892.106514:0:85185:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97b174881200:85185] 2 exiting: rc = 0 00000100:00100000:2.0:1783951892.107226:0:85183:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97b1469d9600:85183] 0 exiting: rc = 1 00000020:00000080:3.0:1783951892.107316:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b049659000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783951892.107326:0:40998:0:(genops.c:906:class_export_put()) final put ffff97b047add000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951892.107328:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b047add000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1783951892.107332:0:40998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951892.107391:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144467800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1783951892.107395:0:40998:0:(genops.c:906:class_export_put()) final put ffff97b04965b000/lustre-MDD0000_UUID 00000020:00000080:3.0:1783951892.107396:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1783951892.107400:0:40998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1783951892.107429:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144463000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1783951892.139453:0:85184:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97b174698600:85184] 1 exiting: rc = 0 00000020:00010000:2.0:1783951892.139557:0:7459:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b04d9f7800: total 0 00010000:00010000:2.0:1783951892.139620:0:7459:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b04d9f7800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1783951892.139655:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1772f9400/0x22c73c7857bb40ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a12b expref: 5 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139672:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc73800/0x22c73c7857bb40fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a139 expref: 4 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139684:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86b000/0x22c73c7857bb40f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a132 expref: 3 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139694:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc72400/0x22c73c7857bb4101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a140 expref: 2 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139713:0:7459:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b04d9f7800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1783951892.139733:0:7459:0:(genops.c:906:class_export_put()) final put ffff97b04d9f7800/e66faa19-2cbc-412c-8aef-9c55427739f8 00000020:00010000:2.0:1783951892.139752:0:7459:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b04d9f2800: total 1 00010000:00010000:2.0:1783951892.139755:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951892.139772:0:7459:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b04d9f2800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1783951892.139788:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1772f9000/0x22c73c7857bb4059 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4052 expref: 14 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139798:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1772f8c00/0x22c73c7857bb40d7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb40d0 expref: 13 pid: 85185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139811:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc73200/0x22c73c7857bb4067 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4060 expref: 12 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139822:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1413ab400/0x22c73c7857bb40c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb40c2 expref: 11 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139849:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1772f8200/0x22c73c7857bb4083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb407c expref: 10 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139859:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1772f9e00/0x22c73c7857bb40e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb40de expref: 9 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139871:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1767e4000/0x22c73c7857bb4075 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb406e expref: 8 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139880:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1413ab600/0x22c73c7857bb4091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb408a expref: 7 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139901:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1767e5a00/0x22c73c7857bb409f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4098 expref: 6 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139912:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1767e4c00/0x22c73c7857bb40ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb40a6 expref: 5 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139922:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1413ab000/0x22c73c7857bb403d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4036 expref: 4 pid: 85184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139932:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1767e4800/0x22c73c7857bb40bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb40b4 expref: 3 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139943:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14dc72a00/0x22c73c7857bb404b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4044 expref: 2 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951892.139952:0:7459:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b04d9f2800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1783951892.139969:0:7459:0:(genops.c:906:class_export_put()) final put ffff97b04d9f2800/75da5dc4-aa7e-42cf-a965-1b5f01232c6f 00010000:00010000:2.0:1783951892.139973:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951892.139975:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951892.139977:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951892.139983:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951892.140022:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140031:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140036:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140042:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140048:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140057:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140716:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140723:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140729:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140753:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140759:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140765:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140771:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140777:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140783:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140790:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140796:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140800:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140806:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140810:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140815:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140820:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140825:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140842:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140848:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140853:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140858:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140863:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140869:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140875:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140880:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140885:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140891:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140897:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140902:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140907:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140912:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140917:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140923:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140929:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140934:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140940:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140946:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140951:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140965:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140971:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140977:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140983:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140989:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.140994:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141000:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141006:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141020:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141028:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141032:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141038:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141042:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141047:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141052:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783951892.141220:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f7800/e66faa19-2cbc-412c-8aef-9c55427739f8 for MGS 00000020:00000080:3.0:1783951892.141267:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f2800/75da5dc4-aa7e-42cf-a965-1b5f01232c6f for MGS 00000020:00000080:3.0:1783951892.141277:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04d9f3800 for MGS 00000020:00000080:3.0:1783951892.141281:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04d9f3000 for MGS 00000100:00100000:2.0:1783951892.141366:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141376:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141380:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141385:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783951892.141391:0:86498:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1783951892.146502:0:86498:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b1522171e0 - data ffff97b152fdb948/ffff97b150975800 00000020:01000000:2.0:1783951892.146664:0:86498:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b152217600 - data ffff97b181d58a20/ffff97b144495000 00000020:00000080:2.0:1783951892.147219:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3efb 00000020:00000080:2.0:1783951892.147228:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b144761000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783951892.147237:0:86498:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b174696000 from MGS, refs=2 00000020:01000004:2.0:1783951892.147241:0:86498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174696000 2 00000020:01000004:2.0:1783951892.147243:0:86498:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b174696000 from MGS 00000020:00000080:2.0:1783951892.147260:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951892.147268:0:86498:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783951892.147271:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b144763000/MGS 00000020:00000080:2.0:1783951892.147273:0:86498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144763000/MGS for MGS 00000020:01000000:2.0:1783951892.147279:0:86498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783951892.147344:0:86498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783951892.147347:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951892.147365:0:86498:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783951892.147371:0:86498:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97b04965e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951892.147377:0:86498:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff97b0476a8000) has exports, disconnecting them 00000020:00080000:2.0:1783951892.147381:0:86498:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97b04965e800), last request at 1783951849 00000020:00000080:2.0:1783951892.147385:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4013 00000020:00080000:2.0:1783951892.147394:0:86498:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b04965e800): rc 0 00000020:00000080:2.0:1783951892.147397:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b04965e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783951892.148266:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144761000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783951892.148276:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783951892.149090:0:86498:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783951892.149097:0:86498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783951892.149101:0:86498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783951892.149107:0:86498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951892.149127:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144574000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783951892.149242:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951892.149255:0:86498:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783951892.149259:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b14de81000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783951892.149262:0:86498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14de81000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783951892.149267:0:86498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783951892.149338:0:86498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174696000 1 00000020:00000080:3.0:1783951892.149350:0:86498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb3eed 00000020:00000080:3.0:1783951892.149355:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b174691800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1783951892.149362:0:86498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783951892.149368:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174691800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783951892.149375:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951892.149378:0:86498:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783951892.149381:0:86498:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff97b14545cd40) has no exports 00000020:00000080:3.0:1783951892.371809:0:86498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951892.371822:0:86498:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783951892.371827:0:86498:0:(genops.c:906:class_export_put()) final put ffff97b174693800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951892.371832:0:86498:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174693800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783951892.371844:0:86498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783951892.371963:0:86498:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97b174696800 00000020:02000400:3.0:1783951892.372038:0:86498:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000400:00000100:1.0:1783951892.977057:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447695488 offset 0 length 224: 4 00000100:00100000:1.0:1783951892.977101:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951892.977134:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951892.977158:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951892.977178:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951892.977235:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447696000 00000100:00100000:3.0:1783951892.977244:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447696000 00000100:00100000:3.0:1783951892.977297:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447695872 00000100:00100000:3.0:1783951892.977299:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447695872 00000100:00100000:3.0:1783951892.977321:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2610 00000100:00100000:3.0:1783951892.977330:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447696000:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951892.977400:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447696000:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 71us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951892.977408:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2610 00000100:00100000:3.0:1783951892.977424:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2611 00000100:00100000:3.0:1783951892.977430:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447695872:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951892.977454:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447695872:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951892.977460:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2611 00000100:00080000:1.0:1783951892.977867:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951892.977872:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951892.978373:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447695744 00000100:00100000:0.0:1783951892.978380:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447695744 00000100:00100000:0.0:1783951892.978431:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447695616 00000100:00100000:0.0:1783951892.978434:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447695616 00000100:00100000:0.0:1783951892.978452:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1083 00000100:00100000:0.0:1783951892.978460:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447695744:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951892.978502:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447695744:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 44us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951892.978509:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1083 00000100:00100000:0.0:1783951892.978522:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1091 00000100:00100000:0.0:1783951892.978536:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870605447695616:12345-192.168.202.48@tcp:400:kworker.0 00000020:00080000:0.0:1783951892.978544:0:67035:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.48@tcp 00000100:00100000:0.0:1783951892.978565:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1870605447695616:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (1406us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951892.978571:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1091 00000100:00080000:3.0:1783951892.986001:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951892.986250:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951892.986324:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447696128 00000100:00100000:2.0:1783951892.986334:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447696128 00000100:00100000:2.0:1783951892.986382:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1092 00000100:00100000:2.0:1783951892.986389:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447696128:12345-192.168.202.48@tcp:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1783951892.986413:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951892.986473:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447696128:12345-192.168.202.48@tcp:38:ptlrpcd_00_00.0 Request processed in 82us (227us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951892.986481:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1092 00010000:00010000:3.0:1783951893.026341:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951894.049173:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951895.074797:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951896.096852:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951896.160952:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465395712:0@lo:400:kworker.0 00000100:00100000:0.0:1783951896.161034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951896.161069:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465396224:0@lo:400:kworker.0 00000100:00100000:0.0:1783951896.161098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951896.161123:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783951896.161129:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465395584:0@lo:400:kworker.0 00000100:00100000:0.0:1783951896.161149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951896.161164:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465396096:0@lo:400:kworker.0 00000100:00100000:0.0:1783951896.161184:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951896.161213:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465395712 00000100:00100000:0.0:1783951896.161220:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465395712 00000100:00100000:0.0:1783951896.161257:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465395584 00000100:00100000:0.0:1783951896.161260:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465395584 00000100:00100000:0.0:1783951896.161293:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1783951896.161302:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465395584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951896.161353:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465395584:12345-0@lo:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951896.161361:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1783951896.161377:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1783951896.161381:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1870605465395712:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783951896.161387:0:67035:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783951896.161426:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1870605465395712:12345-0@lo:400:kworker.0 Request processed in 43us (393us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951896.161433:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1783951896.161456:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465396224 00000100:00100000:0.0:1783951896.161459:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465396224 00000100:00100000:0.0:1783951896.161482:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465396096 00000100:00100000:0.0:1783951896.161485:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465396096 00000100:00100000:0.0:1783951896.161505:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:0.0:1783951896.161510:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465396224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951896.161542:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465396224:12345-0@lo:400:kworker.0 Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951896.161561:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:0.0:1783951896.161574:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1783951896.161580:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465396096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951896.161636:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465396096:12345-0@lo:400:kworker.0 Request processed in 56us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951896.161642:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1783951896.161689:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465395584:0@lo:400:kworker.0 00000100:00100000:0.0:1783951896.161699:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465396096:0@lo:400:kworker.0 00000100:00080000:0.0:1783951896.161709:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783951896.161713:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783951896.161717:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783951896.161722:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951896.161726:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3570 00000100:00080000:0.0:1783951896.161732:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951896.161762:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04aa48e00 x1870605465396480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951896.161780:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465395712:0@lo:400:kworker.0 00000100:00100000:0.0:1783951896.161794:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465396224:0@lo:400:kworker.0 00000100:00080000:3.0:1783951896.161896:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951896.161900:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951896.161903:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951896.161967:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465395328:0@lo:400:kworker.0 00000400:00000100:1.0:1783951896.162004:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465395328 offset 0 length 224: 4 00000100:00100000:1.0:1783951896.162027:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465395840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951896.162050:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951896.162077:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465396352:0@lo:400:kworker.0 00000100:00100000:1.0:1783951896.162100:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951896.162124:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783951896.162130:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465395456:0@lo:400:kworker.0 00000100:00100000:1.0:1783951896.162153:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951896.162172:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465395968:0@lo:400:kworker.0 00000100:00100000:1.0:1783951896.162195:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951896.162231:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465396480:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783951896.162254:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951896.162281:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465395840 00000100:00100000:1.0:1783951896.162286:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465395840 00000100:00100000:1.0:1783951896.162314:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465396352 00000100:00100000:1.0:1783951896.162317:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465396352 00000100:00100000:1.0:1783951896.162328:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465395456 00000100:00100000:1.0:1783951896.162330:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465395456 00000100:00100000:1.0:1783951896.162337:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465396480 00000100:00100000:1.0:1783951896.162339:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465396480 00000100:00100000:1.0:1783951896.162348:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1783951896.162355:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465395840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951896.162391:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465395840:12345-0@lo:400:kworker.0 Request processed in 37us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951896.162397:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1783951896.162411:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1783951896.162415:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1870605465396352:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783951896.162420:0:66236:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783951896.162442:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1870605465396352:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783951896.162448:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1783951896.162460:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1783951896.162463:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1870605465395456:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783951896.162468:0:66236:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783951896.162490:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1870605465395456:12345-0@lo:400:kworker.0 Request processed in 25us (336us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783951896.162495:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1783951896.162506:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1783951896.162518:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465396480:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1783951896.162535:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951896.162564:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465396480:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 46us (309us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951896.162570:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00080000:1.0:1783951896.162624:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951896.162628:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951896.162631:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465396480:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1783951896.162661:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951896.162664:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783951896.162667:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783951896.162671:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951896.162674:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3570 00000100:00080000:1.0:1783951896.162678:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951896.162694:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ea8380 x1870605465396608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951896.162710:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465395456:0@lo:400:kworker.0 00000100:00100000:1.0:1783951896.162725:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465395840:0@lo:400:kworker.0 00000100:00080000:1.0:1783951896.162733:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951896.162736:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783951896.162739:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783951896.162742:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951896.162751:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3570 00000100:00080000:1.0:1783951896.162755:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951896.162769:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ea9c00 x1870605465396736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951896.162780:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465396352:0@lo:400:kworker.0 00000100:00100000:1.0:1783951896.162806:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465396608:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783951896.162830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951896.162847:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465396736:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1783951896.162867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951896.162890:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465396608 00000100:00100000:1.0:1783951896.162893:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465396608 00000100:00100000:1.0:1783951896.162905:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465396736 00000100:00100000:1.0:1783951896.162907:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465396736 00000100:00100000:1.0:1783951896.162916:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1783951896.162920:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465396608:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783951896.162930:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951896.162960:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465396608:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 38us (128us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951896.162966:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1783951896.162988:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:1.0:1783951896.162992:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465396736:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783951896.163001:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951896.163025:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465396736:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 31us (157us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951896.163031:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00080000:1.0:1783951896.163061:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951896.163065:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951896.163068:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465396608:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1783951896.163076:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951896.163079:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951896.163082:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465396736:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1783951896.163160:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951896.163381:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465395968 00000100:00100000:2.0:1783951896.163386:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465395968 00000100:00100000:2.0:1783951896.163421:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:2.0:1783951896.163427:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1870605465395968:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783951896.163432:0:26467:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783951896.163475:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1870605465395968:12345-0@lo:400:kworker.0 Request processed in 47us (1279us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783951896.163481:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00080000:1.0:1783951896.163827:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783951896.163832:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783951896.163835:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783951896.163840:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951896.163844:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3570 00000100:00080000:1.0:1783951896.163849:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951896.163869:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ea9c00 x1870605465396864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951896.163897:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465395968:0@lo:400:kworker.0 00000100:00100000:2.0:1783951896.163956:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465396864:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783951896.164006:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951896.164086:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465396864 00000100:00100000:3.0:1783951896.164090:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465396864 00000100:00100000:3.0:1783951896.164121:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:3.0:1783951896.164127:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465396864:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1783951896.164141:0:8445:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951896.164183:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465396864:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 54us (176us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951896.164189:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00080000:2.0:1783951896.164251:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951896.164256:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951896.164259:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465396864:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1783951897.122391:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951897.185316:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951897.185334:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465396992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951897.185413:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951897.185638:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465396992 00000100:00100000:2.0:1783951897.185646:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465396992 00000100:00100000:2.0:1783951897.185695:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1783951897.185703:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465396992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951897.185731:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951897.185786:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465396992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951897.185793:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:3.0:1783951897.185953:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465396992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951897.186813:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465397120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951897.186861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951897.186949:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465397120 00000100:00100000:3.0:1783951897.186956:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465397120 00000100:00100000:3.0:1783951897.187009:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:3.0:1783951897.187017:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465397120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951897.187041:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951897.187090:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465397120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951897.187096:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:1.0:1783951897.187197:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465397120:0@lo:13:osp-pre-0-1.0 00000400:00000100:0.0:1783951898.097257:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447696256 offset 0 length 224: 4 00000100:00100000:0.0:1783951898.097300:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951898.097333:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951898.097371:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951898.097381:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447696384 00000100:00100000:1.0:1783951898.097392:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447696384 00000100:00100000:0.0:1783951898.097411:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951898.097429:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447696512 00000100:00100000:1.0:1783951898.097432:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447696512 00000100:00100000:0.0:1783951898.097453:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447696640 00000100:00100000:0.0:1783951898.097459:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447696640 00000100:00100000:1.0:1783951898.097480:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1086 00000100:00100000:1.0:1783951898.097491:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447696512:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951898.097496:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447696768 00000100:00100000:0.0:1783951898.097509:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447696768 00000100:00100000:0.0:1783951898.097536:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2614 00000100:00100000:0.0:1783951898.097544:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447696640:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951898.097579:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447696512:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951898.097580:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447696640:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951898.097625:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2614 00000100:00100000:1.0:1783951898.097639:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1086 00000100:00100000:0.0:1783951898.097646:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2615 00000100:00100000:0.0:1783951898.097655:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447696768:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951898.097661:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1099 00000100:00100000:1.0:1783951898.097667:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1870605447696384:12345-192.168.202.48@tcp:38:kworker.0 00000100:00100000:0.0:1783951898.097680:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447696768:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00010000:00020000:1.0:1783951898.097689:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951898.097690:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2615 00000100:00100000:1.0:1783951898.097725:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1870605447696384:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 55us (424us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951898.097732:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1099 00000100:00080000:3.0:1783951898.099309:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951898.099316:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951898.099319:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783951898.145787:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783951898.210842:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951898.210852:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b166f57800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951898.210897:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b166f57800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783951898.211119:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b14de86000 for lustre-OST0000 00000001:00100000:1.0:1783951898.211512:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783951898.211522:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411435 is committed 00000020:00000080:1.0:1783951898.211526:0:75694:0:(genops.c:906:class_export_put()) final put ffff97b18160f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951898.211540:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b18160f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1783951898.211569:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b18160e000 for lustre-MDT0001 00000001:00100000:3.0:1783951898.218840:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951898.218849:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b176bcf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951898.219284:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176bcf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783951898.219330:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b176bcd800 for lustre-OST0001 00010000:00010000:2.0:1783951899.170826:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951900.195043:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951901.216882:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783951901.281728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951901.281736:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951901.281740:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951901.281748:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3611 00000100:00080000:1.0:1783951901.281754:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951901.281761:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951901.281784:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ea9c00 x1870605465397376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951901.281835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951901.281839:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951901.281841:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951901.281844:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3611 00000100:00080000:1.0:1783951901.281847:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951901.281850:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951901.281863:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee2a00 x1870605465397632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951901.281879:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951901.281882:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951901.281900:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951901.281904:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3611 00000100:00080000:1.0:1783951901.281907:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951901.281910:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951901.281922:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee0a80 x1870605465397888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951901.281953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951901.281956:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951901.281958:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951901.281961:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3611 00000100:00080000:1.0:1783951901.281964:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951901.281967:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951901.281979:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee1500 x1870605465398272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951901.282153:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465397248:0@lo:400:kworker.0 00000400:00000100:0.0:1783951901.282212:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465397248 offset 0 length 224: 4 00000100:00100000:0.0:1783951901.282246:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465398144:0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.282274:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951901.282303:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951901.282308:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465398016:0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.282328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951901.282355:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465398144 00000100:00100000:0.0:1783951901.282361:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465398144 00000100:00100000:0.0:1783951901.282409:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465398016 00000100:00100000:0.0:1783951901.282412:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465398016 00000100:00100000:0.0:1783951901.282434:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:0.0:1783951901.282442:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465398144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.282489:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465398144:12345-0@lo:400:kworker.0 Request processed in 48us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951901.282496:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00100000:0.0:1783951901.282511:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:0.0:1783951901.282518:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17743b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465398016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.282544:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17743b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465398016:12345-0@lo:400:kworker.0 Request processed in 27us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951901.282549:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00080000:0.0:1783951901.282734:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951901.282738:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951901.282770:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465398016:0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.282781:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465398144:0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.282802:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465397504:0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.282838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951901.282858:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951901.282863:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465397760:0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.282882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951901.282906:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465397504 00000100:00100000:0.0:1783951901.282909:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465397504 00000100:00100000:0.0:1783951901.282950:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465397760 00000100:00100000:0.0:1783951901.282953:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465397760 00000100:00100000:0.0:1783951901.282974:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1783951901.282979:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465397504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.283012:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465397504:12345-0@lo:400:kworker.0 Request processed in 33us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951901.283018:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1783951901.283029:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1783951901.283034:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465397760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.283074:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465397760:12345-0@lo:400:kworker.0 Request processed in 40us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951901.283080:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00080000:0.0:1783951901.283097:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951901.283115:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465397760:0@lo:400:kworker.0 00000100:00100000:0.0:1783951901.283124:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465397504:0@lo:400:kworker.0 00000100:00100000:2.0:1783951901.283341:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465397376:0@lo:38:kworker.0 00000100:00100000:2.0:1783951901.283377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951901.283411:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465397632:0@lo:38:kworker.0 00000100:00100000:0.0:1783951901.283490:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465397376 00000100:00100000:0.0:1783951901.283495:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465397376 00000100:00100000:0.0:1783951901.283518:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1783951901.283523:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465397376:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951901.283541:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951901.283583:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465397376:12345-0@lo:38:kworker.0 Request processed in 58us (204us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951901.283614:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1783951901.284330:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951901.284366:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465397888:0@lo:38:kworker.0 00000100:00100000:2.0:1783951901.284395:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951901.284483:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465397632 00000100:00100000:3.0:1783951901.284490:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465397632 00000100:00100000:3.0:1783951901.284521:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1783951901.284525:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465397888 00000100:00100000:3.0:1783951901.284529:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465397632:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783951901.284531:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465397888 00010000:00020000:3.0:1783951901.284548:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951901.284560:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:0.0:1783951901.284566:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465397888:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951901.284578:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951901.284612:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465397632:12345-0@lo:38:kworker.0 Request processed in 58us (257us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951901.284631:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1783951901.284640:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465397888:12345-0@lo:38:kworker.0 Request processed in 71us (242us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951901.284649:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000100:00100000:2.0:1783951901.285229:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465398272:0@lo:38:kworker.0 00000100:00100000:2.0:1783951901.285263:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951901.285315:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951901.285321:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951901.285324:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465397376:0@lo:38:kworker.0 00000100:00080000:2.0:1783951901.285335:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951901.285338:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951901.285341:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465397632:0@lo:38:kworker.0 00000100:00080000:2.0:1783951901.285349:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951901.285352:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951901.285355:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465397888:0@lo:38:kworker.0 00000100:00100000:0.0:1783951901.285544:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465398272 00000100:00100000:0.0:1783951901.285549:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465398272 00000100:00100000:0.0:1783951901.285583:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1783951901.285613:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465398272:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951901.285626:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951901.285665:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465398272:12345-0@lo:38:kworker.0 Request processed in 51us (400us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951901.285671:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00080000:2.0:1783951901.285806:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951901.285811:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951901.285813:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465398272:0@lo:38:kworker.0 00010000:00010000:2.0:1783951902.240839:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951902.305122:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951902.305140:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465398400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951902.305207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951902.305295:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465398400 00000100:00100000:2.0:1783951902.305303:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465398400 00000100:00100000:2.0:1783951902.305356:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:2.0:1783951902.305367:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465398400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951902.305409:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951902.305454:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465398400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951902.305461:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1783951902.305608:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465398528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951902.305636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951902.305692:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465398400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951902.305945:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465398528 00000100:00100000:2.0:1783951902.305950:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465398528 00000100:00100000:2.0:1783951902.305987:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:2.0:1783951902.305993:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465398528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951902.306025:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951902.306070:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465398528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951902.306076:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1783951902.306497:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465398528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951903.226681:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951903.226734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951903.226763:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:2.0:1783951903.226790:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447696896 offset 0 length 224: 4 00000100:00100000:2.0:1783951903.226815:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951903.226939:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447697280 00000100:00100000:3.0:1783951903.226949:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447697280 00000100:00100000:3.0:1783951903.227011:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447697408 00000100:00100000:3.0:1783951903.227015:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447697408 00000100:00100000:3.0:1783951903.227038:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4899 00000100:00100000:3.0:1783951903.227048:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+5:2397:x1870605447697280:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:3.0:1783951903.227090:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb433f 00000100:00080000:3.0:1783951903.227099:0:8436:0:(import.c:65:import_set_state_nolock()) ffff97b046619800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783951903.227143:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968950 00000100:00100000:3.0:1783951903.227291:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+2:2397:x1870605447697280:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 244us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951903.227298:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4899 00000100:00100000:3.0:1783951903.227313:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4900 00000100:00100000:3.0:1783951903.227320:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+5:2397:x1870605447697408:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:3.0:1783951903.227332:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4346 00000100:00080000:3.0:1783951903.227337:0:8436:0:(import.c:65:import_set_state_nolock()) ffff97b04b214800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783951903.227360:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968950 00000100:00100000:3.0:1783951903.227425:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+2:2397:x1870605447697408:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 105us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951903.227431:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4900 00010000:00010000:3.0:1783951903.227455:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951903.227460:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951903.227535:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447697024 00000100:00100000:0.0:1783951903.227540:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447697024 00000100:00100000:0.0:1783951903.227570:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447697152 00000100:00100000:0.0:1783951903.227573:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447697152 00000100:00100000:0.0:1783951903.227643:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1089 00000100:00100000:0.0:1783951903.227651:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447697152:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951903.227684:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447697152:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 34us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951903.227698:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1089 00000100:00100000:0.0:1783951903.227711:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1103 00000100:00100000:0.0:1783951903.227716:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447697024:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:0.0:1783951903.227735:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951903.227761:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447697024:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 43us (1090us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951903.227767:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1103 00000100:00080000:2.0:1783951903.228237:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951903.228242:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951903.228244:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783951903.264925:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951904.289110:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951905.344143:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951906.336700:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783951906.402838:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951906.402845:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951906.402857:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951906.402865:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3616 00000100:00100000:2.0:1783951906.402868:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465398656:0@lo:400:kworker.0 00000100:00080000:0.0:1783951906.402871:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783951906.402878:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951906.402909:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04aa4ad80 x1870605465398784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1783951906.402932:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465398656 offset 0 length 224: 4 00000100:00080000:0.0:1783951906.402942:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951906.402945:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951906.402946:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951906.402949:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3616 00000100:00080000:0.0:1783951906.402951:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783951906.402955:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951906.402964:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04aa48380 x1870605465399040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951906.402977:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951906.402983:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465398912:0@lo:400:kworker.0 00000100:00080000:0.0:1783951906.403012:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951906.403015:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1783951906.403017:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783951906.403017:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951906.403020:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3616 00000100:00080000:0.0:1783951906.403023:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783951906.403026:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951906.403037:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04aa48000 x1870605465399296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951906.403064:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783951906.403066:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465399168:0@lo:400:kworker.0 00000100:00080000:0.0:1783951906.403067:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951906.403069:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951906.403073:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3616 00000100:00080000:0.0:1783951906.403075:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783951906.403078:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951906.403089:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951906.403090:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04aa48e00 x1870605465399680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951906.403107:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951906.403112:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465399424:0@lo:400:kworker.0 00000100:00100000:0.0:1783951906.403116:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465398912 00000100:00100000:0.0:1783951906.403122:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465398912 00000100:00100000:2.0:1783951906.403133:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951906.403168:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465399168 00000100:00100000:2.0:1783951906.403171:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465399168 00000100:00100000:0.0:1783951906.403174:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1783951906.403181:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465398912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951906.403196:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1783951906.403201:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465399168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951906.403229:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465398912:12345-0@lo:400:kworker.0 Request processed in 48us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951906.403237:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00080000:0.0:1783951906.403257:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951906.403279:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465399552:0@lo:400:kworker.0 00000100:00100000:0.0:1783951906.403304:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951906.403337:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465398912:0@lo:400:kworker.0 00000100:00100000:2.0:1783951906.403365:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465399168:12345-0@lo:400:kworker.0 Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951906.403369:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465399424 00000100:00100000:0.0:1783951906.403371:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465399424 00000100:00100000:2.0:1783951906.403373:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1783951906.403397:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465399552 00000100:00100000:0.0:1783951906.403400:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465399552 00000100:00100000:0.0:1783951906.403419:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1783951906.403425:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465399424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951906.403454:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465399424:12345-0@lo:400:kworker.0 Request processed in 29us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951906.403460:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:2.0:1783951906.403467:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465399168:0@lo:400:kworker.0 00000100:00100000:0.0:1783951906.403471:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1783951906.403476:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465399552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951906.403485:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465399424:0@lo:400:kworker.0 00000100:00100000:0.0:1783951906.403505:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465399552:12345-0@lo:400:kworker.0 Request processed in 29us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951906.403511:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00080000:0.0:1783951906.403522:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951906.403525:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951906.403538:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465399552:0@lo:400:kworker.0 00000100:00100000:3.0:1783951906.403698:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465398784:0@lo:38:kworker.0 00000100:00100000:3.0:1783951906.403721:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951906.403740:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465399040:0@lo:38:kworker.0 00000100:00100000:3.0:1783951906.403752:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951906.403766:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465399296:0@lo:38:kworker.0 00000100:00100000:3.0:1783951906.403787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951906.403810:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465399680:0@lo:38:kworker.0 00000100:00100000:2.0:1783951906.403838:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465399296 00000100:00100000:3.0:1783951906.403841:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951906.403842:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465399296 00000100:00100000:2.0:1783951906.403861:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:2.0:1783951906.403866:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465399296:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783951906.403872:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465398784 00000100:00100000:3.0:1783951906.403875:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465398784 00010000:00020000:2.0:1783951906.403896:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951906.403903:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465399040 00000100:00100000:3.0:1783951906.403906:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465399040 00000100:00100000:3.0:1783951906.403917:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465399680 00000100:00100000:3.0:1783951906.403919:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465399680 00000100:00100000:2.0:1783951906.403929:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465399296:12345-0@lo:38:kworker.0 Request processed in 62us (141us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951906.403932:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1783951906.403936:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:3.0:1783951906.403937:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465398784:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951906.403946:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951906.403960:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1783951906.403965:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465399040:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783951906.403970:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465398784:12345-0@lo:38:kworker.0 Request processed in 33us (247us total) trans 0 rc -19/-19 00010000:00020000:2.0:1783951906.403974:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951906.403975:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1783951906.403987:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1783951906.403991:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465399680:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783951906.403996:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465399040:12345-0@lo:38:kworker.0 Request processed in 30us (243us total) trans 0 rc -19/-19 00010000:00020000:3.0:1783951906.403999:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951906.404001:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1783951906.404019:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465399680:12345-0@lo:38:kworker.0 Request processed in 26us (177us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951906.404024:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00080000:2.0:1783951906.404032:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951906.404037:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951906.404040:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465398784:0@lo:38:kworker.0 00000100:00080000:2.0:1783951906.404048:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951906.404052:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951906.404061:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465399040:0@lo:38:kworker.0 00000100:00080000:2.0:1783951906.404071:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951906.404074:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951906.404077:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465399296:0@lo:38:kworker.0 00000100:00080000:2.0:1783951906.404084:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951906.404087:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951906.404089:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465399680:0@lo:38:kworker.0 00010000:00010000:3.0:1783951907.360782:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951907.430827:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951907.430849:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465399808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951907.430925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951907.431082:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951907.431092:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465399936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951907.431119:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951907.431157:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465399808 00000100:00100000:0.0:1783951907.431165:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465399808 00000100:00100000:0.0:1783951907.431207:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465399936 00000100:00100000:0.0:1783951907.431210:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465399936 00000100:00100000:0.0:1783951907.431224:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1783951907.431231:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465399808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951907.431275:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951907.431316:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465399808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951907.431323:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1783951907.431339:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:0.0:1783951907.431346:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465399936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951907.431361:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951907.431389:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465399936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951907.431395:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:0.0:1783951907.431558:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465399936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951907.431624:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465399808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951908.335489:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:0.0:1783951908.335535:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447697536 offset 0 length 224: 4 00000100:00100000:0.0:1783951908.335636:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951908.335677:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447697664 00000100:00100000:0.0:1783951908.335690:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447697664 00000100:00100000:0.0:1783951908.335737:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447697792 00000100:00100000:0.0:1783951908.335740:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447697792 00000100:00100000:0.0:1783951908.335783:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1092 00000100:00100000:0.0:1783951908.335793:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447697792:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951908.335904:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447697792:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 112us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951908.335912:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1092 00000100:00100000:0.0:1783951908.335932:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1107 00000100:00100000:0.0:1783951908.335937:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447697664:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:0.0:1783951908.335957:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951908.335982:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447697664:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 44us (505us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951908.335988:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1107 00000100:00080000:0.0:1783951908.336008:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:0.0:1783951908.343998:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447697920 offset 0 length 520: 4 00010000:00010000:2.0:1783951908.384817:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783951908.970908:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:0.0:1783951908.970919:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b046619000/458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:2.0:1783951908.971049:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046619000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-OST0000 00000020:00000080:2.0:1783951908.971097:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b046619800 for lustre-OST0000 00000001:00100000:0.0:1783951908.973361:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:0.0:1783951908.973369:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b04b213000/458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:2.0:1783951908.973488:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04b213000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-OST0001 00000020:00000080:2.0:1783951908.973535:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04b214800 for lustre-OST0001 00010000:00010000:1.0:1783951909.421148:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951910.432762:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951911.456679:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783951911.523878:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951911.523885:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951911.523888:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951911.523895:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3621 00000100:00080000:0.0:1783951911.523900:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783951911.523908:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951911.523929:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04aa4aa00 x1870605465400192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951911.523970:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951911.523981:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951911.523982:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951911.523986:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3621 00000100:00080000:0.0:1783951911.523988:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783951911.523992:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951911.524004:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04aa48a80 x1870605465400448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951911.524023:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951911.524026:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951911.524027:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951911.524031:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3621 00000100:00080000:0.0:1783951911.524034:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783951911.524038:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951911.524048:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1ce00 x1870605465400704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951911.524066:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951911.524069:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951911.524070:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951911.524073:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3621 00000100:00080000:0.0:1783951911.524076:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783951911.524078:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951911.524088:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd6e300 x1870605465401088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951911.524112:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465400064:0@lo:400:kworker.0 00000400:00000100:0.0:1783951911.524167:0:3643:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465400064 offset 0 length 224: 4 00000100:00100000:0.0:1783951911.524206:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465400960:0@lo:400:kworker.0 00000100:00100000:0.0:1783951911.524236:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951911.524257:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951911.524262:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465400832:0@lo:400:kworker.0 00000100:00100000:0.0:1783951911.524283:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951911.524311:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465400192:0@lo:38:kworker.0 00000100:00100000:0.0:1783951911.524335:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951911.524352:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465400448:0@lo:38:kworker.0 00000100:00100000:0.0:1783951911.524372:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951911.524387:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465400704:0@lo:38:kworker.0 00000100:00100000:0.0:1783951911.524441:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951911.524458:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465401088:0@lo:38:kworker.0 00000100:00100000:0.0:1783951911.524479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951911.524506:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465400320:0@lo:400:kworker.0 00000100:00100000:0.0:1783951911.524528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951911.524545:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951911.524550:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465400576:0@lo:400:kworker.0 00000100:00100000:0.0:1783951911.524571:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951911.524618:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465400960 00000100:00100000:0.0:1783951911.524625:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465400960 00000100:00100000:0.0:1783951911.524673:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465400832 00000100:00100000:0.0:1783951911.524676:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465400832 00000100:00100000:0.0:1783951911.524697:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:0.0:1783951911.524705:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465400960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951911.524763:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465400960:12345-0@lo:400:kworker.0 Request processed in 59us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951911.524770:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:0.0:1783951911.524785:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1783951911.524790:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465400832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951911.524815:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465400832:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951911.524820:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1783951911.524854:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465400192 00000100:00100000:0.0:1783951911.524858:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465400192 00000100:00100000:0.0:1783951911.524876:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465400448 00000100:00100000:0.0:1783951911.524878:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465400448 00000100:00100000:0.0:1783951911.524884:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465401088 00000100:00100000:0.0:1783951911.524885:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465401088 00000100:00100000:0.0:1783951911.524892:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465400320 00000100:00100000:0.0:1783951911.524894:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465400320 00000100:00100000:0.0:1783951911.524907:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465400576 00000100:00100000:0.0:1783951911.524910:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465400576 00000100:00100000:0.0:1783951911.524922:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1783951911.524927:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465400320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951911.524960:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465400320:12345-0@lo:400:kworker.0 Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951911.524966:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1783951911.524977:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1783951911.524982:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465400576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951911.525006:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465400576:12345-0@lo:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951911.525020:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1783951911.525033:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1783951911.525036:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465400192:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951911.525053:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951911.525083:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465400192:12345-0@lo:38:kworker.0 Request processed in 45us (746us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951911.525089:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1783951911.525101:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1783951911.525104:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465400448:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951911.525113:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951911.525134:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465400448:12345-0@lo:38:kworker.0 Request processed in 28us (761us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951911.525139:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1783951911.525149:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1783951911.525153:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465401088:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951911.525161:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951911.525182:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465401088:12345-0@lo:38:kworker.0 Request processed in 28us (703us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951911.525187:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1783951911.525209:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465400704 00000100:00100000:0.0:1783951911.525212:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465400704 00000100:00100000:0.0:1783951911.525233:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:0.0:1783951911.525236:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465400704:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951911.525245:0:23862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951911.525275:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465400704:12345-0@lo:38:kworker.0 Request processed in 37us (833us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951911.525281:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00080000:0.0:1783951911.525309:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951911.525312:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951911.525314:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951911.525347:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465400832:0@lo:400:kworker.0 00000100:00100000:0.0:1783951911.525359:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465400960:0@lo:400:kworker.0 00000100:00080000:0.0:1783951911.525391:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951911.525395:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951911.525398:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465400192:0@lo:38:kworker.0 00000100:00080000:0.0:1783951911.525407:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951911.525411:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951911.525413:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465400448:0@lo:38:kworker.0 00000100:00080000:0.0:1783951911.525420:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951911.525422:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951911.525424:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465400704:0@lo:38:kworker.0 00000100:00080000:0.0:1783951911.525431:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951911.525434:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951911.525436:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465401088:0@lo:38:kworker.0 00000100:00100000:0.0:1783951911.525467:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465400576:0@lo:400:kworker.0 00000100:00100000:0.0:1783951911.525475:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465400320:0@lo:400:kworker.0 00010000:00010000:2.0:1783951912.483519:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1783951912.545463:0:3642:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951896/real 1783951896] req@ffff97b16dd40e00 x1870605465395328/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783951912 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951912.545499:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff97b16dd40e00 x1870605465395328/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783951912 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783951912.545508:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783951912.545511:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1783951912.545514:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.148@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783951912.545516:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783951912.545519:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b16dd40e00 x1870605465395328/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783951912 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951912.545527:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b049ea8380 x1870605465397248/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951917 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951912.545535:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b04aa4bb80 x1870605465398656/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951922 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951912.545542:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b04aa49f80 x1870605465400064/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951927 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783951912.545553:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783951912.545556:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783951912.545557:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783951912.545559:0:3642:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1783951912.545576:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465395328:0@lo:400:kworker.0 00000100:00100000:0.0:1783951912.545643:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465397248:0@lo:400:kworker.0 00000100:00100000:0.0:1783951912.545654:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951912.545663:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465401216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951912.546416:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951912.546473:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465400064:0@lo:400:kworker.0 00000100:00100000:0.0:1783951912.546502:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465401216 00000100:00100000:0.0:1783951912.546519:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465401216 00000100:00100000:0.0:1783951912.546566:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:0.0:1783951912.546575:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465401216:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783951912.548034:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951912.548041:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783951912.548045:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951912.548051:0:40998:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3564 00000100:00080000:2.0:1783951912.548060:0:40998:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951912.548082:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04697e300 x1870605465401472/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951912.548102:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951912.548105:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951912.548107:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951912.548110:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3626 00000100:00080000:2.0:1783951912.548112:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951912.548127:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951912.548144:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b174838700 x1870605465401600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951912.548311:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465398656:0@lo:400:kworker.0 00000100:00100000:1.0:1783951912.548331:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951912.548340:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465401344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951912.548408:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951912.548458:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465401344 00000100:00100000:1.0:1783951912.548465:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465401344 00000100:00100000:1.0:1783951912.548498:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:1.0:1783951912.548504:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465401344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951912.549386:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951912.549466:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465401344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 960us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951912.549476:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00002000:00000024:0.0:1783951912.549765:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783951912.549908:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951912.549913:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951912.549917:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951912.549921:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3626 00000100:00080000:2.0:1783951912.549934:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951912.549940:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951912.549965:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b174838a80 x1870605465401856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951912.550285:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465401216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3228us (3388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951912.550293:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00080000:2.0:1783951912.550378:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951912.550381:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951912.550383:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951912.550388:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3626 00000100:00080000:2.0:1783951912.550391:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951912.550394:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951912.550406:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b17483aa00 x1870605465402112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951912.550416:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951912.550419:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951912.550421:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951912.550424:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3626 00000100:00080000:2.0:1783951912.550426:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951912.550447:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951912.550461:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b174839f80 x1870605465402240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951912.550517:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465401216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951912.550656:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465401344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951912.551504:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04697e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465401472:0@lo:250:kworker.0 00000400:00000100:2.0:1783951912.552640:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465401472 offset 0 length 520: 4 00000100:00100000:2.0:1783951912.552693:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465401600:0@lo:38:kworker.0 00000100:00100000:2.0:1783951912.552736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951912.552762:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465401856:0@lo:38:kworker.0 00000100:00100000:2.0:1783951912.552785:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951912.552820:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465402112:0@lo:38:kworker.0 00000100:00100000:2.0:1783951912.552854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951912.552873:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465402240:0@lo:38:kworker.0 00000100:00100000:2.0:1783951912.552906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951912.552952:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465401728:0@lo:400:kworker.0 00000100:00100000:2.0:1783951912.552977:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951912.553009:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951912.553016:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465401984:0@lo:400:kworker.0 00000100:00100000:2.0:1783951912.553038:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951912.553069:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465401600 00000100:00100000:2.0:1783951912.553078:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465401600 00000100:00100000:2.0:1783951912.553110:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465401856 00000100:00100000:2.0:1783951912.553112:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465401856 00000100:00100000:2.0:1783951912.553121:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465402240 00000100:00100000:2.0:1783951912.553124:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465402240 00000100:00100000:2.0:1783951912.553144:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465401728 00000100:00100000:2.0:1783951912.553147:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465401728 00000100:00100000:2.0:1783951912.553175:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465401984 00000100:00100000:2.0:1783951912.553178:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465401984 00000100:00100000:2.0:1783951912.553195:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1783951912.553203:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465401728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951912.553257:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465401728:12345-0@lo:400:kworker.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951912.553264:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1783951912.553281:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1783951912.553287:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b046acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465401984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951912.553313:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b046acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465401984:12345-0@lo:400:kworker.0 Request processed in 27us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951912.553320:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1783951912.553331:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1783951912.553335:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465401600:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951912.553394:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951912.553426:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465401600:12345-0@lo:38:kworker.0 Request processed in 90us (690us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951912.553431:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1783951912.553442:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1783951912.553446:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465401856:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951912.553455:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951912.553477:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465401856:12345-0@lo:38:kworker.0 Request processed in 30us (691us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951912.553483:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1783951912.553502:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1783951912.553506:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465402240:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951912.553516:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951912.554336:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465402112 00000100:00100000:3.0:1783951912.554344:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465402112 00000100:00100000:3.0:1783951912.554374:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:3.0:1783951912.554380:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465402112:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951912.554394:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951912.554444:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465402112:12345-0@lo:38:kworker.0 Request processed in 63us (1589us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951912.554450:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:3.0:1783951912.554504:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465401984:0@lo:400:kworker.0 00000100:00100000:3.0:1783951912.554515:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465401728:0@lo:400:kworker.0 00000100:00080000:3.0:1783951912.556094:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951912.556104:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951912.556109:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465401600:0@lo:38:kworker.0 00000100:00080000:3.0:1783951912.556121:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951912.556124:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951912.556127:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465401856:0@lo:38:kworker.0 00000100:00080000:3.0:1783951912.556136:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951912.556139:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951912.556142:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465402112:0@lo:38:kworker.0 00000100:00100000:2.0:1783951912.557308:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465402240:12345-0@lo:38:kworker.0 Request processed in 3793us (4406us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951912.557322:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00080000:1.0:1783951912.563926:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951912.564331:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951912.564338:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465402240:0@lo:38:kworker.0 00000100:00100000:1.0:1783951913.453291:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951913.455496:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447698176 00000100:00100000:3.0:1783951913.455509:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447698176 00000100:00080000:1.0:1783951913.455581:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951913.455671:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1097 00000100:00100000:3.0:1783951913.455682:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447698176:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951913.455706:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951913.455731:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447698048 00000100:00100000:2.0:1783951913.455734:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447698048 00000100:00100000:3.0:1783951913.455756:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447698176:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 76us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951913.455757:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1114 00000100:00100000:2.0:1783951913.455762:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b046acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447698048:12345-192.168.202.48@tcp:38:kworker.0 00000100:00100000:3.0:1783951913.455764:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1097 00010000:00020000:2.0:1783951913.455781:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951913.455831:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b046acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447698048:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 67us (124us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951913.455837:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1114 00010000:00010000:1.0:1783951913.505053:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951914.534354:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951915.557044:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951916.576741:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951917.602093:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951917.665748:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465402368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951917.665845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951917.665906:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465402368 00000100:00100000:3.0:1783951917.665914:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465402368 00000100:00100000:3.0:1783951917.665966:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:3.0:1783951917.665987:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465402368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951917.666018:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951917.666062:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465402368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951917.666069:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00080000:3.0:1783951917.666089:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951917.666125:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465402368:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783951917.668847:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951917.668854:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951917.668857:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951917.668860:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951917.668864:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951917.668871:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3627 00000100:00080000:3.0:1783951917.668884:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951917.668891:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951917.668971:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b17483aa00 x1870605465402624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951917.669007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951917.669011:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951917.669013:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951917.669017:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3627 00000100:00080000:3.0:1783951917.669026:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951917.669030:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951917.669042:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b174838700 x1870605465402880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951917.669059:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951917.669062:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951917.669064:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951917.669067:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3627 00000100:00080000:3.0:1783951917.669070:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951917.669073:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951917.669083:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b17483ad80 x1870605465403136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951917.669099:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951917.669102:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951917.669104:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951917.669106:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3627 00000100:00080000:3.0:1783951917.669108:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951917.669111:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951917.669121:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04b600000 x1870605465403392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951917.669149:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465402752:0@lo:400:kworker.0 00000100:00100000:3.0:1783951917.669211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951917.669247:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951917.669254:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465403008:0@lo:400:kworker.0 00000100:00100000:3.0:1783951917.669287:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951917.672214:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465402752 00000100:00100000:3.0:1783951917.672230:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465402752 00000100:00100000:3.0:1783951917.672305:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465403008 00000100:00100000:3.0:1783951917.672308:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465403008 00000100:00100000:3.0:1783951917.672336:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1783951917.672347:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465402752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951917.672438:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465402752:12345-0@lo:400:kworker.0 Request processed in 92us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951917.672445:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1783951917.672461:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1783951917.672467:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465403008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951917.672507:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465403008:12345-0@lo:400:kworker.0 Request processed in 40us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951917.672513:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1783951917.672545:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465402624:0@lo:38:kworker.0 00000100:00100000:3.0:1783951917.672580:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951917.672623:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465402880:0@lo:38:kworker.0 00000100:00100000:3.0:1783951917.672647:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951917.672667:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465403136:0@lo:38:kworker.0 00000100:00100000:3.0:1783951917.672740:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951917.672758:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465403392:0@lo:38:kworker.0 00000100:00100000:3.0:1783951917.672789:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951917.672822:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465402624 00000100:00100000:3.0:1783951917.672826:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465402624 00000100:00100000:3.0:1783951917.672858:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465402880 00000100:00100000:3.0:1783951917.672871:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465402880 00000100:00100000:3.0:1783951917.673013:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465403392 00000100:00100000:3.0:1783951917.673018:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465403392 00000100:00100000:3.0:1783951917.673030:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1783951917.673035:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465402624:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951917.673055:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951917.673090:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465402624:12345-0@lo:38:kworker.0 Request processed in 54us (510us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951917.673097:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1783951917.673107:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1783951917.673110:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465402880:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951917.673119:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951917.673142:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465402880:12345-0@lo:38:kworker.0 Request processed in 30us (494us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951917.673147:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1783951917.673158:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1783951917.673162:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465403392:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951917.673170:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951917.673190:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465403392:12345-0@lo:38:kworker.0 Request processed in 27us (410us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951917.673196:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1783951917.673220:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465403264:0@lo:400:kworker.0 00000100:00100000:3.0:1783951917.673244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951917.673264:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951917.673271:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465402496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951917.673292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951917.673342:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465403008:0@lo:400:kworker.0 00000100:00100000:3.0:1783951917.673355:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465402752:0@lo:400:kworker.0 00000100:00080000:3.0:1783951917.673386:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951917.673390:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951917.673394:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465402624:0@lo:38:kworker.0 00000100:00080000:3.0:1783951917.673401:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951917.673404:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951917.673406:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465402880:0@lo:38:kworker.0 00000100:00080000:3.0:1783951917.673413:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951917.673415:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951917.673418:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465403392:0@lo:38:kworker.0 00000100:00100000:0.0:1783951917.673611:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465403136 00000100:00100000:0.0:1783951917.673617:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465403136 00000100:00100000:0.0:1783951917.673643:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:0.0:1783951917.673648:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465403136:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951917.673659:0:23862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951917.673692:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465403136:12345-0@lo:38:kworker.0 Request processed in 43us (952us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951917.673698:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:0.0:1783951917.673718:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465403264 00000100:00100000:0.0:1783951917.673721:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465403264 00000100:00100000:0.0:1783951917.673751:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:0.0:1783951917.673757:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465403264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951917.673806:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465403264:12345-0@lo:400:kworker.0 Request processed in 49us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951917.673812:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:0.0:1783951917.673833:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465402496 00000100:00100000:0.0:1783951917.673836:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465402496 00000100:00100000:0.0:1783951917.673858:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:0.0:1783951917.673864:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465402496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951917.673898:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951917.673934:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465402496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951917.673939:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00080000:0.0:1783951917.673962:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951917.673966:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951917.673993:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465402496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951917.674002:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465403264:0@lo:400:kworker.0 00000100:00080000:0.0:1783951917.674025:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951917.674029:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951917.674032:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465403136:0@lo:38:kworker.0 00000020:01000004:1.0:1783951918.170468:0:87119:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783951918.170483:0:87119:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783951918.170485:0:87119:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783951918.170646:0:87119:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97b176bcd000 00000020:01000004:1.0:1783951918.170671:0:87119:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1783951918.170704:0:87119:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783951918.170737:0:87119:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97b1449b4d40) 00000020:00000080:1.0:1783951918.170757:0:87119:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783951918.371976:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783951918.376808:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783951918.378635:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783951918.379090:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783951918.379330:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783951918.379573:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783951918.389120:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783951918.390039:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783951918.390551:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783951918.394291:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783951918.395505:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783951918.398400:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783951918.399909:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783951918.412848:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783951918.431229:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783951918.443260:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783951918.445783:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783951918.447846:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1783951918.448756:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1783951918.449095:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1783951918.449387:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783951918.449631:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.450359:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.450742:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.451202:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.451622:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.452039:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.452357:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.452654:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.453663:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.454075:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.454572:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.455209:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.455612:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.455889:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.456218:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.456619:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.457424:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.459711:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.462568:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.464755:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.466726:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.467229:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.467620:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783951918.468872:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783951918.470455:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1783951918.480617:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1783951918.490244:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1783951918.490801:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1783951918.492036:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1783951918.498168:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1783951918.498521:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1783951918.499158:0:87119:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1783951918.500227:0:87119:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783951918.504865:0:87119:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1783951918.504877:0:87119:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783951918.504893:0:87119:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb448f 00000020:01000004:1.0:1783951918.504901:0:87119:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1783951918.504913:0:87119:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1783951918.504918:0:87119:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b176bcd000 from MGS 00000020:01000004:1.0:1783951918.504922:0:87119:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1783951918.504934:0:87119:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97b1449b3380) 00000020:00000080:1.0:1783951918.504945:0:87119:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:1.0:1783951918.505004:0:87119:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b176bcd000 from MGS, refs=2 00080000:01000000:1.0:1783951918.505009:0:87119:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783951918.505013:0:87119:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb449d 00010000:00010000:1.0:1783951918.505126:0:87119:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1783951918.531296:0:87119:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783951918.534384:0:87123:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783951918.534455:0:87119:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783951918.534518:0:87119:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783951918.539276:0:87119:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783951918.539543:0:87119:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783951918.539737:0:87119:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783951918.539744:0:87119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783951918.540401:0:87119:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783951918.540409:0:87119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783951918.548790:0:87119:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783951918.548803:0:87119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783951918.549394:0:87119:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783951918.549417:0:87119:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1783951918.549419:0:87119:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1783951918.549422:0:87119:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1783951918.549433:0:87119:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 68, was 0): CONNECTING 00000100:00100000:1.0:1783951918.549437:0:87119:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:1.0:1783951918.577868:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951918.577944:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951918.578022:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951918.578270:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447698304 00000100:00100000:3.0:1783951918.578280:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447698304 00000100:00100000:3.0:1783951918.578319:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447698432 00000100:00100000:3.0:1783951918.578322:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447698432 00000100:00100000:2.0:1783951918.578336:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1118 00000100:00100000:2.0:1783951918.578345:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447698304:12345-192.168.202.48@tcp:38:kworker.0 00000100:00100000:3.0:1783951918.578369:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1100 00010000:00020000:2.0:1783951918.578369:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951918.578375:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447698432:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951918.578427:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447698304:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 81us (568us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951918.578434:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1118 00000100:00080000:1.0:1783951918.578436:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951918.580311:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447698560 00000100:00100000:0.0:1783951918.580323:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447698560 00000100:00100000:0.0:1783951918.580366:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:0.0:1783951918.580373:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b7a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1870605447698560:12345-192.168.202.48@tcp:250:kworker.0 00010000:00080000:0.0:1783951918.580399:0:87124:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e66faa19-2cbc-412c-8aef-9c55427739f8@192.168.202.48@tcp t0 exp 0000000000000000 cur 3633 last 0 00000020:00000080:0.0:1783951918.580427:0:87124:0:(genops.c:1406:class_connect()) connect: client e66faa19-2cbc-412c-8aef-9c55427739f8, cookie 0x22c73c7857bb44a4 00000100:00100000:3.0:1783951918.582447:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447698432:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 4062us (4414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951918.582472:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1100 00000100:00080000:0.0:1783951918.595283:0:87124:0:(import.c:65:import_set_state_nolock()) ffff97b04d9f6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951918.595383:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b7a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+5:2397:x1870605447698560:12345-192.168.202.48@tcp:250:kworker.0 Request processed in 15004us (17433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951918.595395:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00010000:00010000:3.0:1783951918.624852:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951919.648981:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951919.725051:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951919.725141:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447698688 00000100:00100000:0.0:1783951919.725150:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447698688 00000100:00100000:0.0:1783951919.725205:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:0.0:1783951919.725217:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b7aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+5:42446:x1870605447698688:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951919.725234:0:87127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951919.725255:0:87127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb44ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a194 expref: -99 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951919.725293:0:87127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb44ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a194 expref: 6 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951919.725304:0:87127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb44ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a194 expref: 6 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951919.725313:0:87127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc000, rc 0) 00000100:00100000:0.0:1783951919.725375:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b7aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447698688:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 159us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951919.725382:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:3.0:1783951919.744085:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951919.744323:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447698816 00000100:00100000:0.0:1783951919.744334:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447698816 00000100:00100000:0.0:1783951919.744389:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:0.0:1783951919.744399:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b7aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447698816:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783951919.744494:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b7aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447698816:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 Request processed in 96us (420us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783951919.744503:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:2.0:1783951919.759226:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951919.759519:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447698944 00000100:00100000:1.0:1783951919.759530:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447698944 00000100:00100000:1.0:1783951919.759621:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:1.0:1783951919.759632:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b7abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447698944:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951919.759650:0:87125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951919.759671:0:87125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86ac00/0x22c73c7857bb44b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a19b expref: -99 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951919.759699:0:87125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86ac00/0x22c73c7857bb44b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a19b expref: 7 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951919.759709:0:87125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86ac00/0x22c73c7857bb44b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a19b expref: 7 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951919.759717:0:87125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ac00, rc 0) 00000100:00100000:1.0:1783951919.759783:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b7abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+7:42446:x1870605447698944:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 153us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951919.759790:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:2.0:1783951919.762484:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951919.764407:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447699072 00000100:00100000:1.0:1783951919.764421:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447699072 00000100:00100000:1.0:1783951919.764501:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:1.0:1783951919.764512:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b7ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+7:42446:x1870605447699072:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783951919.771057:0:87128:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783951919.771263:0:87127:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 107 20000000:01000000:1.0:1783951919.773871:0:87129:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783951919.773880:0:87129:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1783951919.773883:0:87129:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783951919.773886:0:87129:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783951919.774335:0:87129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1783951919.774581:0:87127:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783951919.774691:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b7ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447699072:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 10176us (12222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951919.774702:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:3.0:1783951919.779650:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951919.779889:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447699200 00000100:00100000:0.0:1783951919.779898:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447699200 00000100:00100000:0.0:1783951919.779960:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:0.0:1783951919.779973:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447699200:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951919.780148:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447699200:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 177us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951919.780155:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5 00000100:00100000:2.0:1783951919.788236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951919.788630:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447699328 00000100:00100000:0.0:1783951919.788640:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447699328 00000100:00100000:0.0:1783951919.788695:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:0.0:1783951919.788706:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447699328:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951919.788726:0:87127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951919.788746:0:87127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb44b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1a2 expref: -99 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951919.788782:0:87127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb44b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1a2 expref: 9 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951919.788792:0:87127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb44b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1a2 expref: 9 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951919.788801:0:87127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbda00, rc 0) 00000100:00100000:0.0:1783951919.788861:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447699328:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 158us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951919.788885:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6 00000100:00100000:2.0:1783951919.792198:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951919.792343:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447699456 00000100:00100000:1.0:1783951919.792353:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447699456 00000100:00100000:1.0:1783951919.792409:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:1.0:1783951919.792419:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447699456:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951919.792624:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447699456:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 206us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951919.792632:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7 00000100:00100000:3.0:1783951919.795499:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951919.795699:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447699584 00000100:00100000:1.0:1783951919.795707:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447699584 00000100:00100000:1.0:1783951919.795745:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:1.0:1783951919.795754:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447699584:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951919.796075:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447699584:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 322us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951919.796083:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8 00000100:00100000:2.0:1783951919.804650:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951919.804746:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447699712 00000100:00100000:0.0:1783951919.804755:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447699712 00000100:00100000:0.0:1783951919.804825:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:0.0:1783951919.804835:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447699712:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951919.804856:0:87127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951919.804887:0:87127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbc400/0x22c73c7857bb44c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1a9 expref: -99 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951919.804923:0:87127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc400/0x22c73c7857bb44c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1a9 expref: 10 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951919.804936:0:87127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbc400/0x22c73c7857bb44c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1a9 expref: 10 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951919.804947:0:87127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc400, rc 0) 00000100:00100000:0.0:1783951919.805024:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447699712:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 191us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951919.805032:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9 00000100:00100000:3.0:1783951919.809333:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951919.809551:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447699840 00000100:00100000:1.0:1783951919.809561:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447699840 00000100:00100000:1.0:1783951919.809652:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10 00000100:00100000:1.0:1783951919.809663:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447699840:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951919.809794:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447699840:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 132us (469us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783951919.809821:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10 00010000:00010000:1.0:1783951920.672904:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951921.697653:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951922.723367:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951922.784948:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465403520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951922.785024:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951922.785077:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465403520 00000100:00100000:2.0:1783951922.785084:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465403520 00000100:00100000:2.0:1783951922.785128:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1783951922.785137:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b046acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465403520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951922.785165:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951922.785214:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b046acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465403520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951922.785221:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1783951922.785354:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465403520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951922.785383:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951912/real 1783951912] req@ffff97b04697e300 x1870605465401472/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951922 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951922.785401:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97b04697e300 x1870605465401472/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951922 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783951922.785415:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951922.785421:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783951922.785437:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04697e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465401472:0@lo:250:kworker.0 00000100:00080000:1.0:1783951922.785928:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951922.786054:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951922.786058:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783951922.786061:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951922.786065:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3627 00000100:00080000:1.0:1783951922.786069:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951922.786074:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951922.786093:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee3100 x1870605465403648/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951922.786110:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951922.786114:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951922.786115:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951922.786118:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3632 00000100:00080000:1.0:1783951922.786121:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951922.786124:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951922.786152:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee0700 x1870605465403776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951922.786178:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951922.786180:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951922.786182:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951922.786185:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3632 00000100:00080000:1.0:1783951922.786187:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951922.786197:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951922.786208:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee0380 x1870605465404032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951922.786222:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951922.786224:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951922.786226:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951922.786228:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3632 00000100:00080000:1.0:1783951922.786230:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951922.786233:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951922.786241:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee1500 x1870605465404288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951922.786262:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951922.786265:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951922.786267:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951922.786270:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3632 00000100:00080000:1.0:1783951922.786272:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783951922.786275:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951922.786285:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee2a00 x1870605465404544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951922.786306:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465404416:0@lo:400:kworker.0 00000100:00100000:1.0:1783951922.786350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1783951922.786403:0:87119:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:1.0:1783951922.786414:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465404416 00000100:00100000:1.0:1783951922.786419:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465404416 00010000:00010000:2.0:1783951922.786420:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14dc73e00/0x22c73c7857bb40d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb40d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.786437:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14dc73e00/0x22c73c7857bb40d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb40d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951922.786460:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:1.0:1783951922.786468:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465404416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951922.786517:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465404416:12345-0@lo:400:kworker.0 Request processed in 51us (167us total) trans 0 rc 0/0 10000000:01000000:2.0:1783951922.786518:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1783951922.786524:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00010000:00010000:2.0:1783951922.786527:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.786537:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14dc73e00/0x22c73c7857bb40d0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb40d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951922.786544:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783951922.786554:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1772f9a00/0x22c73c7857bb4036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb403d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.786560:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1772f9a00/0x22c73c7857bb4036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb403d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951922.786562:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465404416:0@lo:400:kworker.0 10000000:01000000:2.0:1783951922.786566:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951922.786569:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.786573:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1772f9a00/0x22c73c7857bb4036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb403d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00020000:1.0:1783951922.786579:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b049ee3100 x1870605465403648/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783951922.786581:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1413aa400/0x22c73c7857bb4052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4059 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.786634:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1413aa400/0x22c73c7857bb4052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4059 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.786638:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951922.786642:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.786647:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1413aa400/0x22c73c7857bb4052 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4059 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.786657:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1767e5200/0x22c73c7857bb407c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4083 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.786663:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1767e5200/0x22c73c7857bb407c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4083 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.786667:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951922.786670:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.786673:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1767e5200/0x22c73c7857bb407c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4083 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.786681:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1413aa600/0x22c73c7857bb408a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4091 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.786687:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1413aa600/0x22c73c7857bb408a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4091 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.786692:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951922.786695:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.786699:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1413aa600/0x22c73c7857bb408a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4091 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.786718:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1772f9800/0x22c73c7857bb40a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb40ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.786724:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1772f9800/0x22c73c7857bb40a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb40ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.786728:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951922.786740:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.786744:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1772f9800/0x22c73c7857bb40a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb40ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.786752:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1767e5e00/0x22c73c7857bb40b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb40bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.786759:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1767e5e00/0x22c73c7857bb40b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb40bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.786763:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951922.786766:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.786769:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1767e5e00/0x22c73c7857bb40b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb40bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.786776:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1413abe00/0x22c73c7857bb40de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb40e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.786782:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1413abe00/0x22c73c7857bb40de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb40e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.786787:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951922.786796:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.786801:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1413abe00/0x22c73c7857bb40de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb40e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.786816:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1772f8000/0x22c73c7857bb4044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb404b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.786822:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1772f8000/0x22c73c7857bb4044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb404b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.786828:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1783951922.787842:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465403904:0@lo:400:kworker.0 00000100:00100000:3.0:1783951922.787890:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951922.787920:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951922.787927:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465404160:0@lo:400:kworker.0 00000100:00100000:3.0:1783951922.787951:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951922.787996:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465403904 00000100:00100000:3.0:1783951922.788001:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465403904 00000100:00100000:3.0:1783951922.788039:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465404160 00000100:00100000:3.0:1783951922.788042:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465404160 00000100:00100000:3.0:1783951922.788062:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1783951922.788070:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465403904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951922.788126:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465403904:12345-0@lo:400:kworker.0 Request processed in 57us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951922.788237:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1783951922.788256:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1783951922.788263:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465404160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951922.788293:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465404160:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951922.788299:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00080000:3.0:1783951922.788315:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783951922.788338:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.788348:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1772f8000/0x22c73c7857bb4044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb404b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951922.788351:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465404160:0@lo:400:kworker.0 00000100:00100000:3.0:1783951922.788360:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465403904:0@lo:400:kworker.0 00010000:00010000:2.0:1783951922.788368:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1413aae00/0x22c73c7857bb4060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4067 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.788375:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1413aae00/0x22c73c7857bb4060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4067 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.788381:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1783951922.788394:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.788398:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1413aae00/0x22c73c7857bb4060 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4067 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.788411:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1767e5c00/0x22c73c7857bb406e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4075 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.788418:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1767e5c00/0x22c73c7857bb406e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4075 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.788514:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951922.788526:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.788532:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1767e5c00/0x22c73c7857bb406e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4075 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.788542:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1767e5600/0x22c73c7857bb4098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb409f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.788547:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1767e5600/0x22c73c7857bb4098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb409f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.788551:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951922.788555:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.788557:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1767e5600/0x22c73c7857bb4098 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb409f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.788565:0:87119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14dc72c00/0x22c73c7857bb40c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb40c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783951922.788571:0:87119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14dc72c00/0x22c73c7857bb40c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb40c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.788575:0:87119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783951922.788578:0:87119:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783951922.788580:0:87119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14dc72c00/0x22c73c7857bb40c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb40c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951922.788721:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951922.788740:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465404672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951922.788772:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951922.788802:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465404672 00000100:00100000:0.0:1783951922.788806:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465404672 00000100:00100000:0.0:1783951922.788831:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:0.0:1783951922.788837:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465404672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951922.788858:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951922.788896:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465404672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951922.788902:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:0.0:1783951922.788939:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465404672:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783951922.823782:0:87119:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 69, was 0): CONNECTING 00000100:00080000:1.0:1783951922.823783:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951922.823795:0:87119:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951922.823814:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00080000:2.0:1783951922.823820:0:87119:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3637 00000100:00100000:1.0:1783951922.823823:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465403648:0@lo:250:kworker.0 00000100:00080000:2.0:1783951922.823826:0:87119:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783951922.823837:0:87119:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951922.823897:0:87119:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14dee3100 x1870605465404800/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951922.823912:0:87119:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:3.0:1783951922.824241:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951922.824246:0:86521:0:(pinger.c:247:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783951922.825636:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465403776:0@lo:38:kworker.0 00000100:00100000:1.0:1783951922.825709:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951922.825754:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465404032:0@lo:38:kworker.0 00000100:00100000:3.0:1783951922.825764:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465403776 00000100:00100000:3.0:1783951922.825772:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465403776 00000100:00100000:1.0:1783951922.825775:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951922.825802:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465404288:0@lo:38:kworker.0 00000100:00100000:3.0:1783951922.825807:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465404032 00000100:00100000:3.0:1783951922.825809:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465404032 00000100:00100000:3.0:1783951922.825827:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1783951922.825827:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951922.825834:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465403776:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951922.825855:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951922.825896:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465403776:12345-0@lo:38:kworker.0 Request processed in 61us (187us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951922.825903:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1783951922.825904:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465404544:0@lo:38:kworker.0 00000100:00100000:3.0:1783951922.825919:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1783951922.825923:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465404032:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783951922.825937:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:3.0:1783951922.825945:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951922.825969:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465404800:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783951922.825980:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465404032:12345-0@lo:38:kworker.0 Request processed in 55us (203us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951922.825986:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1783951922.825994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951922.825995:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465404544 00000100:00100000:3.0:1783951922.825998:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465404544 00000100:00100000:3.0:1783951922.826012:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1783951922.826013:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465404800 00000100:00100000:3.0:1783951922.826016:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465404544:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783951922.826016:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465404800 00010000:00020000:3.0:1783951922.826025:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951922.826035:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783951922.826039:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3641:x1870605465404800:12345-0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783951922.826047:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465404544:12345-0@lo:38:kworker.0 Request processed in 30us (110us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951922.826052:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00010000:00080000:1.0:1783951922.826064:0:87125:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo t0 exp 0000000000000000 cur 3637 last 0 00000100:00100000:3.0:1783951922.826069:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465404288 00000100:00100000:3.0:1783951922.826072:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465404288 00000100:00100000:3.0:1783951922.826088:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:3.0:1783951922.826091:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465404288:12345-0@lo:38:kworker.0 00000020:00000080:1.0:1783951922.826091:0:87125:0:(genops.c:1406:class_connect()) connect: client 75da5dc4-aa7e-42cf-a965-1b5f01232c6f, cookie 0x22c73c7857bb44c7 00010000:00020000:3.0:1783951922.826100:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951922.826120:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465404288:12345-0@lo:38:kworker.0 Request processed in 28us (294us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951922.826125:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00080000:1.0:1783951922.826216:0:87125:0:(import.c:65:import_set_state_nolock()) ffff97b046484800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783951922.826342:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951922.826348:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951922.826351:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465403776:0@lo:38:kworker.0 00000100:00080000:0.0:1783951922.826359:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951922.826362:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951922.826365:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465404032:0@lo:38:kworker.0 00000100:00080000:0.0:1783951922.826371:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951922.826373:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951922.826375:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465404288:0@lo:38:kworker.0 00000100:00080000:0.0:1783951922.826382:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783951922.826385:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783951922.826387:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465404544:0@lo:38:kworker.0 00000100:00100000:1.0:1783951922.828002:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:3641:x1870605465404800:12345-0@lo:250:mount.lustre.0 Request processed in 1955us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951922.828016:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783951922.828393:0:3641:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.148@tcp: committing for last_committed 0 gen 25 00000100:00080000:0.0:1783951922.828404:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.148@tcp: connect to target with instance 0 00000100:00080000:0.0:1783951922.828413:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783951922.828418:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783951922.828423:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783951922.828426:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783951922.828459:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783951922.828468:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465404800:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1783951922.829134:0:86521:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.148@tcp 10000000:01000000:2.0:1783951922.829225:0:86521:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1783951922.829228:0:86521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783951922.829230:0:86521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783951922.829232:0:86521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951922.829233:0:86521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951922.829234:0:86521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951922.829236:0:86521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951922.829237:0:86521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951922.829239:0:86521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951922.829240:0:86521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783951922.829309:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:01000000:2.0:1783951922.829334:0:86521:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1783951922.829342:0:86521:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1783951922.829344:0:86521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783951922.829345:0:86521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783951922.829346:0:86521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951922.829348:0:86521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951922.829349:0:86521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951922.829350:0:86521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951922.829351:0:86521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951922.829352:0:86521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951922.829353:0:86521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783951922.829393:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951922.829408:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465405056:0@lo:253:kworker.0 00000100:00100000:3.0:1783951922.829463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951922.829515:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465405056 00000100:00100000:3.0:1783951922.829521:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465405056 00000100:00100000:3.0:1783951922.829559:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783951922.829574:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:3642:x1870605465405056:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783951922.829618:0:87127:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783951922.829632:0:87127:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1783951922.829712:0:87119:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1783951922.829721:0:87119:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783951922.829758:0:87119:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783951922.829763:0:87119:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783951922.829936:0:87119:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783951922.829962:0:87119:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783951922.829966:0:87119:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783951922.829967:0:87119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783951922.829968:0:87119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951922.829970:0:87119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951922.829971:0:87119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951922.829972:0:87119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951922.829973:0:87119:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783951922.829974:0:87119:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783951922.829975:0:87119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951922.829976:0:87119:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783951922.829979:0:87119:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783951922.829981:0:87119:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783951922.829982:0:87119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783951922.829984:0:87119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951922.829985:0:87119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951922.829986:0:87119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951922.829987:0:87119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951922.829988:0:87119:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783951922.829989:0:87119:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783951922.829990:0:87119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951922.829991:0:87119:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783951922.830007:0:87119:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783951922.830023:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465405184:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783951922.830057:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951922.830088:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1749b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951922.830685:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465405184 00000100:00100000:3.0:1783951922.830692:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465405184 00000100:00100000:3.0:1783951922.830742:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783951922.830750:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:87119:x1870605465405184:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783951922.830782:0:87125:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783951922.830785:0:87125:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783951922.830788:0:87125:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1783951922.830794:0:87125:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783951922.833359:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465404928:0@lo:253:kworker.0 00000100:00100000:0.0:1783951922.833442:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1783951922.833558:0:86521:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1783951922.833573:0:86521:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1783951922.833575:0:86521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783951922.833577:0:86521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783951922.833578:0:86521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951922.833580:0:86521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951922.833581:0:86521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951922.833582:0:86521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951922.833609:0:86521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951922.833611:0:86521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951922.833613:0:86521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783951922.833648:0:86521:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1783951922.833719:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951922.833729:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465405312:0@lo:253:kworker.0 00000100:00100000:0.0:1783951922.833769:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951922.833919:0:87124:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1783951922.833930:0:87124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1783951922.834470:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465404928 00000100:00100000:0.0:1783951922.834478:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465404928 00000100:00100000:0.0:1783951922.834515:0:87124:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1783951922.834522:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465405312 00000100:00100000:0.0:1783951922.834525:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465405312 00000100:00100000:3.0:1783951922.834665:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783951922.834676:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3643:x1870605465404928:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783951922.834703:0:87131:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1783951922.836421:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:87119:x1870605465405184:12345-0@lo:253:mount.lustre.0 Request processed in 5666us (6357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951922.836542:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783951922.836613:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783951922.836625:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:3645:x1870605465405312:12345-0@lo:253:kworker.0 00000100:00100000:2.0:1783951922.836648:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465405184:0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783951922.836650:0:87125:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1783951922.836660:0:87119:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783951922.836663:0:87119:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783951922.836664:0:87119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783951922.836665:0:87119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951922.836667:0:87119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951922.836668:0:87119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951922.836669:0:87119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951922.836670:0:87119:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951922.836672:0:87119:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783951922.836674:0:87119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951922.836675:0:87119:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783951922.836696:0:87119:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b176bcd000 from lustre-MDT0000 10000000:01000000:2.0:1783951922.836797:0:87119:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783951922.836800:0:87119:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783951922.836807:0:87119:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97b176bcd000 10000000:01000000:2.0:1783951922.836811:0:87119:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783951922.836816:0:87119:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97b176bcd000 10000000:01000000:2.0:1783951922.836819:0:87119:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783951922.836822:0:87119:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b176bcd000 from 1 10000000:01000000:2.0:1783951922.836825:0:87119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783951922.836857:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.836867:0:87119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.836876:0:87119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951922.836894:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465405440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951922.836939:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951922.836974:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1d900 going to sleep for 11 seconds 20000000:01000000:0.0:1783951922.837066:0:87127:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783951922.837079:0:87127:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783951922.837282:0:87131:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783951922.837480:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:3642:x1870605465405056:12345-0@lo:253:kworker.0 Request processed in 7905us (8015us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951922.837487:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951922.837509:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465405440 00000100:00100000:0.0:1783951922.837514:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465405440 00000100:00100000:0.0:1783951922.837534:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783951922.837540:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:87119:x1870605465405440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951922.837549:0:87127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951922.837561:0:87127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb44d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb44ce expref: -99 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951922.837582:0:87127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb44d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb44ce expref: 8 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951922.837615:0:87127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb44d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb44ce expref: 8 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951922.837624:0:87127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc200, rc 0) 00000100:00100000:0.0:1783951922.837657:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:87119:x1870605465405440:12345-0@lo:101:mount.lustre.0 Request processed in 117us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951922.837662:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000004:0.0:1783951922.837695:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783951922.837697:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783951922.837698:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951922.837699:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951922.837700:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951922.837702:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951922.837703:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951922.837704:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951922.837706:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783951922.837843:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465405056:0@lo:253:kworker.0 20000000:01000000:2.0:1783951922.837919:0:87128:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783951922.837923:0:87128:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783951922.837936:0:87128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.837949:0:87128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb44ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a194 expref: 9 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.837956:0:87128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.837981:0:87128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb44ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a194 expref: 9 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.837995:0:87128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb44ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a194 expref: 9 pid: 87127 timeout: 3737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951922.838007:0:87128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87128:1870605465405568:192.168.202.48@tcp:104: 00000100:00100000:2.0:1783951922.838069:0:87128:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1d840 going to sleep for 11 seconds 00000100:00100000:2.0:1783951922.838093:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465405440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951922.838106:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.838115:0:87119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.838127:0:87119:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783951922.838225:0:87119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.838233:0:87119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951922.838240:0:87119:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783951922.838244:0:87119:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783951922.838249:0:87119:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97b176bcd000 10000000:01000000:2.0:1783951922.838252:0:87119:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783951922.838256:0:87119:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783951922.838258:0:87119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783951922.838275:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.838282:0:87119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.838290:0:87119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951922.838303:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465405696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951922.838329:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951922.838342:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1d900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951922.838443:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465405696 00000100:00100000:0.0:1783951922.838448:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465405696 00000100:00100000:0.0:1783951922.838479:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783951922.838487:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:87119:x1870605465405696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951922.838496:0:87127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951922.838504:0:87127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb44ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb44e3 expref: -99 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951922.838517:0:87127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb44ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb44e3 expref: 9 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951922.838525:0:87127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb44ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb44e3 expref: 9 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951922.838532:0:87127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd600, rc 0) 00000100:00100000:0.0:1783951922.838568:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:87119:x1870605465405696:12345-0@lo:101:mount.lustre.0 Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951922.838573:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951922.838792:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465405696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951922.838802:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.838809:0:87119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951922.838866:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465405824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951922.838891:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951922.838920:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1d900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951922.839790:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465405824 00000100:00100000:3.0:1783951922.839797:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465405824 00000100:00100000:3.0:1783951922.839825:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783951922.839845:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:87119:x1870605465405824:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951922.839994:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87119:x1870605465405824:12345-0@lo:501:mount.lustre.0 Request processed in 162us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951922.840001:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783951922.840239:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465405824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951922.840280:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465405952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951922.840322:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951922.841850:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1d900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951922.843159:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465405952 00000100:00100000:3.0:1783951922.843173:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465405952 00000100:00100000:3.0:1783951922.843219:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783951922.843228:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87119:x1870605465405952:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951922.844809:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951922.846636:0:87128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87128:1870605465405568:192.168.202.48@tcp:104: 00010000:00010000:3.0:1783951922.846678:0:87128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951922.847104:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447699968 00000100:00100000:1.0:1783951922.847113:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447699968 00010000:00010000:1.0:1783951922.847159:0:22092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb44ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a194 expref: 10 pid: 87127 timeout: 3737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951922.847196:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2542 00000100:00100000:1.0:1783951922.847206:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447699968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783951922.847221:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951922.847228:0:22092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb44ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a194 expref: 10 pid: 87127 timeout: 3737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847240:0:22092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb44ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a194 expref: 10 pid: 87127 timeout: 3737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847256:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb44ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a194 expref: 10 pid: 87127 timeout: 3737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847273:0:22092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847289:0:22092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783951922.847304:0:22092:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009380397s 00010000:00010000:1.0:1783951922.847308:0:22092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847315:0:22092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847321:0:22092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847327:0:22092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847334:0:22092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ac00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951922.847338:0:22092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847345:0:22092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847359:0:22092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951922.847368:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951922.847420:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e66faa19-2cbc-412c-8aef-9c55427739f8+9:2401:x1870605447699968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 216us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951922.847428:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2542 00010000:00010000:2.0:1783951922.848249:0:87128:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.848260:0:87128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.848265:0:87128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb44dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951922.849410:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87119:x1870605465405952:12345-0@lo:503:mount.lustre.0 Request processed in 6179us (9084us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951922.849422:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783951922.850105:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465405952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951922.850384:0:87132:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87132:1870605465406080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951922.850438:0:87132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951922.851566:0:87132:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1d180 going to sleep for 11 seconds 00000100:00100000:3.0:1783951922.858755:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465406080 00000100:00100000:3.0:1783951922.858770:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465406080 00000100:00100000:3.0:1783951922.858814:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783951922.858824:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87132:x1870605465406080:12345-0@lo:502:llog_process_th.0 20000000:01000000:1.0:1783951922.863422:0:87131:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783951922.863448:0:87131:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783951922.863528:0:87128:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783951922.863533:0:87128:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783951922.863556:0:87128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.863584:0:87128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783951922.863610:0:87128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009380397s 00010000:00010000:2.0:1783951922.863615:0:87128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.863622:0:87128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.863629:0:87128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.863636:0:87128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.863643:0:87128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951922.863647:0:87128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.863656:0:87128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.863669:0:87128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.863676:0:87128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.863683:0:87128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b200/0x22c73c7857bb44f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951922.863805:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:3643:x1870605465404928:12345-0@lo:253:kworker.0 Request processed in 29128us (30359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951922.863815:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:2.0:1783951922.863858:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783951922.863861:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783951922.863862:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951922.863863:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951922.863865:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951922.863866:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951922.863868:0:3643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783951922.863870:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951922.863871:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783951922.863875:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465404928:0@lo:253:kworker.0 20000000:01000000:3.0:1783951922.864609:0:87125:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783951922.866636:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:87132:x1870605465406080:12345-0@lo:502:llog_process_th.0 Request processed in 7808us (16192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951922.866647:0:87132:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87132:1870605465406080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951922.866662:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000020:01000000:2.0:1783951922.866689:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951922.866699:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951922.866701:0:87132:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783951922.866706:0:87132:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783951922.866709:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951922.866724:0:87132:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97b0476acd40) 00000020:00000080:2.0:1783951922.866757:0:87132:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1783951922.866763:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783951922.866861:0:87132:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783951922.866868:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb44ff 00000020:00000080:2.0:1783951922.867145:0:87132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783951922.867150:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951922.867153:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951922.867155:0:87132:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783951922.867158:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951922.867161:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951922.867162:0:87132:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783951922.867166:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951922.867173:0:87132:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97b0476a8000) 00000020:00000080:2.0:1783951922.867186:0:87132:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1783951922.867202:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783951922.867204:0:87132:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783951922.867207:0:87132:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783951922.867214:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783951922.867506:0:87132:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b176bcd000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783951922.867521:0:87132:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97b0476a99c0) 00000020:00000080:2.0:1783951922.867533:0:87132:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1783951922.867631:0:87132:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783951922.867638:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4514 00000020:00000080:2.0:1783951922.867740:0:87132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783951922.867747:0:87132:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783951922.867752:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x22c73c7857bb451b 00080000:01000000:2.0:1783951922.867757:0:87132:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783951922.867761:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb4522 20000000:01000000:3.0:1783951922.871329:0:87125:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783951922.871343:0:87125:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1783951922.871702:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3645:x1870605465405312:12345-0@lo:253:kworker.0 Request processed in 35076us (37927us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951922.871714:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000004:0.0:1783951922.871841:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783951922.871844:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783951922.871845:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951922.871846:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951922.871848:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951922.871849:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951922.871850:0:3645:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951922.871852:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951922.871853:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783951922.871857:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465405312:0@lo:253:kworker.0 20000000:01000000:2.0:1783951922.872011:0:87128:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783951922.872016:0:87128:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783951922.872038:0:87128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.872053:0:87128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783951922.872062:0:87128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009380397s 00010000:00010000:2.0:1783951922.872066:0:87128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.872072:0:87128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.872078:0:87128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.872085:0:87128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.872101:0:87128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ac00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951922.872105:0:87128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.872113:0:87128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.872124:0:87128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.872132:0:87128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951922.872137:0:87128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4529 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951922.987083:0:87132:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1783951922.987220:0:87132:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 458183b2-4c6d-478c-9fed-a955779e6611 idx: 0 lr: 98784247815 srv lr: 103079215104 lx: 0 gen 23 00000001:00080000:3.0:1783951922.987261:0:87132:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 22 00000001:00000004:3.0:1783951922.987284:0:87132:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:3.0:1783951922.987367:0:87132:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1783951922.987411:0:87132:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b1434aa0c0: xid 1870605447691648, transno 103079215108, client gen 23, slot idx 0 00000001:00080000:3.0:1783951922.987418:0:87132:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b1434aac00: xid 1870605447691392, transno 103079215107, client gen 23, slot idx 1 00000020:00000080:3.0:1783951922.988259:0:87132:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97b0489bcd40) 00000020:00000080:3.0:1783951922.988280:0:87132:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1783951922.988349:0:87132:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783951922.988355:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb4545 00000020:00000080:2.0:1783951922.990377:0:87132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783951922.994462:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x22c73c7857bb454c 00000020:00000080:2.0:1783951922.995182:0:87132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783951922.995194:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951922.995201:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951922.995203:0:87132:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783951922.995206:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783951922.995209:0:87132:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1783951922.995211:0:87132:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951922.995212:0:87132:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951922.995214:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783951922.995216:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951922.995218:0:87132:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783951922.995220:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951922.995225:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951922.995232:0:87132:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783951922.995250:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783951922.995293:0:87132:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783951922.995307:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951922.995311:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951922.995312:0:87132:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783951922.995314:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951922.995318:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951922.995319:0:87132:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1783951922.995322:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783951922.995327:0:87132:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:00000080:2.0:1783951922.995351:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951922.995365:0:87132:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff97b0465d4d40) 00000020:00000080:2.0:1783951922.995383:0:87132:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1783951922.995388:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783951922.995448:0:87132:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1783951922.995454:0:87132:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783951922.995461:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb455a 00010000:00080000:2.0:1783951922.995494:0:87132:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b174b22800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:2.0:1783951922.998113:0:87132:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1783951923.002719:0:87132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951923.002743:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783951923.002792:0:87132:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783951923.002816:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4561 00000100:00080000:3.0:1783951923.002826:0:87132:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951923.002842:0:87132:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97b174b22800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951923.002876:0:87132:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b050d2c380 x1870605465406208/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951923.002905:0:87132:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783951923.002988:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951923.002993:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.002995:0:87132:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783951923.002998:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783951923.003001:0:87132:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1783951923.003003:0:87132:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951923.003004:0:87132:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951923.003006:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783951923.003008:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.003010:0:87132:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783951923.003012:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783951923.003017:0:87132:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783951923.003020:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.003022:0:87132:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783951923.003024:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783951923.003028:0:87132:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:3.0:1783951923.003053:0:87132:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783951923.003055:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951923.003068:0:87132:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97b0489b99c0) 00000020:00000080:3.0:1783951923.003084:0:87132:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783951923.003088:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783951923.003148:0:87132:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783951923.003166:0:87132:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783951923.003175:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb456f 00010000:00080000:3.0:1783951923.003204:0:87132:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b1762c7800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.148@tcp at head 00000100:00100000:0.0:1783951923.003352:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465406208:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1783951923.003394:0:87132:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1783951923.003413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.003570:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465406208 00000100:00100000:2.0:1783951923.003578:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465406208 00000100:00100000:2.0:1783951923.003631:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:2.0:1783951923.003638:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465406208:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783951923.003740:0:23862:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3637 last 0 00000020:00000080:3.0:1783951923.003770:0:23862:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4576 00000004:00100000:3.0:1783951923.003784:0:23862:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783951923.004031:0:23862:0:(import.c:65:import_set_state_nolock()) ffff97b1762c6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951923.004093:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465406208:12345-0@lo:38:llog_process_th.0 Request processed in 454us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951923.004100:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000100:00100000:0.0:1783951923.004374:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783951923.004383:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1783951923.004389:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783951923.004394:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783951923.004396:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b174b22800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783951923.004416:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465406208:0@lo:38:llog_process_th.0 00000040:01000000:3.0:1783951923.005025:0:87132:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783951923.005048:0:87132:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783951923.005122:0:87132:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000100:00100000:3.0:1783951923.005280:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951923.005291:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465406336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951923.005333:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1783951923.006420:0:87132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951923.006653:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465406336 00000100:00100000:2.0:1783951923.006661:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465406336 00000100:00100000:2.0:1783951923.006835:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:2.0:1783951923.006846:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465406336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951923.006879:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951923.006942:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465406336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.006957:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:2.0:1783951923.007016:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465406336:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783951923.007551:0:87132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:3.0:1783951923.007747:0:87132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:3.0:1783951923.013906:0:87138:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:3.0:1783951923.013914:0:87138:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783951923.014250:0:87138:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1783951923.014274:0:87138:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783951923.014407:0:87138:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:3.0:1783951923.014410:0:87138:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783951923.015883:0:87132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951923.015897:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783951923.015964:0:87132:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783951923.015992:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb457d 00000100:00080000:3.0:1783951923.016001:0:87132:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951923.016007:0:87132:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b1762c7800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951923.016044:0:87132:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b050d2fb80 x1870605465406464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951923.016073:0:87132:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783951923.016124:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951923.016128:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.016130:0:87132:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000100:00100000:1.0:1783951923.016132:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465406464:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1783951923.016133:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783951923.016136:0:87132:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1783951923.016137:0:87132:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951923.016139:0:87132:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783951923.016140:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783951923.016143:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.016144:0:87132:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783951923.016147:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783951923.016150:0:87132:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783951923.016154:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.016155:0:87132:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783951923.016158:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783951923.016160:0:87132:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:3.0:1783951923.016180:0:87132:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783951923.016182:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951923.016192:0:87132:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97b0489bb380) 00000100:00100000:1.0:1783951923.016206:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1783951923.016207:0:87132:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1783951923.016211:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1783951923.016272:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465406464 00000004:00080000:3.0:1783951923.016274:0:87132:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00000100:00100000:1.0:1783951923.016278:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465406464 00080000:01000000:3.0:1783951923.016279:0:87132:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1783951923.016284:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb458b 00000100:00100000:1.0:1783951923.016306:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4901 00010000:00080000:3.0:1783951923.016312:0:87132:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b046ae4800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.148@tcp at head 00000100:00100000:1.0:1783951923.016312:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3641:x1870605465406464:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783951923.016334:0:26204:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3637 last 0 00000020:00000080:1.0:1783951923.016357:0:26204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4592 00002000:00100000:1.0:1783951923.016368:0:26204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97b144763800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783951923.016372:0:26204:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783951923.016375:0:26204:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783951923.016439:0:26204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783951923.016458:0:26204:0:(import.c:65:import_set_state_nolock()) ffff97b144764000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951923.016506:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465406464:12345-0@lo:8:llog_process_th.0 Request processed in 192us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951923.016514:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4901 00000100:00100000:1.0:1783951923.016552:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783951923.016560:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783951923.016566:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783951923.016570:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783951923.016571:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1762c7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783951923.016580:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783951923.016616:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465406464:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1783951923.016651:0:87138:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783951923.016696:0:87138:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3637959107911ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783951923.016702:0:87138:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1783951923.019158:0:87132:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1783951923.019235:0:87132:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783951923.019251:0:87132:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783951923.019352:0:87132:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000004:00080000:1.0:1783951923.019583:0:87120:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783951923.020474:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465406592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951923.020540:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.021310:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465406592 00000100:00100000:2.0:1783951923.021319:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465406592 00000100:00100000:2.0:1783951923.021379:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1783951923.021389:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465406592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951923.021413:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951923.021471:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465406592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.021477:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00080000:3.0:1783951923.021573:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1783951923.022044:0:87132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951923.022079:0:87132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:0.0:1783951923.022202:0:87132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000100:00100000:1.0:1783951923.022468:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465406592:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1783951923.028947:0:87140:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:1.0:1783951923.028955:0:87140:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1783951923.029153:0:87140:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:1.0:1783951923.029176:0:87140:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1783951923.029331:0:87140:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:1.0:1783951923.029335:0:87140:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783951923.034181:0:87132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951923.034208:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783951923.034375:0:87132:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783951923.034402:0:87132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4599 00000100:00080000:3.0:1783951923.034413:0:87132:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783951923.034419:0:87132:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97b046ae4800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951923.034466:0:87132:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b050d2ca80 x1870605465406720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951923.034527:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465406720:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783951923.034648:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951923.034750:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465406720 00000100:00100000:0.0:1783951923.034757:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465406720 00000100:00100000:0.0:1783951923.034813:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4902 00000100:00100000:0.0:1783951923.034820:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1870605465406720:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783951923.034848:0:8436:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3637 last 0 00000020:00000080:0.0:1783951923.034885:0:8436:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb45a0 00002000:00100000:0.0:1783951923.034911:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97b04d9f2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783951923.034915:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783951923.034918:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783951923.034992:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783951923.035014:0:8436:0:(import.c:65:import_set_state_nolock()) ffff97b04d9f5000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1783951923.035091:0:87132:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783951923.035164:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951923.035168:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.035171:0:87132:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783951923.035174:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951923.035178:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.035179:0:87132:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783951923.035183:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783951923.035184:0:87132:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783951923.035187:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951923.035189:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.035190:0:87132:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783951923.035192:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951923.035195:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.035196:0:87132:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783951923.035199:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783951923.035225:0:87132:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87132:1870605465406848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951923.035279:0:87132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951923.035303:0:87132:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f397180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951923.037081:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465406720:12345-0@lo:8:llog_process_th.0 Request processed in 2252us (2426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.037093:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4902 00000100:00100000:0.0:1783951923.041506:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465406848 00000100:00100000:0.0:1783951923.041521:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465406848 00000100:00100000:0.0:1783951923.041653:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783951923.041664:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:87132:x1870605465406848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951923.041862:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:87132:x1870605465406848:12345-0@lo:502:llog_process_th.0 Request processed in 199us (6582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.041870:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783951923.042172:0:87132:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87132:1870605465406848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783951923.042208:0:87132:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951923.042215:0:87132:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.042217:0:87132:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783951923.042222:0:87132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1783951923.042540:0:87119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1783951923.042563:0:87119:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783951923.042601:0:87119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.042613:0:87119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951923.042620:0:87119:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b176bcd000 from 1 10000000:01000000:2.0:1783951923.042623:0:87119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:1.0:1783951923.042636:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00010000:2.0:1783951923.042656:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.042663:0:87119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.042672:0:87119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783951923.042693:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783951923.042701:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:2.0:1783951923.042704:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049893b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465406976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951923.042756:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783951923.042775:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783951923.042780:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046ae4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783951923.042795:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783951923.042796:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951923.042800:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465406720:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783951923.042877:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465407104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951923.042909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783951923.042965:0:87140:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783951923.043064:0:87140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3637985475160ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783951923.043071:0:87140:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783951923.043168:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465406976 00000100:00100000:0.0:1783951923.043174:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465406976 00000100:00100000:0.0:1783951923.043215:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783951923.043223:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:87119:x1870605465406976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951923.043398:0:87124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951923.043415:0:87124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb45ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb45a7 expref: -99 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.043448:0:87124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb45ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb45a7 expref: 9 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.043459:0:87124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb45ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb45a7 expref: 9 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.043476:0:87124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbde00, rc 0) 00000100:00100000:0.0:1783951923.043513:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:87119:x1870605465406976:12345-0@lo:101:mount.lustre.0 Request processed in 291us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.043520:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783951923.046074:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465407104 00000100:00100000:3.0:1783951923.046088:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465407104 00000100:00100000:3.0:1783951923.046168:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:3.0:1783951923.046179:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465407104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951923.046205:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783951923.046362:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951923.047188:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049893b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465406976:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951923.047211:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.047224:0:87119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951923.047815:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465407232:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783951923.047875:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951923.047923:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ec4d240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951923.048056:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465407232 00000100:00100000:1.0:1783951923.048062:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465407232 00000100:00100000:1.0:1783951923.048105:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783951923.048115:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:87119:x1870605465407232:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783951923.048137:0:87127:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783951923.048154:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783951923.048158:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783951923.048162:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783951923.048164:0:87127:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 110 00000100:00100000:1.0:1783951923.048245:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:87119:x1870605465407232:12345-0@lo:256:mount.lustre.0 Request processed in 132us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951923.048253:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783951923.048563:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465407232:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783951923.049202:0:87119:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783951923.049228:0:87119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.049245:0:87119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951923.049253:0:87119:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b176bcd000 from 1 10000000:01000000:0.0:1783951923.049255:0:87119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951923.049284:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.049304:0:87119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.049313:0:87119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951923.049331:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465407360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951923.049370:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951923.049403:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ec4d240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951923.049427:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465407360 00000100:00100000:0.0:1783951923.049432:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465407360 00000100:00100000:0.0:1783951923.049464:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783951923.049472:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:87119:x1870605465407360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951923.049484:0:87125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951923.049495:0:87125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbd800/0x22c73c7857bb45bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb45b5 expref: -99 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.049514:0:87125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbd800/0x22c73c7857bb45bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb45b5 expref: 10 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.049523:0:87125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbd800/0x22c73c7857bb45bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb45b5 expref: 10 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.049532:0:87125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd800, rc 0) 00000100:00100000:0.0:1783951923.049562:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87119:x1870605465407360:12345-0@lo:101:mount.lustre.0 Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.049568:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783951923.051802:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465407360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951923.051839:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.051851:0:87119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951923.051939:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465407488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951923.052000:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951923.052089:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ec4d240 going to sleep for 11 seconds 00000100:00100000:3.0:1783951923.052636:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465407104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6455us (9720us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951923.052649:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00100000:2.0:1783951923.055286:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465407104:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1783951923.055538:0:87120:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783951923.055676:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465407488 00000100:00100000:1.0:1783951923.055684:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465407488 00000100:00100000:1.0:1783951923.055824:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783951923.055833:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87119:x1870605465407488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783951923.056050:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87119:x1870605465407488:12345-0@lo:501:mount.lustre.0 Request processed in 218us (4048us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951923.056057:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783951923.059174:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465407488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951923.059553:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465407616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951923.059653:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951923.059685:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f397180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951923.059759:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465407616 00000100:00100000:0.0:1783951923.059766:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465407616 00000100:00100000:0.0:1783951923.059819:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783951923.059828:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87119:x1870605465407616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951923.059945:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87119:x1870605465407616:12345-0@lo:503:mount.lustre.0 Request processed in 118us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.059952:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783951923.059971:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465407616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951923.060576:0:87142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049893b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87142:1870605465407744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951923.060772:0:87142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951923.060803:0:87142:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951923.061847:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465407744 00000100:00100000:0.0:1783951923.061857:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465407744 00000100:00100000:0.0:1783951923.061904:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783951923.061913:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87142:x1870605465407744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951923.063374:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87142:x1870605465407744:12345-0@lo:502:llog_process_th.0 Request processed in 1455us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.063386:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783951923.063564:0:87142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049893b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87142:1870605465407744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783951923.063619:0:87142:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951923.063629:0:87142:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.063632:0:87142:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783951923.063637:0:87142:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b176bcd000 00000020:00000080:3.0:1783951923.063640:0:87142:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783951923.063647:0:87142:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951923.063655:0:87142:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.063656:0:87142:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783951923.063659:0:87142:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951923.063662:0:87142:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.063663:0:87142:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783951923.063666:0:87142:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b176bcd000 00000020:00000080:3.0:1783951923.063668:0:87142:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783951923.063764:0:87142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87142:1870605465407872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951923.063809:0:87142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951923.063854:0:87142:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f397180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951923.065290:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465407872 00000100:00100000:0.0:1783951923.065300:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465407872 00000100:00100000:0.0:1783951923.065355:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783951923.065365:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87142:x1870605465407872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951923.065517:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87142:x1870605465407872:12345-0@lo:502:llog_process_th.0 Request processed in 154us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.065525:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783951923.065579:0:87142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87142:1870605465407872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783951923.065637:0:87142:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951923.065645:0:87142:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951923.065647:0:87142:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783951923.065651:0:87142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783951923.065851:0:87119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1783951923.065873:0:87119:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783951923.065896:0:87119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.065907:0:87119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951923.065973:0:87119:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783951923.065976:0:87119:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97b176bcd000 10000000:01000000:2.0:1783951923.065979:0:87119:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97b176bcd000 10000000:01000000:2.0:1783951923.065982:0:87119:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783951923.065988:0:87119:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b176bcd000 from 1 10000000:01000000:2.0:1783951923.065991:0:87119:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783951923.066020:0:87119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.066028:0:87119:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.066044:0:87119:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951923.066062:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465408000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951923.066097:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.066133:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1d180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951923.072465:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465408000 00000100:00100000:0.0:1783951923.072477:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465408000 00000100:00100000:0.0:1783951923.072524:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783951923.072533:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:87119:x1870605465408000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951923.072549:0:87127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951923.072566:0:87127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbd000/0x22c73c7857bb45ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb45c3 expref: -99 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.072609:0:87127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbd000/0x22c73c7857bb45ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb45c3 expref: 11 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.072620:0:87127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbd000/0x22c73c7857bb45ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb45c3 expref: 11 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951923.072629:0:87127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd000, rc 0) 00000100:00100000:0.0:1783951923.072696:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87119:x1870605465408000:12345-0@lo:101:mount.lustre.0 Request processed in 165us (6599us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.072703:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783951923.076070:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465408000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951923.076098:0:87119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.076111:0:87119:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951923.076206:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465408128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951923.076275:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.076314:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1d180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951923.076341:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465408128 00000100:00100000:2.0:1783951923.076347:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465408128 00000100:00100000:2.0:1783951923.076386:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783951923.076395:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87119:x1870605465408128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951923.076527:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87119:x1870605465408128:12345-0@lo:501:mount.lustre.0 Request processed in 132us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.076533:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783951923.076570:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465408128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951923.076621:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465408256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951923.076670:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.076690:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1d180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951923.076703:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465408256 00000100:00100000:2.0:1783951923.076717:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465408256 00000100:00100000:2.0:1783951923.076748:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783951923.076756:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87119:x1870605465408256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951923.076841:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87119:x1870605465408256:12345-0@lo:503:mount.lustre.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.076847:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783951923.076889:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465408256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951923.077099:0:87144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87144:1870605465408384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951923.077130:0:87144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.077148:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465408384 00000100:00100000:2.0:1783951923.077151:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465408384 00000100:00100000:2.0:1783951923.077171:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783951923.077177:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87144:x1870605465408384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951923.077240:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87144:x1870605465408384:12345-0@lo:502:llog_process_th.0 Request processed in 62us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.077246:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783951923.077272:0:87144:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1d180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951923.077283:0:87144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87144:1870605465408384:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783951923.077329:0:87144:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783951923.077343:0:87144:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97b14545cd40) 00000020:00000080:2.0:1783951923.077366:0:87144:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783951923.077504:0:87144:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b176bcd000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783951923.077513:0:87144:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b176bcd000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783951923.077516:0:87144:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b176bcd000 4 00010000:00080000:2.0:1783951923.077548:0:87144:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b1447cd000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:2.0:1783951923.079161:0:87144:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1783951923.079265:0:87144:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783951923.079308:0:87144:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783951923.079318:0:87144:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x22c73c7857bb45d8 00000100:00080000:2.0:1783951923.079328:0:87144:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783951923.079333:0:87144:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b1447cd000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951923.079365:0:87144:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049892d80 x1870605465408512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951923.079388:0:87144:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783951923.079422:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951923.079427:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951923.079430:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951923.079434:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3637 00000100:00080000:2.0:1783951923.079437:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951923.079440:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951923.079454:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049893b80 x1870605465408640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951923.079482:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951923.079486:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951923.079487:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951923.079491:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3637 00000100:00080000:2.0:1783951923.079493:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951923.079497:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951923.079516:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14f0d6d80 x1870605465408896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951923.079534:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951923.079537:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951923.079539:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951923.079542:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3637 00000100:00080000:2.0:1783951923.079544:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951923.079548:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951923.079557:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14f0d4e00 x1870605465409152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951923.079608:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951923.079612:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951923.079614:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951923.079617:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3637 00000100:00080000:2.0:1783951923.079620:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783951923.079623:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951923.079634:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14f0d4000 x1870605465409536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951923.079677:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465408768:0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080074:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465409024:0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080111:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465409280:0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080135:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951923.080162:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465409920:0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080180:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951923.080197:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951923.080202:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465409408:0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080230:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951923.080259:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465409280 00000100:00100000:1.0:1783951923.080266:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465409280 00000100:00100000:1.0:1783951923.080302:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465409920 00000100:00100000:1.0:1783951923.080305:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465409920 00000100:00100000:1.0:1783951923.080322:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465409408 00000100:00100000:1.0:1783951923.080325:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465409408 00000100:00100000:1.0:1783951923.080345:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:1.0:1783951923.080354:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465409280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080401:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465409280:12345-0@lo:400:kworker.0 Request processed in 48us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951923.080409:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:1.0:1783951923.080425:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:1.0:1783951923.080430:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465409920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080456:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465409920:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951923.080462:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00100000:1.0:1783951923.080474:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1783951923.080480:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465409408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080504:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465409408:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951923.080510:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1783951923.080556:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465409408:0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080567:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465409280:0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080575:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465409920:0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.080636:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465408512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783951923.092414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.092488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.092519:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465409792:0@lo:400:kworker.0 00000100:00100000:2.0:1783951923.092580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.093093:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465408768 00000100:00100000:2.0:1783951923.093106:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465408768 00000100:00100000:2.0:1783951923.093200:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465409024 00000100:00100000:2.0:1783951923.093204:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465409024 00000100:00100000:2.0:1783951923.093228:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:2.0:1783951923.093237:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465408768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951923.093294:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465408768:12345-0@lo:400:kworker.0 Request processed in 58us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.093302:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:2.0:1783951923.093317:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1783951923.093322:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465409024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951923.093354:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465409024:12345-0@lo:400:kworker.0 Request processed in 32us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.093360:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1783951923.093380:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465409792 00000100:00100000:2.0:1783951923.093385:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465409792 00000100:00100000:2.0:1783951923.093408:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:2.0:1783951923.093414:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465409792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951923.093443:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465409792:12345-0@lo:400:kworker.0 Request processed in 29us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.093448:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:2.0:1783951923.093496:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465409024:0@lo:400:kworker.0 00000100:00100000:2.0:1783951923.093507:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465409792:0@lo:400:kworker.0 00000100:00100000:2.0:1783951923.093540:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465408768:0@lo:400:kworker.0 00000100:00100000:2.0:1783951923.093548:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465409664:0@lo:400:kworker.0 00000100:00100000:2.0:1783951923.093576:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.093632:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465409664 00000100:00100000:2.0:1783951923.093636:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465409664 00000100:00100000:2.0:1783951923.093674:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:2.0:1783951923.093680:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465409664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951923.094068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951923.094134:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465408512 00000100:00100000:3.0:1783951923.094139:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465408512 00000100:00100000:3.0:1783951923.094162:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1783951923.094167:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465408512:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783951923.099619:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465408640:0@lo:38:kworker.0 00000100:00100000:1.0:1783951923.099698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951923.099739:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465408896:0@lo:38:kworker.0 00000100:00100000:1.0:1783951923.099765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951923.099783:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465409152:0@lo:38:kworker.0 00000100:00100000:1.0:1783951923.099809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951923.099842:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465409536:0@lo:38:kworker.0 00000100:00100000:1.0:1783951923.099865:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951923.099916:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465408640 00000100:00100000:1.0:1783951923.099923:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465408640 00000100:00100000:1.0:1783951923.099946:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465408896 00000100:00100000:1.0:1783951923.099948:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465408896 00000100:00100000:1.0:1783951923.099956:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465409536 00000100:00100000:1.0:1783951923.099957:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465409536 00000100:00100000:1.0:1783951923.099969:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1783951923.099975:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465408640:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783951923.100034:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465408640:12345-0@lo:38:kworker.0 Request processed in 57us (336us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783951923.100040:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1783951923.100058:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1783951923.100062:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465408896:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783951923.100090:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465408896:12345-0@lo:38:kworker.0 Request processed in 26us (323us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783951923.100095:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1783951923.100117:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1783951923.100121:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465409536:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783951923.100150:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465409536:12345-0@lo:38:kworker.0 Request processed in 27us (284us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783951923.100155:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00080000:1.0:1783951923.100204:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951923.100209:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951923.100212:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465408640:0@lo:38:kworker.0 00000100:00080000:1.0:1783951923.100221:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951923.100224:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951923.100226:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465408896:0@lo:38:kworker.0 00000100:00080000:1.0:1783951923.100233:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951923.100237:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951923.100239:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465409536:0@lo:38:kworker.0 00000100:00100000:0.0:1783951923.101967:0:87144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87144:1870605465410048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951923.102034:0:87144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951923.102068:0:87144:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b17496d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783951923.105515:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465408512:12345-0@lo:38:llog_process_th.0 Request processed in 11341us (11441us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783951923.105529:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:0.0:1783951923.106233:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465410048 00000100:00100000:0.0:1783951923.106243:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465410048 00000100:00100000:0.0:1783951923.106299:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783951923.106308:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87144:x1870605465410048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951923.106448:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87144:x1870605465410048:12345-0@lo:502:llog_process_th.0 Request processed in 142us (4413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.106456:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783951923.106498:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465409152 00000100:00100000:0.0:1783951923.106503:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465409152 00000100:00100000:0.0:1783951923.106524:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:0.0:1783951923.106529:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465409152:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783951923.106572:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465409152:12345-0@lo:38:kworker.0 Request processed in 42us (6762us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783951923.106579:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00100000:1.0:1783951923.107867:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783951923.107879:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1447cd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951923.107884:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951923.107888:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465408512:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783951923.107901:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951923.107904:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951923.107908:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465409152:0@lo:38:kworker.0 00000100:00100000:0.0:1783951923.109629:0:87144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87144:1870605465410048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951923.109753:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465409664:12345-0@lo:400:kworker.0 Request processed in 16069us (16173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.109764:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:2.0:1783951923.109846:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465409664:0@lo:400:kworker.0 00000100:00100000:0.0:1783951923.110330:0:87144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87144:1870605465410176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951923.110399:0:87144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951923.110426:0:87144:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b17496d000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951923.112247:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465410176 00000100:00100000:2.0:1783951923.112259:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465410176 00000100:00100000:2.0:1783951923.112316:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783951923.112327:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87144:x1870605465410176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951923.112485:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87144:x1870605465410176:12345-0@lo:502:llog_process_th.0 Request processed in 160us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.112493:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783951923.112554:0:87144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87144:1870605465410176:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783951923.112613:0:87144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783951923.113934:0:87119:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783951923.113967:0:87119:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783951923.113991:0:87119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.114003:0:87119:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783951923.114057:0:87119:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783951923.114059:0:87119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783951923.114065:0:87119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951923.114066:0:87119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951923.114067:0:87119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951923.114068:0:87119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951923.114070:0:87119:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951923.114071:0:87119:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783951923.114073:0:87119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951923.114074:0:87119:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783951923.114078:0:87119:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783951923.114080:0:87119:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783951923.114081:0:87119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783951923.114082:0:87119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783951923.114083:0:87119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783951923.114084:0:87119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783951923.114085:0:87119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783951923.114086:0:87119:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783951923.114087:0:87119:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783951923.114087:0:87119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783951923.114088:0:87119:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783951923.114111:0:87119:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783951923.114130:0:87119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465410304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783951923.114392:0:87119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.114906:0:87119:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951923.121983:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465410304 00000100:00100000:1.0:1783951923.122000:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465410304 00000100:00100000:1.0:1783951923.122106:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783951923.122117:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87119:x1870605465410304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783951923.122170:0:87131:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783951923.122183:0:87131:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783951923.131086:0:87131:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783951923.131106:0:87131:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783951923.131297:0:87128:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783951923.131302:0:87128:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783951923.131329:0:87128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.131351:0:87128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb45ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb45a7 expref: 11 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.131360:0:87128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.131402:0:87128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb45ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb45a7 expref: 11 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.131448:0:87128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb45ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb45a7 expref: 11 pid: 87124 timeout: 3738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951923.131463:0:87128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87128:1870605465410432:0@lo:104: 00000100:00100000:2.0:1783951923.131530:0:87128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.131570:0:87128:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434a8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951923.131878:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783951923.131897:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465410432 00000100:00100000:1.0:1783951923.131904:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465410432 00000100:00100000:1.0:1783951923.131953:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1783951923.131963:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:87128:x1870605465410432:12345-0@lo:104: 00010000:00010000:1.0:1783951923.131976:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951923.132037:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783951923.132043:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:87128:x1870605465410432:12345-0@lo:104: Request processed in 82us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951923.132049:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00010000:3.0:1783951923.132290:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951923.132297:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132305:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b200 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783951923.132309:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132328:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783951923.132335:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951923.132340:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783951923.132368:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132373:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783951923.132395:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132402:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb45a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb45ae expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132418:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951923.132420:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951923.132422:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951923.132444:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465410560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951923.132478:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951923.132527:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465410560 00000100:00100000:3.0:1783951923.132532:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465410560 00010000:00010000:3.0:1783951923.132551:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb45ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb45a7 expref: 12 pid: 87124 timeout: 3738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951923.132573:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:3.0:1783951923.132579:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:3643:x1870605465410560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951923.132620:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951923.132626:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb45ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb45a7 expref: 12 pid: 87124 timeout: 3738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132636:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb45ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb45a7 expref: 12 pid: 87124 timeout: 3738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132652:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132660:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783951923.132674:0:7927:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009380397s 00010000:00010000:3.0:1783951923.132678:0:7927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132685:0:7927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132692:0:7927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132698:0:7927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132702:0:7927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216bc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951923.132718:0:7927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132726:0:7927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132750:0:7927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951923.132760:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951923.132788:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:3643:x1870605465410560:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951923.132795:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:3.0:1783951923.133018:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465410560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783951923.133159:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:87119:x1870605465410304:12345-0@lo:253:mount.lustre.0 Request processed in 11043us (18766us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.133168:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1783951923.133343:0:87128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb45ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb45a7 expref: 10 pid: 87124 timeout: 3738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951923.133353:0:87128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87128:1870605465410432:0@lo:104: 00010000:00010000:2.0:1783951923.133367:0:87128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.133375:0:87128:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.133381:0:87128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951923.133386:0:87128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216bc00/0x22c73c7857bb45df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951923.133538:0:87119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:87119:1870605465410304:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783951923.133548:0:87119:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783951923.133551:0:87119:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783951923.133553:0:87119:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783951923.133554:0:87119:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951923.133555:0:87119:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951923.133557:0:87119:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951923.133558:0:87119:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951923.133559:0:87119:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951923.133561:0:87119:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783951923.133563:0:87119:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951923.133564:0:87119:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783951923.133576:0:87119:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1783951923.162260:0:87119:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411352 00000040:01000000:2.0:1783951923.164454:0:87119:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783951923.164652:0:87150:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411352 00000020:00080000:1.0:1783951923.164657:0:87150:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411352 00000040:01000000:1.0:1783951923.165099:0:87151:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783951923.165402:0:87119:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1783951923.166122:0:87151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951923.168298:0:87152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87152:1870605465410688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951923.168368:0:87152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.168406:0:87152:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434a8540 going to sleep for 11 seconds 00000040:01000000:3.0:1783951923.169707:0:87119:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783951923.169775:0:87119:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783951923.170275:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465410688 00000100:00100000:0.0:1783951923.170284:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465410688 00000100:00100000:0.0:1783951923.170333:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:0.0:1783951923.170343:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87152:x1870605465410688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783951923.170453:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87152:x1870605465410688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 111us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.170461:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000040:00080000:1.0:1783951923.172510:0:87151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783951923.172639:0:87151:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1783951923.174370:0:87152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87152:1870605465410688:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1783951923.174443:0:87152:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783951923.174497:0:87152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87152:1870605465410816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951923.174562:0:87152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951923.174624:0:87152:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434a8540 going to sleep for 11 seconds 00000100:00100000:0.0:1783951923.174786:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465410816 00000100:00100000:0.0:1783951923.174793:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465410816 00000100:00100000:0.0:1783951923.174847:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:0.0:1783951923.174856:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87152:x1870605465410816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783951923.174992:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87152:x1870605465410816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 137us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.174999:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000004:00000080:3.0:1783951923.176499:0:87119:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783951923.177360:0:87119:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783951923.177484:0:87119:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951923.177963:0:87152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87152:1870605465410816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783951923.178054:0:87152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87152:1870605465410944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783951923.178106:0:87152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951923.178171:0:87152:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1429ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1783951923.178246:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465410944 00000100:00100000:0.0:1783951923.178252:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465410944 00000100:00100000:0.0:1783951923.178332:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:0.0:1783951923.178341:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87152:x1870605465410944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783951923.178421:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87152:x1870605465410944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951923.178437:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00100000:1.0:1783951923.178491:0:87152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2f480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87152:1870605465410944:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783951923.178529:0:87152:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951923.178739:0:87119:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783951923.179474:0:87119:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783951923.179505:0:87119:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783951923.179617:0:87119:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783951923.180094:0:87119:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00000040:00080000:1.0:1783951923.180791:0:87152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783951923.180850:0:87152:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783951923.180854:0:87152:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1783951923.188285:0:87119:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215108 00010000:00080000:2.0:1783951923.191905:0:87153:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87153 00010000:02000000:2.0:1783951923.191962:0:87153:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1783951923.191966:0:87153:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783951923.191969:0:87153:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1783951923.193808:0:87119:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783951923.193827:0:87119:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783951923.193948:0:87119:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783951923.193971:0:87119:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783951923.198239:0:87119:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951923.198522:0:87119:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783951923.698128:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951923.698237:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447700224 00000100:00100000:1.0:1783951923.698254:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447700224 00000100:00100000:1.0:1783951923.698304:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1126 00000100:00100000:1.0:1783951923.698312:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447700224:12345-192.168.202.48@tcp:38:kworker.0 00010000:00080000:1.0:1783951923.698346:0:66237:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '458183b2-4c6d-478c-9fed-a955779e6611' at ffff97b174b17000, cookie 0x22c73c7857bb4530 00010000:00080000:1.0:1783951923.698351:0:66237:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp recovering/t103079215109 exp ffff97b174b17000 cur 3638 last 1783951922 00010000:02000400:1.0:1783951923.698360:0:66237:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1783951923.698365:0:66237:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1783951923.698386:0:66237:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783951923.698530:0:66237:0:(import.c:65:import_set_state_nolock()) ffff97b04b215800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951923.698633:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447700224:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 320us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951923.698642:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1126 00000100:00100000:0.0:1783951923.700732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951923.700815:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447700096 00000100:00100000:2.0:1783951923.700824:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447700096 00000100:00100000:2.0:1783951923.700870:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:2.0:1783951923.700880:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+9:2399:x1870605447700096:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951923.700950:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+9:2399:x1870605447700096:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 72us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951923.700957:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:2.0:1783951923.704669:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951923.704791:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447692416 00000100:00100000:3.0:1783951923.704802:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447692416 00000100:00100000:3.0:1783951923.704864:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1127 00000100:00100000:3.0:1783951923.704876:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447692416:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00080000:3.0:1783951923.704896:0:67035:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215109, current: 103079215109, replaying 00000100:00100000:3.0:1783951923.704915:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447692416:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 44us (256us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783951923.704922:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1127 00010000:00080000:0.0:1783951923.705082:0:87153:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1783951923.710971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951923.711196:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447700352 00000100:00100000:3.0:1783951923.711207:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447700352 00000100:00100000:3.0:1783951923.711278:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1105 00000100:00100000:3.0:1783951923.711290:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447700352:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951923.711361:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447700352:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 75us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951923.711369:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1105 00000100:00080000:1.0:1783951923.711671:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783951923.744934:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951924.078794:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951924.081585:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447700480 00000100:00100000:3.0:1783951924.081622:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447700480 00000100:00100000:3.0:1783951924.081698:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:3.0:1783951924.081710:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447700480:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951924.081737:0:87124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951924.081760:0:87124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1444ff200/0x22c73c7857bb45e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1b0 expref: -99 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.081787:0:87124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1444ff200/0x22c73c7857bb45e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1b0 expref: 10 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.081815:0:87124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1444ff200/0x22c73c7857bb45e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1b0 expref: 10 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.081824:0:87124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1444ff200, rc 0) 00000100:00100000:3.0:1783951924.081894:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447700480:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 187us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.081901:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 37 00000100:00100000:3.0:1783951924.094388:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951924.094577:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447700608 00000100:00100000:0.0:1783951924.094627:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447700608 00000100:00100000:0.0:1783951924.094673:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 38 00000100:00100000:0.0:1783951924.094683:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447700608:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783951924.094733:0:87127:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1783951924.094752:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783951924.094756:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783951924.094759:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783951924.094762:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783951924.094765:0:87127:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:0.0:1783951924.097108:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447700608:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 Request processed in 2417us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951924.097123:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 38 10000000:01000000:1.0:1783951924.771613:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783951924.771621:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b176bcd000 from 111 10000000:01000000:1.0:1783951924.771625:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783951924.771733:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.771746:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.773630:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.773723:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.773785:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783951924.773833:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951924.773871:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434a8180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951924.773905:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465411072 00000100:00100000:0.0:1783951924.773913:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465411072 00000100:00100000:0.0:1783951924.773995:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783951924.774005:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:6514:x1870605465411072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951924.774017:0:87124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951924.774031:0:87124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbca00/0x22c73c7857bb45f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb45ed expref: -99 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.774051:0:87124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbca00/0x22c73c7857bb45f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb45ed expref: 11 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.774059:0:87124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbca00/0x22c73c7857bb45f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb45ed expref: 11 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.774065:0:87124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbca00, rc 0) 00000100:00100000:0.0:1783951924.774094:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465411072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951924.774099:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783951924.774268:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.774283:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.774291:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.774338:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.774362:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.774475:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434a8180 going to sleep for 11 seconds 00000100:00100000:0.0:1783951924.774512:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465411200 00000100:00100000:0.0:1783951924.774520:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465411200 00000100:00100000:0.0:1783951924.774542:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783951924.774546:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465411200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783951924.774557:0:87125:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783951924.774569:0:87125:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783951924.774572:0:87125:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 111 00000100:00100000:0.0:1783951924.774678:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465411200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951924.774685:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783951924.774750:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783951924.774798:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783951924.774805:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.774813:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951924.774823:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783951924.774825:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b151231000 from 52 10000000:01000000:1.0:1783951924.774827:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783951924.774845:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86ba00/0x22c73c7857bb45fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.774853:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86ba00/0x22c73c7857bb45fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.774860:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86ba00/0x22c73c7857bb45fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.774882:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.774906:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.774955:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951924.775189:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465411328 00000100:00100000:0.0:1783951924.775193:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465411328 00000100:00100000:0.0:1783951924.775217:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783951924.775224:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465411328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951924.775233:0:87124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951924.775242:0:87124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb4602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb45fb expref: -99 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.775258:0:87124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb4602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb45fb expref: 12 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.775267:0:87124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb4602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb45fb expref: 12 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.775274:0:87124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbdc00, rc 0) 00000100:00100000:0.0:1783951924.775311:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465411328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951924.775317:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783951924.775334:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.775345:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86ba00/0x22c73c7857bb45fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4602 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.775353:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86ba00/0x22c73c7857bb45fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4602 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.775405:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.775429:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.775446:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951924.775462:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465411456 00000100:00100000:2.0:1783951924.775468:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465411456 00000100:00100000:2.0:1783951924.775514:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783951924.775523:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465411456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951924.775706:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465411456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951924.775728:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783951924.775745:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.775784:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.775894:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.775965:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e900 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.776094:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465411584 00000100:00100000:1.0:1783951924.776098:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465411584 00000100:00100000:1.0:1783951924.776162:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783951924.776171:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465411584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.776258:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465411584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.776266:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783951924.776359:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951924.777437:0:87219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783951924.777538:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783951924.777561:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783951924.777568:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86ba00/0x22c73c7857bb45fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4602 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.777575:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86ba00/0x22c73c7857bb45fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4602 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951924.777614:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783951924.777617:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b151231000 from 108 10000000:01000000:1.0:1783951924.777621:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783951924.777651:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb4609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.777658:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb4609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.777667:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb4609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.777687:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.777737:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.777779:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951924.777845:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465411712 00000100:00100000:2.0:1783951924.777851:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465411712 00000100:00100000:2.0:1783951924.777892:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951924.777900:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465411712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951924.777910:0:87125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951924.777921:0:87125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216b600/0x22c73c7857bb4610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4609 expref: -99 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951924.777939:0:87125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216b600/0x22c73c7857bb4610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4609 expref: 13 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951924.777950:0:87125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216b600/0x22c73c7857bb4610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4609 expref: 13 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951924.777957:0:87125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b600, rc 0) 00000100:00100000:2.0:1783951924.777988:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465411712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951924.777995:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783951924.778069:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.778082:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb4609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4610 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.778091:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb4609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4610 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.778133:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.778164:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.778186:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.778240:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465411840 00000100:00100000:3.0:1783951924.778244:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465411840 00000100:00100000:3.0:1783951924.778280:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783951924.778287:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465411840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783951924.778302:0:87127:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783951924.778317:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783951924.778321:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783951924.778324:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783951924.778327:0:87127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783951924.778329:0:87127:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:3.0:1783951924.778403:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465411840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.778410:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783951924.778487:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783951924.778549:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783951924.778559:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb4609 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4610 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.778567:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb4609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4610 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951924.778574:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783951924.778576:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1783951924.778578:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783951924.778614:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86aa00/0x22c73c7857bb4617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.778623:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86aa00/0x22c73c7857bb4617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.778630:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86aa00/0x22c73c7857bb4617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.778642:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.778666:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.778682:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951924.778747:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465411968 00000100:00100000:2.0:1783951924.778751:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465411968 00000100:00100000:2.0:1783951924.778783:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783951924.778789:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465411968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951924.778805:0:87124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951924.778813:0:87124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216a800/0x22c73c7857bb461e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4617 expref: -99 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951924.778828:0:87124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216a800/0x22c73c7857bb461e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4617 expref: 14 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951924.778838:0:87124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216a800/0x22c73c7857bb461e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4617 expref: 14 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951924.778845:0:87124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a800, rc 0) 00000100:00100000:2.0:1783951924.778874:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465411968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951924.778881:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783951924.779109:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465411968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.779121:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86aa00/0x22c73c7857bb4617 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb461e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.779129:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86aa00/0x22c73c7857bb4617 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb461e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.779178:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.779211:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.779237:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.779285:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465412096 00000100:00100000:3.0:1783951924.779290:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465412096 00000100:00100000:3.0:1783951924.779319:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783951924.779326:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465412096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.779460:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465412096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.779471:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783951924.779572:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.779625:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.779663:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.779679:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.779937:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465412224 00000100:00100000:3.0:1783951924.779942:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465412224 00000100:00100000:3.0:1783951924.779964:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783951924.779970:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465412224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.780650:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465412224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 678us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.780658:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783951924.780761:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951924.781851:0:87221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1783951924.782000:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1783951924.782026:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783951924.782036:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86aa00/0x22c73c7857bb4617 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb461e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.782047:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86aa00/0x22c73c7857bb4617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb461e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951924.782056:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1783951924.782058:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b151231000 from 1 10000000:01000000:1.0:1783951924.782060:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783951924.782092:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb4625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.782101:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb4625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.782111:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb4625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.782133:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.782186:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.782227:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.782284:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465412352 00000100:00100000:3.0:1783951924.782291:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465412352 00000100:00100000:3.0:1783951924.782335:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783951924.782343:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465412352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951924.782355:0:87131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951924.782367:0:87131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1444fec00/0x22c73c7857bb462c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4625 expref: -99 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.782389:0:87131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1444fec00/0x22c73c7857bb462c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4625 expref: 15 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.782400:0:87131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1444fec00/0x22c73c7857bb462c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4625 expref: 15 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.782409:0:87131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1444fec00, rc 0) 00000100:00100000:3.0:1783951924.782530:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465412352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.782537:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783951924.782754:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.782769:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb4625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb462c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.782778:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb4625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb462c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951924.782792:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783951924.782796:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb4625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb462c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.782802:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb4625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb462c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951924.782809:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951924.782811:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b151231000 from 7 10000000:01000000:1.0:1783951924.782813:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951924.782826:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb4633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.782833:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb4633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.782840:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb4633 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.782852:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.782884:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.782941:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a300 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.782978:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465412480 00000100:00100000:3.0:1783951924.782988:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465412480 00000100:00100000:3.0:1783951924.783046:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783951924.783053:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465412480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951924.783061:0:87127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951924.783069:0:87127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1444fee00/0x22c73c7857bb463a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4633 expref: -99 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.783081:0:87127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1444fee00/0x22c73c7857bb463a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4633 expref: 16 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.783090:0:87127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1444fee00/0x22c73c7857bb463a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4633 expref: 16 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.783096:0:87127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1444fee00, rc 0) 00000100:00100000:3.0:1783951924.783130:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465412480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.783136:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783951924.783193:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.783203:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb4633 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb463a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.783209:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb4633 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb463a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.783256:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.783281:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.783352:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951924.783382:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465412608 00000100:00100000:2.0:1783951924.783387:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465412608 00000100:00100000:2.0:1783951924.783417:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783951924.783423:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465412608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951924.783537:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465412608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951924.783543:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783951924.783548:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.783576:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.783634:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.783751:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e900 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.783832:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465412736 00000100:00100000:1.0:1783951924.783837:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465412736 00000100:00100000:1.0:1783951924.783861:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783951924.783867:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465412736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.783941:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465412736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.783948:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783951924.784495:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951924.790260:0:87223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783951924.790477:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783951924.790503:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951924.790514:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb4633 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb463a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.790527:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb4633 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb463a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951924.790537:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783951924.790551:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b046482800 from 52 10000000:01000000:1.0:1783951924.790554:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783951924.790790:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a000/0x22c73c7857bb4641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.790800:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86a000/0x22c73c7857bb4641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.790811:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86a000/0x22c73c7857bb4641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951924.790885:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.790945:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.791007:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e540 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.791038:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465412864 00000100:00100000:1.0:1783951924.791044:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465412864 00000100:00100000:1.0:1783951924.791119:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783951924.791127:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465412864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.791139:0:87131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951924.791149:0:87131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86b800/0x22c73c7857bb4648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4641 expref: -99 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.791171:0:87131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86b800/0x22c73c7857bb4648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4641 expref: 17 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.791181:0:87131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86b800/0x22c73c7857bb4648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4641 expref: 17 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.791189:0:87131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86b800, rc 0) 00000100:00100000:1.0:1783951924.791261:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465412864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.791268:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783951924.791355:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951924.791368:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86a000/0x22c73c7857bb4641 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4648 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.791377:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86a000/0x22c73c7857bb4641 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4648 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951924.791423:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.791445:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.791466:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e540 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.791510:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465412992 00000100:00100000:3.0:1783951924.791515:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465412992 00000100:00100000:3.0:1783951924.791550:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783951924.791557:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465412992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.791693:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465412992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.791701:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783951924.791791:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465412992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.791824:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.791856:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.791880:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e540 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.791920:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465413120 00000100:00100000:3.0:1783951924.791924:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465413120 00000100:00100000:3.0:1783951924.791951:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783951924.791958:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1469b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465413120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.792040:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1469b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465413120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.792047:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783951924.792082:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951924.792862:0:87224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783951924.792913:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783951924.792930:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783951924.792938:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a000/0x22c73c7857bb4641 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4648 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.792947:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86a000/0x22c73c7857bb4641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4648 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951924.792956:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783951924.792958:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783951924.792961:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783951924.792989:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1444ff400/0x22c73c7857bb464f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.792997:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1444ff400/0x22c73c7857bb464f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.793006:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1444ff400/0x22c73c7857bb464f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951924.793023:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.793055:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951924.793076:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b5a300 going to sleep for 11 seconds 00000100:00100000:0.0:1783951924.793189:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465413248 00000100:00100000:0.0:1783951924.793195:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465413248 00000100:00100000:0.0:1783951924.793230:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783951924.793237:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1469ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465413248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951924.793247:0:87124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951924.793259:0:87124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbc800/0x22c73c7857bb4656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb464f expref: -99 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.793276:0:87124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc800/0x22c73c7857bb4656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb464f expref: 18 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.793285:0:87124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbc800/0x22c73c7857bb4656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb464f expref: 18 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.793293:0:87124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc800, rc 0) 00000100:00100000:0.0:1783951924.793323:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1469ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465413248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951924.793329:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783951924.793358:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951924.793370:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1444ff400/0x22c73c7857bb464f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4656 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.793378:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1444ff400/0x22c73c7857bb464f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4656 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951924.793432:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.793453:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.793464:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e540 going to sleep for 11 seconds 00000100:00100000:0.0:1783951924.793473:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465413376 00000100:00100000:0.0:1783951924.793476:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465413376 00000100:00100000:0.0:1783951924.793489:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783951924.793494:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1469b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465413376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.793620:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1469b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465413376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951924.793627:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783951924.793652:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.793677:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.793723:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.793742:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e540 going to sleep for 11 seconds 00000100:00100000:0.0:1783951924.793755:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465413504 00000100:00100000:0.0:1783951924.793758:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465413504 00000100:00100000:0.0:1783951924.793777:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783951924.793782:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1469ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465413504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.794548:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1469ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465413504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 762us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951924.794557:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783951924.794845:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783951924.795873:0:87225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1783951924.796024:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1783951924.796046:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783951924.796056:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1444ff400/0x22c73c7857bb464f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4656 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.796078:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1444ff400/0x22c73c7857bb464f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4656 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951924.796087:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783951924.796089:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b046482800 from 7 10000000:01000000:0.0:1783951924.796092:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951924.796125:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb465d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.796132:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb465d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.796141:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb465d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951924.796162:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.796211:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.796249:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b0468640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.796298:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465413632 00000100:00100000:1.0:1783951924.796304:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465413632 00000100:00100000:1.0:1783951924.796353:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783951924.796362:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1469b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465413632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.796374:0:87124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951924.796388:0:87124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb4664 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb465d expref: -99 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.796421:0:87124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb4664 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb465d expref: 19 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.796431:0:87124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb4664 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb465d expref: 19 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.796440:0:87124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86b400, rc 0) 00000100:00100000:1.0:1783951924.796474:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1469b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465413632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.796480:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783951924.796554:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951924.796567:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb465d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4664 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.796576:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb465d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4664 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951924.796655:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.796681:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.796706:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b0468640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.796771:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465413760 00000100:00100000:1.0:1783951924.796776:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465413760 00000100:00100000:1.0:1783951924.796806:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783951924.796813:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1469b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465413760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.796912:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1469b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465413760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.796919:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783951924.796983:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.797010:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.797046:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.797069:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b0468640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.797108:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465413888 00000100:00100000:1.0:1783951924.797112:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465413888 00000100:00100000:1.0:1783951924.797147:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783951924.797153:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b50d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465413888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.797228:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b50d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465413888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.797235:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783951924.797378:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465413888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951924.798216:0:87226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783951924.798512:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783951924.798532:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951924.798542:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb465d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4664 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.798552:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb465d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4664 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951924.798563:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783951924.798565:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174849000 from 52 10000000:01000000:1.0:1783951924.798568:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783951924.799685:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb466b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.799697:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb466b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.799708:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb466b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.799744:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.799809:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.799854:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.799905:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465414016 00000100:00100000:3.0:1783951924.799912:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465414016 00000100:00100000:3.0:1783951924.799966:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783951924.799974:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465414016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951924.799989:0:87131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951924.800004:0:87131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1444fe200/0x22c73c7857bb4672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb466b expref: -99 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.800027:0:87131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1444fe200/0x22c73c7857bb4672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb466b expref: 20 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.800038:0:87131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1444fe200/0x22c73c7857bb4672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb466b expref: 20 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.800046:0:87131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1444fe200, rc 0) 00000100:00100000:3.0:1783951924.800084:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465414016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.800091:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783951924.800168:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.800196:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb466b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4672 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.800204:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb466b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4672 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951924.800262:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.800285:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.800312:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.800350:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465414144 00000100:00100000:3.0:1783951924.800354:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465414144 00000100:00100000:3.0:1783951924.800384:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783951924.800391:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465414144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.800520:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465414144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.800527:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783951924.802152:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.802205:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.802269:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951924.802303:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.802324:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465414272 00000100:00100000:1.0:1783951924.802329:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465414272 00000100:00100000:1.0:1783951924.802366:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783951924.802373:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b7a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465414272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.802474:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b7a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465414272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.802480:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783951924.802528:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783951924.804143:0:87227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783951924.804734:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783951924.804757:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783951924.804767:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb466b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4672 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.804786:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb466b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4672 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951924.804794:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783951924.804796:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1783951924.804797:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783951924.804827:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1444ffe00/0x22c73c7857bb4679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.804832:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1444ffe00/0x22c73c7857bb4679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.804840:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1444ffe00/0x22c73c7857bb4679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951924.804858:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.804903:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951924.804970:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b5a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.805012:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465414400 00000100:00100000:1.0:1783951924.805017:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465414400 00000100:00100000:1.0:1783951924.805077:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783951924.805083:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b7aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465414400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.805101:0:87124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951924.805111:0:87124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb4680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4679 expref: -99 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.805129:0:87124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb4680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4679 expref: 21 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.805136:0:87124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb4680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4679 expref: 21 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.805142:0:87124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86be00, rc 0) 00000100:00100000:1.0:1783951924.805177:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b7aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465414400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.805182:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783951924.805238:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951924.805253:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1444ffe00/0x22c73c7857bb4679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4680 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.805262:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1444ffe00/0x22c73c7857bb4679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4680 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951924.805314:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.805332:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951924.805435:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b5a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783951924.805513:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465414528 00000100:00100000:0.0:1783951924.805518:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465414528 00000100:00100000:2.0:1783951924.805585:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783951924.805617:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b7aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465414528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951924.805909:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b7aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465414528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951924.805917:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783951924.805981:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.806010:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.806049:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951924.806079:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b5a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.806120:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465414656 00000100:00100000:1.0:1783951924.806124:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465414656 00000100:00100000:1.0:1783951924.806157:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783951924.806165:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b7abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465414656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.808377:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b7abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465414656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2206us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.808389:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783951924.808508:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951924.809577:0:87228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783951924.809914:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783951924.809939:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783951924.809949:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1444ffe00/0x22c73c7857bb4679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4680 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.809961:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1444ffe00/0x22c73c7857bb4679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4680 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951924.809971:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951924.809973:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b174849000 from 7 10000000:01000000:3.0:1783951924.809976:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951924.810013:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1444ff600/0x22c73c7857bb4687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.810021:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1444ff600/0x22c73c7857bb4687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.810031:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1444ff600/0x22c73c7857bb4687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951924.810055:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.810113:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951924.810204:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b5a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.810244:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465414784 00000100:00100000:1.0:1783951924.810251:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465414784 00000100:00100000:1.0:1783951924.810340:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783951924.810350:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b7ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465414784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951924.810364:0:87124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951924.810376:0:87124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86a800/0x22c73c7857bb468e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4687 expref: -99 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.810491:0:87124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86a800/0x22c73c7857bb468e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4687 expref: 22 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.810503:0:87124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86a800/0x22c73c7857bb468e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4687 expref: 22 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951924.810513:0:87124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a800, rc 0) 00000100:00100000:1.0:1783951924.810620:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b7ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465414784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 271us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.810627:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783951924.810880:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951924.810894:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1444ff600/0x22c73c7857bb4687 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb468e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.810904:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1444ff600/0x22c73c7857bb4687 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb468e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951924.810958:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.810986:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951924.811159:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b5a240 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.811198:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465414912 00000100:00100000:1.0:1783951924.811202:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465414912 00000100:00100000:1.0:1783951924.811234:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783951924.811240:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465414912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.811486:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465414912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.811494:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783951924.811579:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465414912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951924.811790:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465415040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951924.811834:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951924.811894:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522af780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951924.811937:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465415040 00000100:00100000:1.0:1783951924.811942:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465415040 00000100:00100000:1.0:1783951924.812015:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783951924.812023:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465415040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951924.812127:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465415040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951924.812134:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783951924.812211:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465415040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951924.813127:0:87229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783951924.813318:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783951924.813344:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951924.813356:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1444ff600/0x22c73c7857bb4687 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb468e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.813368:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1444ff600/0x22c73c7857bb4687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb468e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951924.813378:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783951924.813380:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97b167c90000 from 1 10000000:01000000:0.0:1783951924.813383:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783951924.813435:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb4695 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.813444:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb4695 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.813453:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb4695 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951924.813493:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465415168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.813549:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.813964:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046864f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.814021:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465415168 00000100:00100000:3.0:1783951924.814029:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465415168 00000100:00100000:3.0:1783951924.814077:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783951924.814085:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465415168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951924.814098:0:87127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951924.814112:0:87127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1444ff000/0x22c73c7857bb469c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4695 expref: -99 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.814133:0:87127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1444ff000/0x22c73c7857bb469c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4695 expref: 23 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.814143:0:87127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1444ff000/0x22c73c7857bb469c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4695 expref: 23 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.814152:0:87127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1444ff000, rc 0) 00000100:00100000:3.0:1783951924.814189:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465415168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.814196:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783951924.814290:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465415168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951924.814305:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb4695 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb469c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.814315:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb4695 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb469c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951924.814333:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783951924.814337:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb4695 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb469c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.814344:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb4695 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb469c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951924.814351:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783951924.814353:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97b167c90000 from 1 10000000:01000000:0.0:1783951924.814355:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783951924.814372:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbc000/0x22c73c7857bb46a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.814379:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbc000/0x22c73c7857bb46a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.814386:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbc000/0x22c73c7857bb46a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951924.814426:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465415296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.814455:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.814478:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046864f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.814581:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465415296 00000100:00100000:3.0:1783951924.814624:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465415296 00000100:00100000:3.0:1783951924.814655:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783951924.814663:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465415296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951924.814671:0:87127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951924.814680:0:87127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1444fea00/0x22c73c7857bb46aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb46a3 expref: -99 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.814694:0:87127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1444fea00/0x22c73c7857bb46aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb46a3 expref: 24 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.814703:0:87127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1444fea00/0x22c73c7857bb46aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb46a3 expref: 24 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951924.814709:0:87127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1444fea00, rc 0) 00000100:00100000:3.0:1783951924.814749:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465415296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951924.814754:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783951924.814887:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465415296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951924.814898:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbc000/0x22c73c7857bb46a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb46aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.814905:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbc000/0x22c73c7857bb46a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb46aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951924.814952:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465415424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951924.814976:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951924.815002:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046864f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951924.815040:0:87127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465415424 00000100:00100000:3.0:1783951924.815044:0:87127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465415424 00000100:00100000:3.0:1783951924.815073:0:87127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783951924.815079:0:87127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465415424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951924.815155:0:87127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465415424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (178us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783951924.815162:0:87127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783951924.815241:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465415424:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783951924.815266:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783951924.815271:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbc000/0x22c73c7857bb46a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb46aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951924.815278:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbc000/0x22c73c7857bb46a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb46aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951925.794534:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951926.776884:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951926.776974:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447700736 00000100:00100000:1.0:1783951926.776985:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447700736 00000100:00080000:0.0:1783951926.777574:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951926.777671:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1128 00000100:00100000:1.0:1783951926.777683:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447700736:12345-192.168.202.48@tcp:17:kworker.0 00000100:00100000:1.0:1783951926.777782:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447700736:12345-192.168.202.48@tcp:17:kworker.0 Request processed in 102us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951926.777791:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1128 00010000:00010000:1.0:1783951926.817583:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951927.845680:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951927.904747:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951927.904769:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465415552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951927.904834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951927.904875:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465415552 00000100:00100000:2.0:1783951927.904880:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465415552 00000100:00100000:2.0:1783951927.904927:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1783951927.904935:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465415552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951927.904977:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951927.905019:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465415552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951927.905026:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1783951927.905063:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465415552:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783951927.906171:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951927.906621:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465415680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951927.906667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951927.907301:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465415680 00000100:00100000:0.0:1783951927.907315:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465415680 00000100:00100000:0.0:1783951927.907502:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:0.0:1783951927.907510:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465415680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951927.907534:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951927.921978:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465415680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 14458us (15299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951927.921995:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00080000:0.0:1783951927.922041:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951927.936038:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465415680:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1783951928.086973:0:87404:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783951928.416940:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951928.416964:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465415808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951928.417035:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951928.417129:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465415808 00000100:00100000:3.0:1783951928.417138:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465415808 00000100:00100000:3.0:1783951928.417190:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:3.0:1783951928.417199:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465415808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951928.417230:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951928.417273:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465415808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951928.417280:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:2.0:1783951928.417384:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465415808:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1783951928.417798:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951928.417803:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951928.417807:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951928.417815:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951928.417837:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1447b3b80 x1870605465416064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951928.417869:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951928.417872:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951928.417874:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951928.417878:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951928.417889:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04aa4bb80 x1870605465416320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951928.417904:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951928.417907:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951928.417909:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951928.417913:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951928.417922:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04aa4b800 x1870605465416576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951928.417955:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951928.417958:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951928.417960:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951928.417965:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951928.417975:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1c700 x1870605465416960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951928.417992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783951928.417996:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951928.417998:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1447cd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951928.418001:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b1447cd000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951928.418011:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1ca80 x1870605465417344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951928.418063:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465416704:0@lo:400:kworker.0 00000100:00100000:1.0:1783951928.418097:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951928.418117:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783951928.418123:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465415936:0@lo:400:kworker.0 00000100:00100000:1.0:1783951928.418148:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951928.418170:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465416832:0@lo:400:kworker.0 00000100:00100000:1.0:1783951928.418190:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.418788:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465416192:0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.418833:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.418859:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465417088:0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.418875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.418889:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783951928.418892:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465416448:0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.418904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.418913:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465417216:0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.418923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.418943:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465416704 00000100:00100000:2.0:1783951928.418947:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465416704 00000100:00100000:2.0:1783951928.418971:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465416832 00000100:00100000:2.0:1783951928.418973:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465416832 00000100:00100000:2.0:1783951928.418983:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465417088 00000100:00100000:2.0:1783951928.418984:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465417088 00000100:00100000:2.0:1783951928.419000:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465417216 00000100:00100000:2.0:1783951928.419002:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465417216 00000100:00100000:2.0:1783951928.419014:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:2.0:1783951928.419018:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465416704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419058:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465416704:12345-0@lo:400:kworker.0 Request processed in 38us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951928.419064:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:2.0:1783951928.419079:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:2.0:1783951928.419085:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465416832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419108:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465416832:12345-0@lo:400:kworker.0 Request processed in 25us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951928.419112:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:2.0:1783951928.419120:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:2.0:1783951928.419128:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465417088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419149:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465417088:12345-0@lo:400:kworker.0 Request processed in 21us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951928.419152:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:2.0:1783951928.419159:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1783951928.419162:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465417216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419175:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465417216:12345-0@lo:400:kworker.0 Request processed in 13us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951928.419179:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1783951928.419190:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465416192 00000100:00100000:2.0:1783951928.419192:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465416192 00000100:00100000:2.0:1783951928.419208:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465416448 00000100:00100000:2.0:1783951928.419209:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465416448 00000100:00100000:2.0:1783951928.419220:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1783951928.419223:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465416192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419240:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465416192:12345-0@lo:400:kworker.0 Request processed in 17us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951928.419244:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1783951928.419249:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1783951928.419252:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465416448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419264:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465416448:12345-0@lo:400:kworker.0 Request processed in 12us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951928.419268:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00080000:2.0:1783951928.419282:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951928.419285:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951928.419286:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951928.419311:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465416448:0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419323:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465417216:0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419329:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465416192:0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419334:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465417088:0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419358:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465416832:0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.419364:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465416704:0@lo:400:kworker.0 00000100:00100000:1.0:1783951928.421911:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465415936 00000100:00100000:1.0:1783951928.421921:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465415936 00000100:00100000:1.0:1783951928.421967:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783951928.421974:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465415936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951928.422042:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465415936:12345-0@lo:400:kworker.0 Request processed in 68us (3893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951928.422048:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783951928.422139:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465415936:0@lo:400:kworker.0 00000100:00100000:2.0:1783951928.422176:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465416064:0@lo:38:kworker.0 00000100:00100000:2.0:1783951928.422203:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.422231:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465416320:0@lo:38:kworker.0 00000100:00100000:2.0:1783951928.422244:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.422253:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465416576:0@lo:38:kworker.0 00000100:00100000:2.0:1783951928.422266:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.422276:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465416960:0@lo:38:kworker.0 00000100:00100000:2.0:1783951928.422287:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.422296:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465417344:0@lo:38:kworker.0 00000100:00100000:2.0:1783951928.422311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.422330:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465416064 00000100:00100000:2.0:1783951928.422332:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465416064 00000100:00100000:2.0:1783951928.422395:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465416320 00000100:00100000:2.0:1783951928.422399:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465416320 00000100:00100000:2.0:1783951928.422410:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465416960 00000100:00100000:2.0:1783951928.422412:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465416960 00000100:00100000:2.0:1783951928.422418:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465417344 00000100:00100000:2.0:1783951928.422432:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465417344 00000100:00100000:2.0:1783951928.422446:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1783951928.422450:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465416064:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783951928.422468:0:66236:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3643 last 0 00000020:00000080:2.0:1783951928.422494:0:66236:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x22c73c7857bb46b1 00000004:00100000:2.0:1783951928.422506:0:66236:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951928.422712:0:66236:0:(import.c:65:import_set_state_nolock()) ffff97b17407d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951928.422754:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870605465416064:12345-0@lo:38:kworker.0 Request processed in 303us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951928.422759:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1783951928.422770:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1783951928.422772:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465416320:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783951928.422785:0:66236:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3643 last 0 00000020:00000080:2.0:1783951928.422806:0:66236:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x22c73c7857bb46b8 00000004:00100000:2.0:1783951928.422812:0:66236:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951928.422830:0:66236:0:(import.c:65:import_set_state_nolock()) ffff97b17407b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951928.422855:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870605465416320:12345-0@lo:38:kworker.0 Request processed in 81us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951928.422859:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1783951928.422868:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1783951928.422870:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465416960:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783951928.422879:0:66236:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3643 last 0 00000020:00000080:2.0:1783951928.422897:0:66236:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x22c73c7857bb46bf 00000004:00100000:2.0:1783951928.422902:0:66236:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951928.422910:0:66236:0:(import.c:65:import_set_state_nolock()) ffff97b17407e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951928.422934:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870605465416960:12345-0@lo:38:kworker.0 Request processed in 62us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951928.422938:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1783951928.422946:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1783951928.422949:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465417344:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783951928.422957:0:66236:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3643 last 0 00000020:00000080:2.0:1783951928.422971:0:66236:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x22c73c7857bb46c6 00000004:00100000:2.0:1783951928.422975:0:66236:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951928.422983:0:66236:0:(import.c:65:import_set_state_nolock()) ffff97b174692800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951928.422999:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465417344:12345-0@lo:38:kworker.0 Request processed in 50us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951928.423003:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00010000:00080000:2.0:1783951928.423026:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b1447b3b80 x1870605465416064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951928.423038:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00100000:3.0:1783951928.423869:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465416576 00000100:00100000:3.0:1783951928.423935:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465416576 00000100:00100000:3.0:1783951928.423978:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:3.0:1783951928.423984:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465416576:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783951928.424006:0:23862:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff97b174b15000, cookie 0x22c73c7857bb4537 00010000:00080000:3.0:1783951928.424011:0:23862:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378653 exp ffff97b174b15000 cur 3643 last 1783951922 00000004:00100000:3.0:1783951928.424022:0:23862:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783951928.424041:0:23862:0:(import.c:65:import_set_state_nolock()) ffff97b1746cc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951928.424092:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465416576:12345-0@lo:38:kworker.0 Request processed in 107us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951928.424098:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00010000:00080000:3.0:1783951928.424119:0:87153:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1783951928.424124:0:87153:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 103079215109 00000020:00080000:3.0:1783951928.424128:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.424131:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215109, next_transno: 103079215109 00010000:00080000:3.0:1783951928.424135:0:87153:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215109) 00000020:00080000:3.0:1783951928.424137:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.424146:0:87153:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447692416 t103079215109 from 192.168.202.48@tcp req@ffff97b14f0d7b80 x1870605447692416/t0(103079215109) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:184/0 lens 528/0 e 0 to 0 dl 1783951934 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783951928.427242:0:87153:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3037us 00000100:00080000:2.0:1783951928.429882:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff97b1447b3b80 x1870605465416064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951953 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951928.429893:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783951928.429898:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783951928.429901:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783951928.429906:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465416064:0@lo:38:kworker.0 00010000:00080000:2.0:1783951928.429933:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b04aa4bb80 x1870605465416320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951928.429946:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00080000:2.0:1783951928.430776:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff97b04aa4bb80 x1870605465416320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951953 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951928.430799:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783951928.430803:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783951928.430807:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783951928.430811:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465416320:0@lo:38:kworker.0 00000100:00080000:2.0:1783951928.430833:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:2.0:1783951928.430841:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1783951928.430845:0:3641:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1783951928.430847:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:2.0:1783951928.430851:0:3641:0:(recover.c:53:ptlrpc_replay_next()) import ffff97b048caf800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:2.0:1783951928.430855:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1783951928.431335:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465416576:0@lo:38:kworker.0 00010000:00080000:2.0:1783951928.431354:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b14de1c700 x1870605465416960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951928.431364:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000100:00080000:2.0:1783951928.432146:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff97b14de1c700 x1870605465416960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951953 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951928.432155:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783951928.432160:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783951928.432163:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783951928.432167:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465416960:0@lo:38:kworker.0 00010000:00080000:2.0:1783951928.432186:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b14de1ca80 x1870605465417344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783951938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951928.432196:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:2.0:1783951928.432211:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783951928.432215:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783951928.432217:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1447cd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783951928.432221:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465417344:0@lo:38:kworker.0 00010000:00080000:1.0:1783951928.432320:0:87427:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1783951928.432325:0:87427:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1783951928.432330:0:87427:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1783951928.432784:0:87427:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1783951928.433693:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465417472:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1783951928.433759:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951928.433868:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465417472 00000100:00100000:0.0:1783951928.433876:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465417472 00000100:00100000:0.0:1783951928.433924:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:0.0:1783951928.433934:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465417472:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1783951928.433953:0:8445:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b1447b3b80 x1870605465417472/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:189/0 lens 224/0 e 0 to 0 dl 1783951939 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951928.433965:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465417472:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 34us (206us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783951928.433972:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00010000:00010000:3.0:1783951928.440809:0:87153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.440831:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.440847:0:87153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.440861:0:87153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.440868:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.440875:0:87153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.441251:0:87153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.441260:0:87153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.441266:0:87153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.441273:0:87153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ffa00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951928.441277:0:87153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.441296:0:87153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.441309:0:87153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b155cd6300) 00010000:00010000:3.0:1783951928.441312:0:87153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951928.441317:0:87153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.441323:0:87153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951928.441340:0:87153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e33f4edd reply state 00000000fe387820 transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.441350:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.441356:0:87153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b155cd6900) 00010000:00010000:3.0:1783951928.441358:0:87153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951928.441362:0:87153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783951928.441468:0:87153:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783951928.441491:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.441494:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000020:00080000:3.0:1783951928.441498:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.441501:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000001:00080000:0.0:1783951928.449085:0:87120:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215109 is committed 00010000:00010000:1.0:1783951928.449157:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.449170:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.449178:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.449184:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951928.449189:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.449197:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.449216:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b155cd6900) 00010000:00010000:1.0:1783951928.449219:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951928.449224:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.449230:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe400/0x22c73c7857bb46d4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951928.456618:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951928.456746:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447692928 00000100:00100000:3.0:1783951928.456757:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447692928 00000100:00100000:3.0:1783951928.456840:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1133 00000100:00100000:3.0:1783951928.456855:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447692928:12345-192.168.202.48@tcp:36:rm.0 00010000:00080000:3.0:1783951928.456894:0:66236:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215110, current: 103079215110, replaying 00000100:00100000:3.0:1783951928.456912:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447692928:12345-192.168.202.48@tcp:36:rm.0 Request processed in 61us (330us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783951928.456922:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1133 00000020:00080000:3.0:1783951928.456966:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.456971:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215110, next_transno: 103079215110 00010000:00080000:3.0:1783951928.456976:0:87153:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215110) 00000020:00080000:3.0:1783951928.456979:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.456989:0:87153:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447692928 t103079215110 from 192.168.202.48@tcp req@ffff97b144cf5f80 x1870605447692928/t0(103079215110) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:189/0 lens 512/0 e 0 to 0 dl 1783951939 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783951928.457079:0:87153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.457096:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.457108:0:87153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.457122:0:87153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.457129:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.457134:0:87153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.457239:0:87153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb46e9 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.457252:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb46e9 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.457259:0:87153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb46e9 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458014:0:87153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb46e9 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458024:0:87153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb46e9 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458031:0:87153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb46e9 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458037:0:87153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951928.458041:0:87153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb46e9 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458048:0:87153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb46e9 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458060:0:87153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff97b150d9e700) 00010000:00010000:3.0:1783951928.458063:0:87153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783951928.458067:0:87153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb46e9 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458074:0:87153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe800/0x22c73c7857bb46e9 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458091:0:87153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458103:0:87153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458109:0:87153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458113:0:87153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ffa00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951928.458116:0:87153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458122:0:87153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458129:0:87153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9ea00) 00010000:00010000:3.0:1783951928.458131:0:87153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951928.458133:0:87153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458138:0:87153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffa00/0x22c73c7857bb46db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951928.458148:0:87153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062db1a7e reply state 0000000078321448 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458159:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.458165:0:87153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b150d9ef00) 00010000:00010000:3.0:1783951928.458167:0:87153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951928.458170:0:87153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783951928.458273:0:87153:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783951928.458294:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.458297:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000020:00080000:3.0:1783951928.458300:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.458302:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000100:00100000:3.0:1783951928.465567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951928.465722:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447694720 00000100:00100000:1.0:1783951928.465737:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447694720 00000100:00100000:1.0:1783951928.465823:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1134 00000100:00100000:1.0:1783951928.465834:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447694720:12345-192.168.202.48@tcp:101:touch.0 00010000:00080000:1.0:1783951928.465857:0:68591:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:1.0:1783951928.465896:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447694720:12345-192.168.202.48@tcp:101:touch.0 Request processed in 64us (344us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783951928.465903:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1134 00000020:00080000:3.0:1783951928.465997:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.466002:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:3.0:1783951928.466006:0:87153:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:3.0:1783951928.466009:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.466019:0:87153:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447694720 t103079215111 from 192.168.202.48@tcp req@ffff97b050d2c380 x1870605447694720/t0(103079215111) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:189/0 lens 752/0 e 0 to 0 dl 1783951939 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1783951928.466050:0:87153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951928.466076:0:87153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb46f0 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a18d expref: -99 pid: 87153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.466303:0:87153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff800/0x22c73c7857bb46f7 lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.466318:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff800/0x22c73c7857bb46f7 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.466331:0:87153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff800/0x22c73c7857bb46f7 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.466343:0:87153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.466350:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.466370:0:87153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783951928.467004:0:87153:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x5:0x0], cookie = 0x22c73c7857bb447a 00000004:00080000:3.0:1783951928.467009:0:87153:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x22c73c7857bb447a in new mfd 00010000:00010000:3.0:1783951928.467018:0:87153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff800/0x22c73c7857bb46f7 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.467026:0:87153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff800/0x22c73c7857bb46f7 lrc: 2/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.467032:0:87153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff800/0x22c73c7857bb46f7 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.467038:0:87153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951928.467042:0:87153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff800/0x22c73c7857bb46f7 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.467049:0:87153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff800/0x22c73c7857bb46f7 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.467060:0:87153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:3.0:1783951928.467063:0:87153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951928.467067:0:87153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff800/0x22c73c7857bb46f7 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.467073:0:87153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ff800/0x22c73c7857bb46f7 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951928.467083:0:87153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e733955e reply state 0000000011b703f1 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.467112:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.467119:0:87153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff97b150d9e500) 00010000:00010000:3.0:1783951928.467125:0:87153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951928.467128:0:87153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783951928.467155:0:87153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb46f0 lrc: 1/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 10 pid: 87153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.467164:0:87153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:3.0:1783951928.467166:0:87153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951928.467169:0:87153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb46f0 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a18d expref: 10 pid: 87153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.467182:0:87153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1444ffc00, rc 0) 00010000:00080000:3.0:1783951928.467258:0:87153:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783951928.467274:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.467277:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:3.0:1783951928.467282:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.467284:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000100:00100000:0.0:1783951928.505135:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951928.505361:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447694976 00000100:00100000:1.0:1783951928.505372:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447694976 00000100:00100000:1.0:1783951928.505479:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1135 00000100:00100000:1.0:1783951928.505491:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+10:2397:x1870605447694976:12345-192.168.202.48@tcp:36:touch.0 00010000:00080000:1.0:1783951928.505514:0:67035:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:1.0:1783951928.505533:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+10:2397:x1870605447694976:12345-192.168.202.48@tcp:36:touch.0 Request processed in 46us (408us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783951928.505539:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1135 00000020:00080000:3.0:1783951928.505712:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.505716:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:3.0:1783951928.505721:0:87153:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:3.0:1783951928.505723:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.505733:0:87153:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447694976 t103079215112 from 192.168.202.48@tcp req@ffff97b14de1ca80 x1870605447694976/t0(103079215112) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:189/0 lens 488/0 e 0 to 0 dl 1783951939 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783951928.505860:0:87153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.505875:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.505885:0:87153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951928.505988:0:87153:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001f42d9f7 reply state 000000008a714304 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.506001:0:87153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.506009:0:87153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff97b150d9eb00) 00010000:00010000:3.0:1783951928.506012:0:87153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951928.506015:0:87153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783951928.506173:0:87153:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783951928.506188:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.506191:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:3.0:1783951928.506195:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.506196:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:3.0:1783951928.510057:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951928.510143:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447695360 00000100:00100000:0.0:1783951928.510170:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447695360 00000100:00100000:0.0:1783951928.510251:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 220 00000100:00100000:0.0:1783951928.510262:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+12:2397:x1870605447695360:12345-192.168.202.48@tcp:35:touch.0 00010000:00080000:0.0:1783951928.510282:0:66241:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215113, replaying 00000100:00100000:0.0:1783951928.510307:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+12:2397:x1870605447695360:12345-192.168.202.48@tcp:35:touch.0 Request processed in 48us (267us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783951928.510315:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 220 00000020:00080000:1.0:1783951928.510424:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951928.510428:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215113, next_transno: 103079215113 00010000:00080000:1.0:1783951928.510432:0:87153:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215113) 00000020:00080000:1.0:1783951928.510435:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951928.510444:0:87153:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447695360 t103079215113 from 192.168.202.48@tcp req@ffff97b050d2fb80 x1870605447695360/t0(103079215113) o35->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:189/0 lens 392/0 e 0 to 0 dl 1783951939 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783951928.510738:0:87153:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783951928.510754:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951928.510757:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000020:00080000:1.0:1783951928.510761:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951928.510763:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000100:00100000:3.0:1783951928.518293:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951928.518383:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447700864 00000100:00100000:2.0:1783951928.518392:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447700864 00000100:00100000:2.0:1783951928.518451:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1108 00000100:00100000:2.0:1783951928.518460:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+13:2397:x1870605447700864:12345-192.168.202.48@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783951928.518484:0:66236:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b050d2ca80 x1870605447700864/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:189/0 lens 224/0 e 0 to 0 dl 1783951939 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951928.518510:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+13:2397:x1870605447700864:12345-192.168.202.48@tcp:400:ldlm_lock_repla.0 Request processed in 51us (226us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783951928.518516:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1108 00000020:00080000:3.0:1783951928.523740:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.523749:0:87153:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215114 00010000:00080000:3.0:1783951928.523754:0:87153:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1783951928.523757:0:87153:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951928.523770:0:87153:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783951928.523773:0:87153:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1783951928.523880:0:87153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:1.0:1783951928.528051:0:87120:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00100000:1.0:1783951928.528060:0:87120:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1783951928.528087:0:87120:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:3.0:1783951928.528182:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528195:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528203:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528209:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951928.528213:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528220:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528248:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528255:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe600/0x22c73c7857bb46e2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528279:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528285:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528291:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528305:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951928.528308:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528313:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528321:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528326:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444fe000/0x22c73c7857bb46fe lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528339:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528345:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528349:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528354:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ffc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951928.528357:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528362:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528369:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.528395:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1444ffc00/0x22c73c7857bb470c lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951928.528449:0:87153:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783951928.528484:0:87153:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783951928.528498:0:87153:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff97b1447b3b80 x1870605465417472/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:189/0 lens 224/0 e 0 to 0 dl 1783951939 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783951928.528657:0:87153:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.48@tcp: req@ffff97b050d2ca80 x1870605447700864/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:189/0 lens 224/0 e 0 to 0 dl 1783951939 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783951928.528755:0:87153:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1783951928.534087:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1783951928.534105:0:3641:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff97b144cf4700 x1870605465417472/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951944 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951928.534116:0:3641:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff97b144cf4700 x1870605465417472/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951944 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783951928.534123:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783951928.534137:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783951928.534147:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465417472:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1783951928.534227:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951928.534250:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465417600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951928.534307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951928.534350:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465417600 00000100:00100000:1.0:1783951928.534357:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465417600 00000100:00100000:1.0:1783951928.534402:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:1.0:1783951928.534409:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465417600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951928.534442:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:1.0:1783951928.534484:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465417600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951928.534490:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:1.0:1783951928.534528:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465417600:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1783951928.588787:0:87153:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa80a486abe10 00100000:10000000:2.0:1783951928.588800:0:87153:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1783951928.589967:0:87141:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x47c:0x0] 00000100:00100000:1.0:1783951928.590014:0:87141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87141:1870605465417728:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783951928.590081:0:87141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951928.590112:0:87141:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522af780 going to sleep for 11 seconds 00000100:00100000:1.0:1783951928.590137:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465417728 00000100:00100000:1.0:1783951928.590150:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465417728 00000100:00100000:1.0:1783951928.590200:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4903 00000100:00100000:1.0:1783951928.590208:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:87141:x1870605465417728:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783951928.590248:0:26199:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -645 00002000:02000040:1.0:1783951928.590253:0:26199:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1149 to 0x2c0000401:1793) 00000004:00080000:2.0:1783951928.592965:0:87139:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6a2:0x0] 00000100:00100000:2.0:1783951928.593029:0:87139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87139:1870605465417856:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783951928.593106:0:87139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.593133:0:87139:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951928.593994:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465417856 00000100:00100000:0.0:1783951928.594002:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465417856 00000100:00100000:0.0:1783951928.594210:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4904 00000100:00100000:0.0:1783951928.594221:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:87139:x1870605465417856:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783951928.594263:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -95 00002000:02000040:0.0:1783951928.594267:0:8436:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1699 to 0x280000401:1793) 00002000:00010000:1.0:1783951928.609833:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.609848:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb4713 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.609866:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.609870:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.609877:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb4713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.609894:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb4713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.609905:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb4713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.609912:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb4713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.609933:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.609945:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.609951:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb4713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.609973:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.609977:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb4713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.609987:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb4713 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.610003:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb4713 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.610011:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb4713 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.610028:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.610030:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.610032:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.612440:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.612452:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb471a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.612468:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.612473:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.612479:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb471a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.612493:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb471a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.612513:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb471a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.612520:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb471a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.612732:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951928.612829:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.612835:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb4721 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.612843:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.612847:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.612851:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb4721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.612860:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb4721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.612866:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb4721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.612873:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb4721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.618729:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951928.618745:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb471a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.618777:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951928.618782:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb471a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.618791:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb471a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.618813:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb471a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.618820:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb471a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.618841:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951928.618844:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb4721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.618850:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ae00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951928.618853:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb4721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.618861:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb4721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.618871:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb4721 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.618884:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951928.618886:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951928.618888:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.619040:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783951928.619047:0:26199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb4721 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1783951928.619109:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1783951928.619222:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.619229:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4728 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619240:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.619245:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.619251:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619262:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619270:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619277:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619296:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.619305:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.619316:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619323:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cd200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.619325:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619333:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4728 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619344:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4728 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619351:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb4728 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619365:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.619367:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.619368:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951928.619463:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.619528:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.619534:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb472f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619542:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.619545:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.619549:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb472f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619569:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb472f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619577:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb472f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619647:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb472f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619706:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951928.619748:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.619753:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4736 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619761:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.619764:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.619767:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619775:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619781:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.619797:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951928.623284:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951928.623295:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f9face/0x22c73c7857bb473d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.623311:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:0.0:1783951928.623315:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951928.623321:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031f9face/0x22c73c7857bb473d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.623336:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031f9face/0x22c73c7857bb473d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.623345:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f9face/0x22c73c7857bb473d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.623365:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031f9face/0x22c73c7857bb473d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625648:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783951928.625662:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb472f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625675:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cda00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951928.625689:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb472f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625701:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb472f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625720:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb472f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625728:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb472f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625750:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783951928.625755:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4736 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625760:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cd400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951928.625770:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4736 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625779:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4736 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625788:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4736 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625795:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951928.625799:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031f9face/0x22c73c7857bb473d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625805:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951928.625808:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f9face/0x22c73c7857bb473d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625816:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f9face/0x22c73c7857bb473d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625825:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031f9face/0x22c73c7857bb473d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951928.625833:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951928.625835:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951928.625836:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.626018:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783951928.626026:0:26199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb4736 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951928.626163:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.626169:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb4744 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626180:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.626186:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.626192:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb4744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626203:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb4744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626212:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb4744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626220:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb4744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626248:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.626255:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.626260:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb4744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626266:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.626269:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb4744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626276:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb4744 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626287:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb4744 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626294:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb4744 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626307:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.626308:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.626310:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.626422:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.626428:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb474b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626436:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.626444:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.626449:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb474b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626458:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb474b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626465:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb474b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626471:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb474b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626486:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.626493:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.626497:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb474b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626503:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.626506:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb474b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626512:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb474b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626521:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb474b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626538:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb474b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626551:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.626553:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.626554:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.626624:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.626630:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb4752 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626638:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.626641:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.626646:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb4752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626655:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb4752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626662:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb4752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626669:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb4752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626696:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.626709:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.626713:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb4752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626720:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.626722:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb4752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626730:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb4752 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626739:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb4752 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626746:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb4752 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626759:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.626760:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.626762:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.626808:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.626812:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb4759 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626820:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.626822:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.626826:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb4759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626845:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb4759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626852:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb4759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626858:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb4759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626870:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.626877:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.626880:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb4759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626886:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644de00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.626889:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb4759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626895:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb4759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626905:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb4759 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626912:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb4759 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626932:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.626933:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.626935:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.626975:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.626980:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb4760 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.626987:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.626989:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.626993:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb4760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627000:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb4760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627008:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb4760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627014:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb4760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627025:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.627031:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.627035:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb4760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627051:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644dc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.627054:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb4760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627061:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb4760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627071:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb4760 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627077:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb4760 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627087:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627089:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627090:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.627125:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.627129:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb4767 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627137:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.627139:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.627143:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb4767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627151:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb4767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627164:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb4767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627171:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb4767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627182:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.627188:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.627191:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb4767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627197:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.627200:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb4767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627206:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb4767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627214:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb4767 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627220:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb4767 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627230:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627237:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627239:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.627283:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.627288:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb476e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627295:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.627298:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.627302:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb476e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627311:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb476e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627318:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb476e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627324:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb476e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627337:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.627343:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.627347:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb476e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627354:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.627357:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb476e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627374:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb476e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627385:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb476e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627392:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb476e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627405:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627407:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627408:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.627447:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.627452:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb4775 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627460:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.627462:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.627466:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb4775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627474:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb4775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627481:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb4775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627495:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb4775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627506:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.627515:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.627518:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb4775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627525:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.627528:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb4775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627536:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb4775 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627547:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb4775 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627554:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb4775 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627566:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627567:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627569:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.627628:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.627639:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb477c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627647:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.627649:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.627653:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb477c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627661:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb477c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627668:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb477c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627674:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb477c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627698:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.627704:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.627708:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb477c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627715:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.627719:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb477c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627726:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb477c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627742:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb477c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627749:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb477c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627763:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627765:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627767:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.627807:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.627812:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb4783 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627819:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.627822:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.627826:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb4783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627834:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb4783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627842:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb4783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627849:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb4783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627873:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.627882:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.627885:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb4783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627891:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.627894:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb4783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627902:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb4783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627912:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb4783 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627919:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb4783 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627931:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627933:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.627935:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.627972:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.627976:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb478a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.627983:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.627992:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.627996:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb478a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628005:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb478a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628013:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb478a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628020:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb478a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628032:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.628039:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.628042:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb478a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628050:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644da00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.628053:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb478a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628060:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb478a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628069:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb478a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628088:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb478a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628102:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628104:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628105:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.628145:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.628150:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb4791 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628158:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.628161:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.628165:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb4791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628174:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb4791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628181:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb4791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628188:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb4791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628201:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.628214:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.628217:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb4791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628224:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.628227:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb4791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628235:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb4791 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628246:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb4791 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628253:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb4791 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628266:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628268:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628269:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.628311:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.628316:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4798 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628323:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.628327:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.628331:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628349:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628357:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628365:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628377:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.628383:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.628388:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628394:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.628396:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628404:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628413:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4798 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628421:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4798 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628439:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628441:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628442:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.628481:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.628486:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb479f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628494:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.628496:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.628501:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb479f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628510:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb479f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628518:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb479f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628525:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb479f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628538:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.628544:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.628547:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb479f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628564:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ce00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.628568:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb479f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628575:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb479f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628608:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb479f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628616:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb479f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628629:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628631:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628633:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.628675:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.628716:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb47a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628723:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.628726:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.628729:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb47a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628738:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb47a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628755:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb47a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628761:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb47a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628772:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.628779:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.628782:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb47a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628788:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644cc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.628792:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb47a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628799:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb47a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628808:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb47a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628814:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb47a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628827:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628834:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628836:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.628878:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.628884:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb47ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628891:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.628894:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.628897:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb47ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628905:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb47ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628913:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb47ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628920:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb47ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628931:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.628937:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.628941:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb47ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628946:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.628949:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb47ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628965:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb47ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628974:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb47ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628981:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb47ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.628994:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628995:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.628996:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.629033:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.629037:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb47b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629044:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.629047:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.629050:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb47b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629058:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb47b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629065:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb47b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629076:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb47b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629087:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.629092:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.629096:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb47b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629102:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.629106:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb47b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629114:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb47b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629125:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb47b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629133:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb47b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629146:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.629148:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.629150:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.629189:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.629199:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb47bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629207:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.629211:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.629215:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb47bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629223:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb47bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629231:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb47bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629239:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb47bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629250:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.629256:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.629259:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb47bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629267:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afe00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.629270:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb47bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629277:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb47bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629292:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb47bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629298:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb47bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629310:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.629312:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.629313:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.629352:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.629357:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb47c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629365:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.629368:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.629372:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb47c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629381:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb47c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629388:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb47c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629394:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb47c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629425:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.629432:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.629435:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb47c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629441:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.629444:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb47c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629451:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb47c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629462:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb47c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629469:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb47c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629480:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.629482:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.629484:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.629522:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.629526:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb47c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629533:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.629541:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.629545:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb47c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629553:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb47c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629560:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb47c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629566:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb47c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629578:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951928.629584:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951928.629606:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb47c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629613:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951928.629616:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb47c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629623:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb47c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629633:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb47c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629649:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb47c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.629662:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.629663:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951928.629665:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.630987:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783951928.630998:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031f9face/0x22c73c7857bb473d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783951928.631475:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951928.631482:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb47d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.631493:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:0.0:1783951928.631497:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951928.631503:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb47d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.631515:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb47d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.631525:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb47d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.631532:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb47d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.631558:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951928.631567:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951928.631572:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb47d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.631580:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951928.631584:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb47d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.631618:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb47d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.631632:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb47d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.631639:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb47d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.631652:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.631654:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.631655:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951928.632843:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951928.632850:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb47d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.632862:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:0.0:1783951928.632872:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951928.632877:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb47d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.632889:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb47d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.632896:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb47d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.632902:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb47d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.632917:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951928.632926:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951928.632931:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb47d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.632937:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951928.632940:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb47d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.632947:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb47d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.632957:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb47d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.632974:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb47d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.632987:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.632989:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.632991:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951928.633053:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951928.633058:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf1cc06/0x22c73c7857bb47de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633066:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:0.0:1783951928.633070:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951928.633073:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf1cc06/0x22c73c7857bb47de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633082:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf1cc06/0x22c73c7857bb47de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633090:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf1cc06/0x22c73c7857bb47de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633097:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bf1cc06/0x22c73c7857bb47de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633110:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951928.633117:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951928.633126:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bf1cc06/0x22c73c7857bb47de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633132:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951928.633136:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf1cc06/0x22c73c7857bb47de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633143:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf1cc06/0x22c73c7857bb47de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633153:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bf1cc06/0x22c73c7857bb47de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633159:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf1cc06/0x22c73c7857bb47de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633171:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.633172:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.633174:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951928.633213:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951928.633218:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4221233/0x22c73c7857bb47e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633226:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:0.0:1783951928.633228:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951928.633232:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4221233/0x22c73c7857bb47e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633251:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4221233/0x22c73c7857bb47e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633259:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4221233/0x22c73c7857bb47e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633266:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4221233/0x22c73c7857bb47e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633277:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951928.633284:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951928.633287:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4221233/0x22c73c7857bb47e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633293:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951928.633296:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4221233/0x22c73c7857bb47e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633303:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4221233/0x22c73c7857bb47e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633314:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4221233/0x22c73c7857bb47e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633321:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4221233/0x22c73c7857bb47e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633340:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.633341:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.633343:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951928.633393:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951928.633399:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb47ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633406:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:0.0:1783951928.633410:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951928.633413:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb47ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633422:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb47ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633431:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb47ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633439:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb47ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633452:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951928.633458:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951928.633461:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb47ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633478:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951928.633481:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb47ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633489:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb47ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633499:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb47ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633506:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb47ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633518:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.633519:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.633521:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783951928.633559:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783951928.633565:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b2f7d5b/0x22c73c7857bb47f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633572:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:0.0:1783951928.633576:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951928.633580:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b2f7d5b/0x22c73c7857bb47f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633633:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b2f7d5b/0x22c73c7857bb47f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633648:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b2f7d5b/0x22c73c7857bb47f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633655:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b2f7d5b/0x22c73c7857bb47f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.633666:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951928.633674:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.634039:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951928.634470:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b2f7d5b/0x22c73c7857bb47f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.634481:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951928.634485:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b2f7d5b/0x22c73c7857bb47f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.634494:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b2f7d5b/0x22c73c7857bb47f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.634507:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b2f7d5b/0x22c73c7857bb47f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951928.634514:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b2f7d5b/0x22c73c7857bb47f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1783951928.639523:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783951928.640108:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951928.641664:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.641674:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb47fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641701:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.641706:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.641712:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb47fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641727:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb47fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641738:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb47fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641746:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb47fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641777:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951928.641838:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.641843:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007965df6e/0x22c73c7857bb4801 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641851:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.641854:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.641857:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007965df6e/0x22c73c7857bb4801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641866:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007965df6e/0x22c73c7857bb4801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641874:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007965df6e/0x22c73c7857bb4801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641881:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007965df6e/0x22c73c7857bb4801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641892:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783951928.641926:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.641931:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb4808 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641939:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.641942:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.641945:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb4808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641964:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb4808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641972:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb4808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641980:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb4808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.641990:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783951928.642026:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.642032:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0278cf8/0x22c73c7857bb480f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642038:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.642041:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.642045:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0278cf8/0x22c73c7857bb480f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642054:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0278cf8/0x22c73c7857bb480f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642061:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0278cf8/0x22c73c7857bb480f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642080:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0278cf8/0x22c73c7857bb480f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642087:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783951928.642125:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.642129:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb4816 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642136:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.642138:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.642142:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb4816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642149:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb4816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642454:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb4816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642465:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb4816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642474:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783951928.642573:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951928.642579:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb481d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642617:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:1.0:1783951928.642620:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951928.642625:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb481d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642633:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb481d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642640:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb481d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642646:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb481d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951928.642654:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1783951928.643606:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783951928.643614:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb47fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643623:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aea00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.643628:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb47fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643636:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb47fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643653:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb47fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643667:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb47fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643699:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783951928.643703:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007965df6e/0x22c73c7857bb4801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643710:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.643713:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007965df6e/0x22c73c7857bb4801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643721:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007965df6e/0x22c73c7857bb4801 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643730:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007965df6e/0x22c73c7857bb4801 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643736:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007965df6e/0x22c73c7857bb4801 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643746:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783951928.643749:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb4808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643754:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aec00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.643763:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb4808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643770:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb4808 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643778:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb4808 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643785:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb4808 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643796:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783951928.643799:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0278cf8/0x22c73c7857bb480f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643805:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.643808:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0278cf8/0x22c73c7857bb480f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643814:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0278cf8/0x22c73c7857bb480f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643823:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0278cf8/0x22c73c7857bb480f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643828:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0278cf8/0x22c73c7857bb480f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643845:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951928.643848:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb4816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643854:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.643857:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb4816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643863:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb4816 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643874:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb4816 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643880:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb4816 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643890:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.643893:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb481d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643900:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.643903:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb481d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643921:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb481d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643931:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb481d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643937:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb481d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.643949:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.643951:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.643953:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.643962:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.643968:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.649255:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.649261:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.649263:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.649400:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.649409:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4824 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649430:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.649434:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.649442:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649458:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649481:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649488:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649512:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.649528:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.649534:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649541:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ffc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.649548:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649559:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4824 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649574:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4824 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649581:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e76a3f1/0x22c73c7857bb4824 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649616:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.649624:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.649626:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.649690:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.649696:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb482b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649707:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.649712:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.649716:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb482b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649724:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb482b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649732:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb482b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649743:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb482b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649761:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.649772:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.649776:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb482b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649784:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.649788:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb482b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649807:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb482b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649818:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb482b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649825:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f150d4f/0x22c73c7857bb482b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649839:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.649840:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.649842:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.649885:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.649890:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb4832 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649898:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.649901:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.649905:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb4832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649918:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb4832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649930:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb4832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649949:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb4832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649968:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.649980:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.649985:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb4832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.649996:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.650006:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb4832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650019:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb4832 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650033:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb4832 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650040:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000502f7c46/0x22c73c7857bb4832 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650060:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.650062:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.650064:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.650136:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.650147:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4839 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650166:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.650169:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.650173:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650187:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650195:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650201:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650218:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.650225:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.650229:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650238:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ff800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.650241:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650247:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4839 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650265:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4839 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650276:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000294d4d0a/0x22c73c7857bb4839 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650290:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.650292:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.650293:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.650350:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.650359:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb4840 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650367:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.650370:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.650374:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb4840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650382:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb4840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650391:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb4840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650401:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb4840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650430:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.650441:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.650445:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb4840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650459:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444ffa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.650462:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb4840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650470:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb4840 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650487:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb4840 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650498:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056b3fc45/0x22c73c7857bb4840 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650517:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.650519:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.650520:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.650581:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.650606:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb4847 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650615:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.650623:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.650628:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb4847 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650637:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb4847 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650657:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb4847 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650665:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb4847 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650693:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.650700:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.650708:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb4847 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650721:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.650724:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb4847 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650734:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb4847 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650746:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb4847 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650773:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000709b1c8e/0x22c73c7857bb4847 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650790:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.650792:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.650793:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.650835:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.650840:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb484e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650847:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.650850:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.650853:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb484e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650867:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb484e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650874:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb484e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650880:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb484e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650898:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.650909:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.650917:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb484e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650924:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1444fe400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.650926:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb484e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650933:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb484e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650942:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb484e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.650953:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a386bc43/0x22c73c7857bb484e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651718:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.651721:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.651723:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.651774:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.651780:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d902c3d/0x22c73c7857bb4855 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651789:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.651792:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.651796:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d902c3d/0x22c73c7857bb4855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651816:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d902c3d/0x22c73c7857bb4855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651825:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d902c3d/0x22c73c7857bb4855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651831:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d902c3d/0x22c73c7857bb4855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651846:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.651854:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.651858:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d902c3d/0x22c73c7857bb4855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651864:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aae00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.651867:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d902c3d/0x22c73c7857bb4855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651875:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d902c3d/0x22c73c7857bb4855 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651885:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d902c3d/0x22c73c7857bb4855 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651890:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d902c3d/0x22c73c7857bb4855 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651910:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.651911:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.651913:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.651957:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.651961:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a85283c7/0x22c73c7857bb485c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651969:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.651972:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.651976:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a85283c7/0x22c73c7857bb485c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651984:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a85283c7/0x22c73c7857bb485c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651992:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a85283c7/0x22c73c7857bb485c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.651997:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a85283c7/0x22c73c7857bb485c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652008:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.652015:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.652019:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a85283c7/0x22c73c7857bb485c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652036:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413abe00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.652040:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a85283c7/0x22c73c7857bb485c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652048:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a85283c7/0x22c73c7857bb485c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652058:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a85283c7/0x22c73c7857bb485c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652065:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a85283c7/0x22c73c7857bb485c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652078:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652080:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652082:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.652129:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.652134:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa4d7503/0x22c73c7857bb4863 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652141:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.652144:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.652147:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa4d7503/0x22c73c7857bb4863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652156:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa4d7503/0x22c73c7857bb4863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652169:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa4d7503/0x22c73c7857bb4863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652176:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa4d7503/0x22c73c7857bb4863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652190:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.652197:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.652201:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa4d7503/0x22c73c7857bb4863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652207:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aa600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.652210:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa4d7503/0x22c73c7857bb4863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652218:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa4d7503/0x22c73c7857bb4863 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652228:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa4d7503/0x22c73c7857bb4863 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652235:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa4d7503/0x22c73c7857bb4863 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652248:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652255:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652256:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.652295:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.652300:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f19b33/0x22c73c7857bb486a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652307:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.652311:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.652315:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016f19b33/0x22c73c7857bb486a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652323:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016f19b33/0x22c73c7857bb486a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652330:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f19b33/0x22c73c7857bb486a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652336:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016f19b33/0x22c73c7857bb486a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652348:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.652354:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.652358:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016f19b33/0x22c73c7857bb486a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652365:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aa400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.652368:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f19b33/0x22c73c7857bb486a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652387:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f19b33/0x22c73c7857bb486a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652397:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016f19b33/0x22c73c7857bb486a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652404:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016f19b33/0x22c73c7857bb486a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652417:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652419:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652420:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.652466:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.652471:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb4871 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652478:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.652481:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.652485:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb4871 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652493:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb4871 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652500:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb4871 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652513:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb4871 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652525:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.652532:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.652536:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb4871 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652542:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413ab000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.652545:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb4871 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652553:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb4871 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652564:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb4871 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652572:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a3fc8d/0x22c73c7857bb4871 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652603:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652605:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652606:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.652645:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.652656:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b60f6ae/0x22c73c7857bb4878 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652664:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.652667:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.652671:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b60f6ae/0x22c73c7857bb4878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652692:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b60f6ae/0x22c73c7857bb4878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652701:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b60f6ae/0x22c73c7857bb4878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652707:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b60f6ae/0x22c73c7857bb4878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652719:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.652725:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.652729:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b60f6ae/0x22c73c7857bb4878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652736:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413ab600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.652739:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b60f6ae/0x22c73c7857bb4878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652746:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b60f6ae/0x22c73c7857bb4878 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652764:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b60f6ae/0x22c73c7857bb4878 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652770:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b60f6ae/0x22c73c7857bb4878 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652782:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652784:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652786:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.652826:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.652831:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f56acd/0x22c73c7857bb487f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652838:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.652841:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.652845:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f56acd/0x22c73c7857bb487f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652853:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f56acd/0x22c73c7857bb487f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652860:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f56acd/0x22c73c7857bb487f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652867:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f56acd/0x22c73c7857bb487f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652890:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.652897:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.652900:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f56acd/0x22c73c7857bb487f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652906:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413ab400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.652909:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f56acd/0x22c73c7857bb487f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652917:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f56acd/0x22c73c7857bb487f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652927:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f56acd/0x22c73c7857bb487f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652935:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f56acd/0x22c73c7857bb487f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.652947:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652949:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.652951:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.652994:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.652999:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000923f140f/0x22c73c7857bb4886 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653006:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.653015:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.653020:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000923f140f/0x22c73c7857bb4886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653028:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000923f140f/0x22c73c7857bb4886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653036:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000923f140f/0x22c73c7857bb4886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653044:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000923f140f/0x22c73c7857bb4886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653056:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.653062:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.653066:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000923f140f/0x22c73c7857bb4886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653073:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aa200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.653075:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000923f140f/0x22c73c7857bb4886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653083:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000923f140f/0x22c73c7857bb4886 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653094:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000923f140f/0x22c73c7857bb4886 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653112:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000923f140f/0x22c73c7857bb4886 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653125:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.653127:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.653129:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.653169:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.653173:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090f2bcc3/0x22c73c7857bb488d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653180:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.653182:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.653185:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090f2bcc3/0x22c73c7857bb488d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653193:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090f2bcc3/0x22c73c7857bb488d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653199:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090f2bcc3/0x22c73c7857bb488d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653206:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090f2bcc3/0x22c73c7857bb488d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653217:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.653223:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.653232:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090f2bcc3/0x22c73c7857bb488d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653238:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413aac00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.653241:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090f2bcc3/0x22c73c7857bb488d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653248:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090f2bcc3/0x22c73c7857bb488d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653258:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090f2bcc3/0x22c73c7857bb488d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653266:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090f2bcc3/0x22c73c7857bb488d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653279:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.653280:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.653282:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.653388:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.653393:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ba720d/0x22c73c7857bb4894 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653400:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.653403:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.653407:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ba720d/0x22c73c7857bb4894 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653426:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1ba720d/0x22c73c7857bb4894 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653434:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ba720d/0x22c73c7857bb4894 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653441:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ba720d/0x22c73c7857bb4894 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653454:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.653461:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.653464:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1ba720d/0x22c73c7857bb4894 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653470:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1413ab200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.653473:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ba720d/0x22c73c7857bb4894 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653480:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ba720d/0x22c73c7857bb4894 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653490:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1ba720d/0x22c73c7857bb4894 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653497:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1ba720d/0x22c73c7857bb4894 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653516:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.653517:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.653519:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.653560:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.653565:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb489b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653572:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.653575:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.653579:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb489b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653609:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb489b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653618:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb489b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653624:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb489b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653637:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.653643:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.653647:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb489b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653665:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.653668:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb489b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.653676:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb489b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783951928.656001:0:26199:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1148 00000100:00100000:1.0:1783951928.656105:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:87141:x1870605465417728:12345-0@lo:5:osp-pre-1-0.0 Request processed in 65893us (66019us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951928.656116:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4903 00010000:00010000:3.0:1783951928.656247:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb489b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656256:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb489b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656279:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.656281:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.656283:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.656778:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.656785:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb48a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656798:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.656802:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.656808:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb48a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656818:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb48a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656838:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb48a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656845:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb48a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656865:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.656875:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.656879:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb48a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656886:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.656891:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb48a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656898:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb48a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656909:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb48a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656916:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb48a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656930:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.656938:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.656940:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.656981:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.656986:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd8c06a/0x22c73c7857bb48a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.656993:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.656996:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.657000:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cd8c06a/0x22c73c7857bb48a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657009:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cd8c06a/0x22c73c7857bb48a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657016:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd8c06a/0x22c73c7857bb48a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657022:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cd8c06a/0x22c73c7857bb48a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657036:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.657043:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.657047:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cd8c06a/0x22c73c7857bb48a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657053:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.657056:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd8c06a/0x22c73c7857bb48a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657076:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd8c06a/0x22c73c7857bb48a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657086:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cd8c06a/0x22c73c7857bb48a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657094:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cd8c06a/0x22c73c7857bb48a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657106:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657108:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657109:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.657147:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.657152:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a1cb29f/0x22c73c7857bb48b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657159:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.657162:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.657165:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a1cb29f/0x22c73c7857bb48b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657174:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a1cb29f/0x22c73c7857bb48b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657181:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a1cb29f/0x22c73c7857bb48b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657194:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a1cb29f/0x22c73c7857bb48b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657207:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.657214:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.657218:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a1cb29f/0x22c73c7857bb48b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657225:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.657228:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a1cb29f/0x22c73c7857bb48b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657235:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a1cb29f/0x22c73c7857bb48b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657246:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a1cb29f/0x22c73c7857bb48b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657253:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a1cb29f/0x22c73c7857bb48b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657263:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657265:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657266:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.657305:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.657317:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861d7bdc/0x22c73c7857bb48b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657324:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.657326:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.657330:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000861d7bdc/0x22c73c7857bb48b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657338:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000861d7bdc/0x22c73c7857bb48b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657345:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000861d7bdc/0x22c73c7857bb48b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657352:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000861d7bdc/0x22c73c7857bb48b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657363:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.657369:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.657373:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000861d7bdc/0x22c73c7857bb48b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657388:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.657391:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000861d7bdc/0x22c73c7857bb48b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657398:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000861d7bdc/0x22c73c7857bb48b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657416:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000861d7bdc/0x22c73c7857bb48b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657423:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000861d7bdc/0x22c73c7857bb48b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657434:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657436:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657438:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.657484:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.657489:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c20c9f0/0x22c73c7857bb48be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657496:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.657499:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.657503:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c20c9f0/0x22c73c7857bb48be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657510:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c20c9f0/0x22c73c7857bb48be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657516:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c20c9f0/0x22c73c7857bb48be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657522:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c20c9f0/0x22c73c7857bb48be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657546:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.657553:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.657556:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c20c9f0/0x22c73c7857bb48be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657562:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.657564:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c20c9f0/0x22c73c7857bb48be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657571:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c20c9f0/0x22c73c7857bb48be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657580:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c20c9f0/0x22c73c7857bb48be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657607:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c20c9f0/0x22c73c7857bb48be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657619:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657621:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657623:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.657661:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.657666:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb48c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657674:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.657696:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.657701:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb48c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657710:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb48c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657718:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb48c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657725:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb48c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657737:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.657743:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.657747:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb48c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657754:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.657757:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb48c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657765:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb48c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657775:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb48c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657793:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb48c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657804:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657806:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657807:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951928.657857:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951928.657861:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009607f5fb/0x22c73c7857bb48cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657870:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=3643s v=(0 0) 00010000:00010000:3.0:1783951928.657872:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951928.657875:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009607f5fb/0x22c73c7857bb48cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657884:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009607f5fb/0x22c73c7857bb48cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657890:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009607f5fb/0x22c73c7857bb48cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657896:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009607f5fb/0x22c73c7857bb48cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657908:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783951928.657913:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951928.657921:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009607f5fb/0x22c73c7857bb48cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657928:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951928.657931:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009607f5fb/0x22c73c7857bb48cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657937:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009607f5fb/0x22c73c7857bb48cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657947:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009607f5fb/0x22c73c7857bb48cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657954:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009607f5fb/0x22c73c7857bb48cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951928.657966:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657968:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951928.657969:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951928.658616:0:87141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87141:1870605465417728:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783951928.658641:0:87141:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x701:0x0] from OST, last_created [0x2c0000401:0x701:0x0]last_used is [0x2c0000401:0x47c:0x0] 00000100:00100000:0.0:1783951928.658744:0:87141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87141:1870605465418112:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783951928.658806:0:87141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951928.658832:0:87141:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951928.658849:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465417984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951928.658884:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951928.658935:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465418112 00000100:00100000:0.0:1783951928.658941:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465418112 00000100:00100000:0.0:1783951928.658999:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4905 00000100:00100000:0.0:1783951928.659008:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:87141:x1870605465418112:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783951928.659049:0:26196:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1794 00000100:00100000:0.0:1783951928.663020:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465417984 00000100:00100000:0.0:1783951928.663034:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465417984 00000100:00100000:0.0:1783951928.663082:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:0.0:1783951928.663090:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465417984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951928.663114:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951928.663185:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465417984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (4299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951928.663191:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:0.0:1783951928.663243:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465417984:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1783951928.665391:0:8436:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1698 00000100:00100000:3.0:1783951928.665474:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:87139:x1870605465417856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 71253us (72365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951928.665483:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4904 00000100:00100000:0.0:1783951928.667327:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:87141:x1870605465418112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8315us (8517us total) trans 4294968951 rc 0/0 00000100:00100000:0.0:1783951928.667339:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4905 00000100:00100000:0.0:1783951928.667391:0:87141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87141:1870605465418112:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783951928.667419:0:87141:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x701:0x0]-[0x2c0000401:0x721:0x0] 00000100:00100000:2.0:1783951928.673344:0:87139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87139:1870605465417856:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783951928.673374:0:87139:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x701:0x0] from OST, last_created [0x280000401:0x701:0x0]last_used is [0x280000401:0x6a2:0x0] 00000100:00100000:0.0:1783951928.673465:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465418240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951928.673529:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.673635:0:87139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87139:1870605465418368:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783951928.673662:0:87139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951928.673690:0:87139:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951928.673712:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465418368 00000100:00100000:2.0:1783951928.673717:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465418368 00000100:00100000:2.0:1783951928.673761:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4906 00000100:00100000:2.0:1783951928.673769:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:87139:x1870605465418368:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783951928.673807:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1794 00000100:00100000:2.0:1783951928.675386:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:87139:x1870605465418368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1614us (1719us total) trans 4294968951 rc 0/0 00000100:00100000:2.0:1783951928.675398:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4906 00000100:00100000:2.0:1783951928.675454:0:87139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87139:1870605465418368:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783951928.675468:0:87139:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x701:0x0]-[0x280000401:0x721:0x0] 00000100:00100000:1.0:1783951928.675782:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465418240 00000100:00100000:1.0:1783951928.675789:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465418240 00000100:00100000:1.0:1783951928.675837:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:1.0:1783951928.675846:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465418240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783951928.675867:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951928.682607:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465418240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6730us (9045us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951928.682631:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00100000:0.0:1783951928.683472:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465418240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951928.819694:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951928.819745:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951928.819774:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447701120 00000100:00100000:0.0:1783951928.819783:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447701120 00000100:00100000:0.0:1783951928.819843:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1109 00000100:00100000:0.0:1783951928.819853:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447701120:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951928.819920:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447701120:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951928.819942:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1109 00000100:00080000:0.0:1783951928.819963:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951928.821525:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447700992 00000100:00100000:1.0:1783951928.821537:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447700992 00000100:00100000:1.0:1783951928.821611:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:1.0:1783951928.821620:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447700992:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951928.821695:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447700992:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 76us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951928.821703:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 75 00010000:00010000:3.0:1783951928.864727:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783951928.935063:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:2.0:1783951929.021387:0:87459:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783951929.021634:0:87459:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951929.888684:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783951930.096257:0:87510:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951930.097647:0:87510:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783951930.914639:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951931.937672:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951932.147865:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951932.147958:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447701248 00000100:00100000:1.0:1783951932.147970:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447701248 00000100:00100000:1.0:1783951932.148044:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1136 00000100:00100000:1.0:1783951932.148054:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:66741:x1870605447701248:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1783951932.148074:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951932.148097:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb48d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1b7 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951932.148173:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb48da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951932.148188:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb48da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951932.148201:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb48da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951932.148253:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783951932.148256:0:67035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951932.148293:0:67035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb48da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951932.148330:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb48d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1b7 expref: 8 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951932.148346:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb48da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1b7 expref: 7 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951932.148355:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531c600) 00010000:00010000:1.0:1783951932.148358:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783951932.148361:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af200, rc 0) 00000100:00100000:1.0:1783951932.148425:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+7:66741:x1870605447701248:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 373us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951932.148432:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1136 00000100:00080000:0.0:1783951932.148820:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951932.164882:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951932.164977:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447701376 00000100:00100000:2.0:1783951932.164990:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447701376 00000100:00100000:2.0:1783951932.165056:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1137 00000100:00100000:2.0:1783951932.165066:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+7:66741:x1870605447701376:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:2.0:1783951932.165107:0:66236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1783951932.165194:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+7:66741:x1870605447701376:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 129us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951932.165202:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1137 00000100:00100000:3.0:1783951932.172128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951932.172282:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447701504 00000100:00100000:0.0:1783951932.172292:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447701504 00000100:00100000:0.0:1783951932.172364:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1138 00000100:00100000:0.0:1783951932.172374:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:66741:x1870605447701504:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:0.0:1783951932.172411:0:68591:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783951932.172476:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:66741:x1870605447701504:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 104us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951932.172483:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1138 00000100:00080000:2.0:1783951932.173731:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951932.177785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951932.177904:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447701632 00000100:00100000:1.0:1783951932.177916:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447701632 00000100:00100000:1.0:1783951932.177967:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4907 00000100:00100000:1.0:1783951932.177976:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2397:x1870605447701632:12345-192.168.202.48@tcp:8:lfs.0 00010000:00080000:1.0:1783951932.178013:0:26207:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp t0 exp 0000000000000000 cur 3647 last 0 00000020:00000080:1.0:1783951932.178045:0:26207:0:(genops.c:1406:class_connect()) connect: client 458183b2-4c6d-478c-9fed-a955779e6611, cookie 0x22c73c7857bb48e1 00002000:00100000:1.0:1783951932.178058:0:26207:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 458183b2-4c6d-478c-9fed-a955779e6611/ffff97b14374f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783951932.178077:0:26207:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783951932.178149:0:26207:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783951932.178193:0:26207:0:(import.c:65:import_set_state_nolock()) ffff97b04b212000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951932.178274:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447701632:12345-192.168.202.48@tcp:8:lfs.0 Request processed in 297us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951932.178299:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4907 00000100:00100000:3.0:1783951932.193893:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951932.195354:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447701760 00000100:00100000:0.0:1783951932.195368:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447701760 00000100:00100000:0.0:1783951932.195561:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2051 00000100:00100000:0.0:1783951932.195572:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:66741:x1870605447701760:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783951932.195615:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951932.195711:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:66741:x1870605447701760:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 140us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951932.195719:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2051 00000100:00080000:2.0:1783951932.196006:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951932.200872:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951932.200963:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447701888 00000100:00100000:2.0:1783951932.200972:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447701888 00000100:00100000:2.0:1783951932.201016:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4908 00000100:00100000:2.0:1783951932.201024:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2397:x1870605447701888:12345-192.168.202.48@tcp:8:lfs.0 00010000:00080000:2.0:1783951932.201058:0:26200:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp t0 exp 0000000000000000 cur 3647 last 0 00000020:00000080:2.0:1783951932.201084:0:26200:0:(genops.c:1406:class_connect()) connect: client 458183b2-4c6d-478c-9fed-a955779e6611, cookie 0x22c73c7857bb48e8 00002000:00100000:2.0:1783951932.201095:0:26200:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 458183b2-4c6d-478c-9fed-a955779e6611/ffff97b04965b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783951932.201111:0:26200:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783951932.201184:0:26200:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783951932.201211:0:26200:0:(import.c:65:import_set_state_nolock()) ffff97b04965a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951932.201277:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447701888:12345-192.168.202.48@tcp:8:lfs.0 Request processed in 252us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951932.201285:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4908 00000100:00100000:1.0:1783951932.215355:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951932.215461:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447702016 00000100:00100000:0.0:1783951932.215473:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447702016 00000100:00100000:0.0:1783951932.215543:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2052 00000100:00100000:0.0:1783951932.215553:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:66741:x1870605447702016:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783951932.215580:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951932.215679:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:66741:x1870605447702016:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 126us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951932.215686:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2052 00000100:00080000:2.0:1783951932.216221:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783951932.964676:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951933.025234:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465418496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951933.025315:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951933.025516:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465418496 00000100:00100000:1.0:1783951933.025526:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465418496 00000100:00100000:1.0:1783951933.025628:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:1.0:1783951933.025648:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465418496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951933.025673:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951933.025722:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465418496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.025729:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00080000:2.0:1783951933.025872:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951933.025926:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465418624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951933.025958:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951933.026022:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465418496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951933.026090:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465418624 00000100:00100000:2.0:1783951933.026095:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465418624 00000100:00100000:2.0:1783951933.026152:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:2.0:1783951933.026160:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04697e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465418624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951933.026172:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951933.026206:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04697e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465418624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951933.026213:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:3.0:1783951933.026677:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465418624:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783951933.026695:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951933.539218:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465418752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951933.539294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951933.539375:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465418752 00000100:00100000:3.0:1783951933.539383:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465418752 00000100:00100000:3.0:1783951933.539433:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:3.0:1783951933.539442:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465418752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951933.539479:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951933.539530:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465418752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951933.539538:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:3.0:1783951933.539584:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465418752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951933.540964:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951933.540980:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465418880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951933.541028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951933.541852:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465418880 00000100:00100000:1.0:1783951933.541862:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465418880 00000100:00100000:1.0:1783951933.541912:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:1.0:1783951933.541922:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465418880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783951933.541970:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:1.0:1783951933.542053:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465418880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.542060:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:1.0:1783951933.542186:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465419136:0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.542217:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951933.542238:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465419648:0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.542262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951933.542294:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465420160:0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.542317:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951933.542348:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465419008:0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.542351:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783951933.542371:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465419264:0@lo:400:kworker.0 00000100:00100000:2.0:1783951933.542392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951933.542406:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951933.542442:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465419520:0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.542443:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465419776:0@lo:400:kworker.0 00000100:00100000:2.0:1783951933.542488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951933.542492:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951933.542517:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465420032:0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.542522:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465420288:0@lo:400:kworker.0 00000100:00100000:2.0:1783951933.542551:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951933.542558:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951933.542621:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465418880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951933.542650:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783951933.542657:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465419392:0@lo:400:kworker.0 00000100:00100000:3.0:1783951933.544368:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465419136 00000100:00100000:3.0:1783951933.544379:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465419136 00000100:00100000:3.0:1783951933.544427:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465419264 00000100:00100000:3.0:1783951933.544430:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465419264 00000100:00100000:3.0:1783951933.544458:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465419520 00000100:00100000:3.0:1783951933.544462:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465419520 00000100:00100000:3.0:1783951933.544474:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465420288 00000100:00100000:3.0:1783951933.544476:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465420288 00000100:00100000:3.0:1783951933.544489:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1783951933.544496:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465419136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951933.544597:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465419648 00000100:00100000:0.0:1783951933.544602:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465419648 00000100:00100000:0.0:1783951933.544648:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465420160 00000100:00100000:0.0:1783951933.544652:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465420160 00000100:00100000:0.0:1783951933.544679:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465419776 00000100:00100000:0.0:1783951933.544682:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465419776 00000100:00100000:0.0:1783951933.544695:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465420032 00000100:00100000:0.0:1783951933.544698:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465420032 00000100:00100000:0.0:1783951933.544729:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:0.0:1783951933.544736:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465419648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.546565:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:1.0:1783951933.546583:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465420160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.546686:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465420160:12345-0@lo:400:kworker.0 Request processed in 110us (4367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.546694:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:1.0:1783951933.546716:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:1.0:1783951933.546722:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465419776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.546766:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465419776:12345-0@lo:400:kworker.0 Request processed in 45us (4281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.546773:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00000100:00100000:1.0:1783951933.546786:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:1.0:1783951933.546792:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465420032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.546824:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465420032:12345-0@lo:400:kworker.0 Request processed in 33us (4273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.546829:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:1.0:1783951933.546848:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465419008 00000100:00100000:1.0:1783951933.546854:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465419008 00000100:00100000:1.0:1783951933.546885:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783951933.546892:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465419008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.546940:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465419008:12345-0@lo:400:kworker.0 Request processed in 48us (4549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.546946:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783951933.546983:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1783951933.546991:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465419264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.547021:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465419264:12345-0@lo:400:kworker.0 Request processed in 32us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.547027:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1783951933.547043:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1783951933.547049:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465419520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.547077:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465419520:12345-0@lo:400:kworker.0 Request processed in 28us (4593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.547082:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1783951933.547094:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1783951933.547101:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465420288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.547126:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465420288:12345-0@lo:400:kworker.0 Request processed in 27us (4569us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.547131:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1783951933.547193:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465419264:0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.547206:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465419776:0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.547217:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465420288:0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.547229:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465420160:0@lo:400:kworker.0 00000100:00080000:1.0:1783951933.550097:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951933.550123:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951933.550126:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951933.550129:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951933.550511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951933.550562:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465419904:0@lo:400:kworker.0 00000100:00100000:2.0:1783951933.550611:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951933.550659:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465419008:0@lo:400:kworker.0 00000100:00100000:2.0:1783951933.550683:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465419520:0@lo:400:kworker.0 00000100:00100000:2.0:1783951933.550697:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465420032:0@lo:400:kworker.0 00000100:00100000:2.0:1783951933.550747:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465419392 00000100:00100000:2.0:1783951933.550753:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465419392 00000100:00100000:2.0:1783951933.550798:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465419904 00000100:00100000:2.0:1783951933.550801:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465419904 00000100:00100000:2.0:1783951933.550824:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1783951933.550847:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465419392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951933.550901:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465419392:12345-0@lo:400:kworker.0 Request processed in 68us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951933.550909:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1783951933.550926:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1783951933.550932:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465419904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951933.550974:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465419904:12345-0@lo:400:kworker.0 Request processed in 42us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951933.550980:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00080000:2.0:1783951933.551001:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951933.551018:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465419392:0@lo:400:kworker.0 00000100:00100000:2.0:1783951933.551027:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465419904:0@lo:400:kworker.0 00000100:00100000:3.0:1783951933.553342:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465419136:12345-0@lo:400:kworker.0 Request processed in 8827us (11105us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951933.553358:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1783951933.553529:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465419136:0@lo:400:kworker.0 00000100:00100000:0.0:1783951933.554567:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465419648:12345-0@lo:400:kworker.0 Request processed in 9827us (12299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951933.554579:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:1.0:1783951933.555732:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465419648:0@lo:400:kworker.0 00000100:00100000:1.0:1783951933.933680:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951933.933721:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951933.933750:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951933.933772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951933.933835:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951933.933863:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447702400 00000100:00100000:1.0:1783951933.933872:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447702400 00000100:00100000:1.0:1783951933.933921:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447702272 00000100:00100000:1.0:1783951933.933924:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447702272 00000100:00100000:1.0:1783951933.933949:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1116 00000100:00100000:1.0:1783951933.933960:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447702400:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951933.934045:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447702400:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 87us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.934053:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1116 00000100:00100000:1.0:1783951933.934074:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1117 00000100:00100000:1.0:1783951933.934081:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447702272:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951933.934106:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447702272:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.934111:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1117 00000100:00100000:1.0:1783951933.934131:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447702656 00000100:00100000:1.0:1783951933.934135:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447702656 00000100:00100000:1.0:1783951933.934188:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447702528 00000100:00100000:1.0:1783951933.934191:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447702528 00000100:00100000:1.0:1783951933.934209:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2636 00000100:00100000:1.0:1783951933.934215:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447702656:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951933.934243:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447702656:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.934249:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2636 00000100:00100000:1.0:1783951933.934261:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2637 00000100:00100000:1.0:1783951933.934267:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447702528:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951933.934291:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447702528:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951933.934297:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2637 00000100:00100000:3.0:1783951933.937776:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447702144 00000100:00100000:3.0:1783951933.937792:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447702144 00000100:00100000:3.0:1783951933.937929:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:3.0:1783951933.937939:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447702144:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951933.938037:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447702144:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 100us (4363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951933.938045:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 77 00010000:00010000:2.0:1783951933.993276:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951934.054251:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465420416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951934.054323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951934.054383:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465420416 00000100:00100000:0.0:1783951934.054390:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465420416 00000100:00100000:0.0:1783951934.054436:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:0.0:1783951934.054445:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465420416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951934.054472:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951934.054514:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465420416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951934.054521:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:0.0:1783951934.054566:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465420416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951934.055526:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465420544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951934.055568:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951934.055648:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465420544 00000100:00100000:3.0:1783951934.055653:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465420544 00000100:00100000:3.0:1783951934.055686:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:3.0:1783951934.055693:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465420544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951934.055708:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951934.055743:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465420544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951934.055752:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:3.0:1783951934.055783:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465420544:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1783951934.060538:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00080000:2.0:1783951934.060554:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968951 is committed 00000001:00100000:2.0:1783951934.063348:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00080000:2.0:1783951934.063364:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968951 is committed 00010000:00010000:2.0:1783951935.019279:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951936.033600:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951937.058770:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951938.080759:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951938.145681:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783951938.145702:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465420672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951938.145771:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951938.145951:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951938.145962:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465420800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951938.145995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951938.146104:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465420672 00000100:00100000:2.0:1783951938.146110:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465420672 00000100:00100000:2.0:1783951938.146151:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465420800 00000100:00100000:2.0:1783951938.146153:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465420800 00000100:00100000:2.0:1783951938.146164:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:2.0:1783951938.146171:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465420672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951938.146199:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951938.146230:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465420672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951938.146235:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:2.0:1783951938.146246:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:2.0:1783951938.146249:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465420800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951938.146259:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951938.146294:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465420800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951938.146300:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:2.0:1783951938.146337:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465420800:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783951938.146397:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951938.146400:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951938.146470:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465420672:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1783951938.645143:0:87703:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:1.0:1783951938.656835:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951938.656857:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465420928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951938.656919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951938.657276:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465420928 00000100:00100000:2.0:1783951938.657283:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465420928 00000100:00100000:2.0:1783951938.657484:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:2.0:1783951938.657491:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465420928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951938.657523:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951938.657567:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465420928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951938.657574:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:2.0:1783951938.657652:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465420928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783951938.657730:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951938.657738:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465421056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951938.657763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951938.657787:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465421056 00000100:00100000:0.0:1783951938.657790:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465421056 00000100:00100000:0.0:1783951938.657811:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:0.0:1783951938.657826:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465421056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951938.657843:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1783951938.657872:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465421056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951938.657877:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000100:00100000:0.0:1783951938.657904:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465421056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951938.658137:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465421184:0@lo:400:kworker.0 00000100:00100000:2.0:1783951938.658164:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951938.658215:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465421184 00000100:00100000:3.0:1783951938.658219:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465421184 00000100:00100000:3.0:1783951938.658244:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783951938.658250:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465421184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.658545:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465421312:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.658573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951938.658625:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465421312 00000100:00100000:1.0:1783951938.658629:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465421312 00000100:00100000:1.0:1783951938.658664:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1783951938.658671:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465421312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.658714:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465421312:12345-0@lo:400:kworker.0 Request processed in 44us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951938.658721:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00080000:1.0:1783951938.658740:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951938.658757:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465421312:0@lo:400:kworker.0 00000100:00100000:3.0:1783951938.659736:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465421184:12345-0@lo:400:kworker.0 Request processed in 1482us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951938.659746:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783951938.659967:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465421824:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660001:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951938.660030:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783951938.660036:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465421696:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660057:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951938.660073:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465422208:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951938.660119:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465421824 00000100:00100000:1.0:1783951938.660124:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465421824 00000100:00100000:1.0:1783951938.660153:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465421696 00000100:00100000:1.0:1783951938.660156:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465421696 00000100:00100000:1.0:1783951938.660178:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465422208 00000100:00100000:1.0:1783951938.660181:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465422208 00000100:00100000:1.0:1783951938.660198:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1783951938.660205:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465421824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660247:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465421824:12345-0@lo:400:kworker.0 Request processed in 43us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951938.660253:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1783951938.660267:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1783951938.660273:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465421696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660320:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465421696:12345-0@lo:400:kworker.0 Request processed in 47us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951938.660337:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1783951938.660350:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1783951938.660356:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465422208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660384:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465422208:12345-0@lo:400:kworker.0 Request processed in 29us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951938.660390:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00080000:1.0:1783951938.660411:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951938.660422:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465421440:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951938.660463:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465421952:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951938.660503:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783951938.660508:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465421568:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660529:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951938.660543:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465422080:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660563:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951938.660617:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465421952 00000100:00100000:1.0:1783951938.660621:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465421952 00000100:00100000:1.0:1783951938.660654:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465422080 00000100:00100000:1.0:1783951938.660657:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465422080 00000100:00100000:1.0:1783951938.660677:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1783951938.660684:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465421952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660716:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465421952:12345-0@lo:400:kworker.0 Request processed in 33us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951938.660721:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1783951938.660739:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1783951938.660744:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465422080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660776:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465422080:12345-0@lo:400:kworker.0 Request processed in 31us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951938.660781:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1783951938.660803:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465421440 00000100:00100000:1.0:1783951938.660806:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465421440 00000100:00100000:1.0:1783951938.660825:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465421568 00000100:00100000:1.0:1783951938.660827:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465421568 00000100:00100000:1.0:1783951938.660839:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1783951938.660844:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465421440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660872:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465421440:12345-0@lo:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951938.660877:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1783951938.660886:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1783951938.660890:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465421568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660911:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465421568:12345-0@lo:400:kworker.0 Request processed in 21us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951938.660916:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00080000:1.0:1783951938.660931:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783951938.660933:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951938.660935:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951938.660937:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951938.660962:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465421696:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660972:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465422208:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.660980:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465421824:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.661019:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465421568:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.661026:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968951 gen 2 00000100:00100000:1.0:1783951938.661036:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465422080:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.661044:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465421440:0@lo:400:kworker.0 00000100:00100000:1.0:1783951938.661050:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968951 gen 2 00000100:00100000:1.0:1783951938.661059:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465421952:0@lo:400:kworker.0 00000100:00100000:2.0:1783951938.671443:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465421184:0@lo:400:kworker.0 00000100:00100000:1.0:1783951939.056211:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951939.056257:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951939.056309:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951939.056339:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951939.056388:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951939.056417:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447703040 00000100:00100000:1.0:1783951939.056426:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447703040 00000100:00100000:1.0:1783951939.056478:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447702912 00000100:00100000:1.0:1783951939.056482:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447702912 00000100:00100000:1.0:1783951939.056505:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1124 00000100:00100000:1.0:1783951939.056514:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447703040:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951939.056696:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447703296 00000100:00100000:0.0:1783951939.056701:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447703296 00000100:00100000:0.0:1783951939.056733:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447703168 00000100:00100000:0.0:1783951939.056735:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447703168 00000100:00100000:0.0:1783951939.056758:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2640 00000100:00100000:0.0:1783951939.056766:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447703296:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951939.056862:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447703040:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 348us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951939.056869:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1124 00000100:00100000:1.0:1783951939.056888:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1125 00000100:00100000:1.0:1783951939.056895:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447702912:12345-192.168.202.48@tcp:400:kworker.0 00000100:00080000:2.0:1783951939.057007:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951939.057012:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951939.057015:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783951939.057017:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951939.057030:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2641 00000100:00100000:2.0:1783951939.057039:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447703168:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951939.057103:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447702784 00000100:00100000:3.0:1783951939.057108:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447702784 00000100:00100000:3.0:1783951939.057139:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:3.0:1783951939.057145:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447702784:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951939.059387:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447703296:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 2610us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951939.059403:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2640 00000100:00100000:1.0:1783951939.059830:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447702912:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 2934us (3488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951939.059855:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1125 00000100:00100000:2.0:1783951939.064673:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447703168:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 7621us (8270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951939.065772:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2641 00000100:00100000:3.0:1783951939.069441:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447702784:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 12282us (13226us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951939.069458:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 79 00010000:00010000:0.0:1783951939.104874:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951939.169465:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951939.169495:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465422336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951939.169567:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951939.169663:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465422336 00000100:00100000:2.0:1783951939.169673:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465422336 00000100:00100000:1.0:1783951939.169736:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951939.169748:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1783951939.169750:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465422464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951939.169762:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465422336:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951939.169786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1783951939.169790:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951939.169819:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465422464 00000100:00100000:1.0:1783951939.169824:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465422464 00000100:00100000:2.0:1783951939.169847:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465422336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951939.169851:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:2.0:1783951939.169864:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1783951939.169865:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465422464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783951939.169885:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951939.169923:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465422336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951939.169928:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465422464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951939.169937:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:1.0:1783951939.169971:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465422464:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783951940.128736:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783951940.608845:0:87751:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1783951941.152888:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951942.177717:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951942.753756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951942.754002:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447703424 00000100:00100000:3.0:1783951942.754016:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447703424 00000100:00100000:3.0:1783951942.754114:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1139 00000100:00100000:3.0:1783951942.754127:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+7:67208:x1870605447703424:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:3.0:1783951942.754188:0:66236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00080000:2.0:1783951942.754616:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951942.754810:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+7:67208:x1870605447703424:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 569us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951942.754822:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1139 00000100:00100000:0.0:1783951942.777376:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951942.777585:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447703552 00000100:00100000:2.0:1783951942.777633:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447703552 00000100:00100000:2.0:1783951942.777736:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1140 00000100:00100000:2.0:1783951942.777749:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:67208:x1870605447703552:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:2.0:1783951942.777806:0:66237:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00080000:1.0:1783951942.777910:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951942.782236:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:67208:x1870605447703552:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 4469us (4854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951942.782264:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1140 00000100:00100000:1.0:1783951942.795568:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951942.797261:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447703680 00000100:00100000:2.0:1783951942.797281:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447703680 00000100:00100000:2.0:1783951942.797421:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2061 00000100:00100000:2.0:1783951942.797436:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:67208:x1870605447703680:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:2.0:1783951942.797507:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951942.797641:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:67208:x1870605447703680:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 209us (3946us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951942.797651:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2061 00000100:00080000:1.0:1783951942.798424:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951942.800916:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951942.801021:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447703808 00000100:00100000:3.0:1783951942.801034:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447703808 00000100:00100000:3.0:1783951942.801128:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2062 00000100:00100000:3.0:1783951942.801140:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:67208:x1870605447703808:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783951942.801194:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951942.801306:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:67208:x1870605447703808:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 168us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951942.801315:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2062 00000100:00080000:1.0:1783951942.802072:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951942.865023:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951942.865688:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447703936 00000100:00100000:2.0:1783951942.865703:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447703936 00000100:00100000:2.0:1783951942.865841:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1141 00000100:00100000:2.0:1783951942.865855:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:67224:x1870605447703936:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783951942.865884:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951942.865914:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb48ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1be expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.865997:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866014:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866042:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866062:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb48fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866070:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb48fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866076:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb48fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866209:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb4904 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866217:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb4904 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866224:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb4904 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951942.866274:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783951942.866278:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951942.866304:0:66238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb4904 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866319:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866326:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866332:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866351:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866357:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951942.866362:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866378:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.866401:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531c600) 00010000:00010000:2.0:1783951942.867398:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951942.867544:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.867832:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb48f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.867859:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb48fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.867865:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb48fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.867871:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb48fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.867876:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216bc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951942.867880:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb48fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.867887:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb48fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.867901:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff97b1584d4f00) 00010000:00010000:2.0:1783951942.867904:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951942.867907:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb48fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.867912:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb48fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.867990:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb48ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1be expref: 9 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.868008:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb4904 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1be expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951942.868015:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:2.0:1783951942.868018:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951942.868020:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216ae00, rc 0) 00000100:00100000:2.0:1783951942.868137:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:67224:x1870605447703936:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2284us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951942.868147:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1141 00000100:00100000:0.0:1783951942.874207:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951942.874569:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447704192 00000100:00100000:3.0:1783951942.874584:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447704192 00000100:00100000:3.0:1783951942.874873:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1142 00000100:00100000:3.0:1783951942.874888:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+8:67224:x1870605447704192:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783951942.874917:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951942.874947:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb490b lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1c5 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875054:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875072:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875087:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875103:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4919 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875111:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4919 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875136:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4919 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875247:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875256:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875263:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875270:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875278:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951942.875283:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875291:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.875319:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:3.0:1783951942.875323:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951942.875329:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.879150:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4912 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.879183:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4919 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.879213:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4919 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.879220:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4919 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.879227:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951942.879233:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4919 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.879241:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4919 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.879263:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff97b158d55c00) 00010000:00010000:3.0:1783951942.879266:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951942.879272:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4919 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.879277:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4919 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.889746:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb490b lrc: 1/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1c5 expref: 9 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.889778:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:3.0:1783951942.889781:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951942.889788:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb490b lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1c5 expref: 9 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.889836:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70e00, rc 0) 00000100:00100000:2.0:1783951942.895258:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+8:67224:x1870605447704192:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 20355us (21046us total) trans 0 rc 301/301 00000100:00100000:2.0:1783951942.895275:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1142 00000100:00100000:0.0:1783951942.916005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951942.916118:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447704448 00000100:00100000:3.0:1783951942.916133:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447704448 00000100:00100000:3.0:1783951942.916216:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1143 00000100:00100000:3.0:1783951942.916229:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:67224:x1870605447704448:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783951942.916257:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951942.916284:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb4920 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1cc expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951942.916461:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783951942.916663:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb4920 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1cc expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.916680:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531c600) 00010000:00010000:3.0:1783951942.916683:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783951942.916690:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb4920 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1cc expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951942.916707:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70e00, rc 0) 00000100:00100000:3.0:1783951942.916779:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:67224:x1870605447704448:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 553us (789us total) trans 107374182401 rc 301/301 00000100:00100000:3.0:1783951942.916786:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1143 00000100:00100000:0.0:1783951942.932199:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951942.934934:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447704576 00000100:00100000:1.0:1783951942.934958:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447704576 00000100:00100000:1.0:1783951942.935064:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1144 00000100:00100000:1.0:1783951942.935077:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+9:67224:x1870605447704576:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:1.0:1783951942.935186:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935208:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935244:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935262:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb4935 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935269:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb4935 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935275:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb4935 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935389:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935397:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935684:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783951942.935794:0:67035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783951942.935812:0:67035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935830:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935837:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935844:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935861:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935868:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951942.935872:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935880:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935894:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:1.0:1783951942.935898:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951942.935904:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935911:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb492e lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935930:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb4935 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935935:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb4935 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935941:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb4935 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935945:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aee00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951942.935948:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb4935 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935964:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb4935 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935973:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff97b164ef8600) 00010000:00010000:1.0:1783951942.935975:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951942.935978:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb4935 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.935984:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb4935 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.936000:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.936006:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.936011:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.936017:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951942.936019:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.936024:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.936030:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff97b164ef8300) 00010000:00010000:1.0:1783951942.936033:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951942.936035:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951942.936051:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb493c lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951942.936160:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+9:67224:x1870605447704576:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 1082us (3973us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951942.936170:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1144 00000100:00100000:0.0:1783951942.939486:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951942.939673:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447704832 00000100:00100000:1.0:1783951942.939687:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447704832 00000100:00100000:1.0:1783951942.939822:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 221 00000100:00100000:1.0:1783951942.939836:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+9:67224:x1870605447704832:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1783951942.940135:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:67224:x1870605447704832:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 301us (664us total) trans 107374182402 rc 0/0 00000100:00100000:1.0:1783951942.940144:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 221 00010000:00010000:0.0:1783951943.200917:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951943.264892:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465422592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951943.265004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951943.265130:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465422592 00000100:00100000:0.0:1783951943.265142:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465422592 00000100:00100000:0.0:1783951943.265231:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:0.0:1783951943.265245:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465422592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951943.265279:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783951943.265400:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951943.267952:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465422720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951943.268066:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951943.268629:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465422720 00000100:00100000:3.0:1783951943.268642:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465422720 00000100:00100000:3.0:1783951943.268722:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:3.0:1783951943.268736:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465422720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951943.268794:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951943.268863:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465422720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951943.268872:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00080000:2.0:1783951943.269802:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951943.269878:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465422720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783951943.271162:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465422592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5896us (6133us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951943.271176:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:2.0:1783951943.274743:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465422592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951943.779473:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465422848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951943.779608:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951943.779722:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465422848 00000100:00100000:1.0:1783951943.779732:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465422848 00000100:00100000:1.0:1783951943.779804:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:1.0:1783951943.779815:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465422848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951943.779864:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951943.784145:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465422976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951943.784631:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951943.784688:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951943.784694:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465423104:0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.784725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951943.784797:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465422976 00000100:00100000:2.0:1783951943.784806:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465422976 00000100:00100000:2.0:1783951943.784856:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:2.0:1783951943.784866:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465422976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951943.784919:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1783951943.784970:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465422976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951943.784978:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:2.0:1783951943.785004:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465423104 00000100:00100000:2.0:1783951943.785008:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465423104 00000100:00100000:2.0:1783951943.785035:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783951943.785040:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465423104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.785071:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465423104:12345-0@lo:400:kworker.0 Request processed in 30us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951943.785077:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783951943.785126:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465423104:0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.785145:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465422976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951943.785525:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465423232:0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.785574:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951943.785699:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465423232 00000100:00100000:2.0:1783951943.785704:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465423232 00000100:00100000:2.0:1783951943.785768:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1783951943.785776:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465423232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.785819:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465423232:12345-0@lo:400:kworker.0 Request processed in 44us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951943.785825:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00080000:2.0:1783951943.785845:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951943.785867:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465423232:0@lo:400:kworker.0 00000100:00100000:1.0:1783951943.785965:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465422848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6149us (6374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951943.785974:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1783951943.786102:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465422848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951943.786614:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951943.788616:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465423488:0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.788716:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951943.788768:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951943.788774:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465423616:0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.788794:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951943.788837:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465423488 00000100:00100000:2.0:1783951943.788846:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465423488 00000100:00100000:2.0:1783951943.788912:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465423616 00000100:00100000:2.0:1783951943.788915:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465423616 00000100:00100000:2.0:1783951943.788944:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1783951943.788954:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465423488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.789020:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465423488:12345-0@lo:400:kworker.0 Request processed in 67us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951943.789028:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1783951943.789049:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1783951943.789055:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465423616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.789084:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465423616:12345-0@lo:400:kworker.0 Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951943.789112:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00080000:2.0:1783951943.789135:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951943.789139:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951943.789174:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465423616:0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.789185:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465423488:0@lo:400:kworker.0 00000100:00100000:1.0:1783951943.792458:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465423744:0@lo:400:kworker.0 00000100:00100000:1.0:1783951943.792581:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951943.792716:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465423360:0@lo:400:kworker.0 00000100:00100000:1.0:1783951943.792745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951943.792800:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465423744 00000100:00100000:1.0:1783951943.792809:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465423744 00000100:00100000:1.0:1783951943.792859:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465423360 00000100:00100000:1.0:1783951943.792862:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465423360 00000100:00100000:1.0:1783951943.792894:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1783951943.792903:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465423744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951943.792967:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465423744:12345-0@lo:400:kworker.0 Request processed in 65us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951943.792975:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1783951943.792996:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1783951943.793003:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465423360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951943.793030:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465423360:12345-0@lo:400:kworker.0 Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951943.793036:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00080000:1.0:1783951943.793057:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951943.793096:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465423744:0@lo:400:kworker.0 00000100:00100000:1.0:1783951943.793107:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465423360:0@lo:400:kworker.0 00000100:00100000:0.0:1783951943.794097:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951943.795631:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465424000:0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.795735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951943.795793:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951943.795800:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465424128:0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.795827:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951943.795864:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465424128 00000100:00100000:2.0:1783951943.795873:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465424128 00000100:00100000:2.0:1783951943.795937:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1783951943.795947:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465424128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.796008:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465424128:12345-0@lo:400:kworker.0 Request processed in 62us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951943.796016:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1783951943.796064:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465424128:0@lo:400:kworker.0 00000100:00100000:3.0:1783951943.797435:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465424000 00000100:00100000:3.0:1783951943.797449:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465424000 00000100:00100000:3.0:1783951943.797526:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:3.0:1783951943.797537:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465424000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951943.797695:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465424000:12345-0@lo:400:kworker.0 Request processed in 159us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951943.797702:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00080000:2.0:1783951943.798621:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951943.798692:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465424000:0@lo:400:kworker.0 00000100:00100000:3.0:1783951943.803359:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465423872:0@lo:400:kworker.0 00000100:00100000:3.0:1783951943.803473:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951943.803686:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465423872 00000100:00100000:2.0:1783951943.803698:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465423872 00000100:00100000:2.0:1783951943.803787:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:2.0:1783951943.803800:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465423872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951943.803888:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465423872:12345-0@lo:400:kworker.0 Request processed in 91us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951943.803897:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:2.0:1783951943.803947:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465423872:0@lo:400:kworker.0 00000100:00080000:1.0:1783951943.804084:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951944.175408:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951944.175446:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951944.175474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951944.175491:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951944.175511:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951944.175554:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447705088 00000100:00100000:0.0:1783951944.175566:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447705088 00000100:00100000:1.0:1783951944.177026:0:87124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447704960 00000100:00100000:1.0:1783951944.177039:0:87124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447704960 00000100:00100000:1.0:1783951944.177105:0:87124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:1.0:1783951944.177116:0:87124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447704960:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951944.177213:0:87124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447704960:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 100us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951944.178023:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447705216 00000100:00100000:0.0:1783951944.178031:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447705216 00000100:00100000:0.0:1783951944.178088:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1132 00000100:00100000:0.0:1783951944.178100:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:2401:x1870605447705088:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951944.178165:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:2401:x1870605447705088:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 69us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951944.178174:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1132 00000100:00100000:0.0:1783951944.178194:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1133 00000100:00100000:0.0:1783951944.178200:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447705216:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951944.178412:0:87124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:0.0:1783951944.179017:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447705216:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 814us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951944.179026:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1133 00000100:00100000:0.0:1783951944.179063:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447705344 00000100:00100000:0.0:1783951944.179070:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447705344 00000100:00100000:0.0:1783951944.179118:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447705472 00000100:00100000:0.0:1783951944.179122:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447705472 00000100:00100000:0.0:1783951944.179152:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2644 00000100:00100000:0.0:1783951944.179161:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447705344:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951944.179232:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2645 00000100:00100000:1.0:1783951944.179370:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447705472:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951944.179408:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447705472:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 45us (3895us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951944.179415:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2645 00000100:00080000:1.0:1783951944.180190:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951944.180196:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951944.180200:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951944.180203:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783951944.180874:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447705344:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 1704us (5417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951944.181083:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2644 00010000:00010000:0.0:1783951944.230528:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951944.293711:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465424256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951944.293808:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951944.294135:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465424256 00000100:00100000:3.0:1783951944.294146:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465424256 00000100:00100000:3.0:1783951944.294429:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:3.0:1783951944.294441:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465424256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951944.294484:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951944.294685:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465424256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 245us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951944.294694:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:2.0:1783951944.298140:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465424384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951944.298266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951944.298345:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465424384 00000100:00100000:2.0:1783951944.298355:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465424384 00000100:00100000:2.0:1783951944.298413:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:2.0:1783951944.298424:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465424384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951944.298465:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951944.298516:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465424384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951944.298525:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:2.0:1783951944.298616:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465424384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951944.303796:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465424256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783951945.249960:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951946.274642:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951947.297421:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951948.321744:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951948.385714:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951948.385751:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465424512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951948.385868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951948.385937:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465424512 00000100:00100000:3.0:1783951948.385967:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465424512 00000100:00100000:3.0:1783951948.386039:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:3.0:1783951948.386050:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465424512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951948.386098:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951948.386152:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465424512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951948.386160:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00100000:3.0:1783951948.386223:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465424512:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783951948.386381:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951948.386612:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951948.386624:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465424640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951948.386663:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951948.386734:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465424640 00000100:00100000:0.0:1783951948.386740:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465424640 00000100:00100000:0.0:1783951948.386788:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1783951948.386797:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465424640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783951948.386820:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951948.386874:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465424640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951948.386881:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00080000:1.0:1783951948.387093:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951948.387122:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465424640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951948.898302:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465425024:0@lo:400:kworker.0 00000100:00100000:0.0:1783951948.898349:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465424768:0@lo:400:kworker.0 00000100:00100000:1.0:1783951948.898431:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465424896:0@lo:400:kworker.0 00000100:00100000:2.0:1783951948.898817:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14debbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465425152:0@lo:400:kworker.0 00000100:00100000:0.0:1783951948.911412:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951948.911523:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14debad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465425280:0@lo:400:kworker.0 00000100:00100000:0.0:1783951948.911611:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951948.912762:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465425792:0@lo:400:kworker.0 00000100:00100000:0.0:1783951948.912828:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951948.913018:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465424768 00000100:00100000:0.0:1783951948.913026:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465424768 00000100:00100000:0.0:1783951948.913091:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783951948.913917:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465424768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951948.914017:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465424768:12345-0@lo:400:kworker.0 Request processed in 916us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951948.914026:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783951948.914086:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465425280 00000100:00100000:0.0:1783951948.914092:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465425280 00000100:00100000:0.0:1783951948.914160:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1783951948.914168:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465425280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951948.914206:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465425280:12345-0@lo:400:kworker.0 Request processed in 39us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951948.914212:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00080000:0.0:1783951948.914235:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951948.914258:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465426304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951948.914307:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951948.914368:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465424768:0@lo:400:kworker.0 00000100:00100000:0.0:1783951948.914386:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14debad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465425280:0@lo:400:kworker.0 00000100:00100000:0.0:1783951948.914450:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465426304 00000100:00100000:0.0:1783951948.914453:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465426304 00000100:00100000:0.0:1783951948.914483:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:0.0:1783951948.914489:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465426304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951948.916265:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1783951948.916767:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465426304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2273us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951948.916780:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:0.0:1783951948.916877:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465426304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951948.916973:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465425792 00000100:00100000:0.0:1783951948.916980:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465425792 00000100:00100000:0.0:1783951948.917048:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646 00000100:00100000:0.0:1783951948.917056:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465425792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951948.919266:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465425792:12345-0@lo:400:kworker.0 Request processed in 2198us (6424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951948.919293:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646 00000100:00080000:0.0:1783951948.920053:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951948.920140:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951948.922794:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465424896 00000100:00100000:1.0:1783951948.922816:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465424896 00000100:00100000:1.0:1783951948.923043:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1783951948.923060:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465424896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951948.923185:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465424896:12345-0@lo:400:kworker.0 Request processed in 133us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951948.923224:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00080000:1.0:1783951948.923261:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951948.923321:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465424896:0@lo:400:kworker.0 00000100:00100000:1.0:1783951948.923337:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465425408:0@lo:400:kworker.0 00000100:00100000:1.0:1783951948.923610:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951948.923649:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465425408 00000100:00100000:1.0:1783951948.923654:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465425408 00000100:00100000:1.0:1783951948.923686:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:1.0:1783951948.923693:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465425408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951948.923729:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465425408:12345-0@lo:400:kworker.0 Request processed in 36us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951948.923738:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:1.0:1783951948.923767:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465425408:0@lo:400:kworker.0 00000100:00100000:1.0:1783951948.923775:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465425920:0@lo:400:kworker.0 00000100:00100000:1.0:1783951948.923804:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951948.923830:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465425920 00000100:00100000:1.0:1783951948.923834:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465425920 00000100:00100000:1.0:1783951948.924123:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647 00000100:00100000:1.0:1783951948.924130:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465425920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951948.924167:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465425920:12345-0@lo:400:kworker.0 Request processed in 38us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951948.924172:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647 00000100:00080000:1.0:1783951948.924349:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951948.924374:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465425920:0@lo:400:kworker.0 00000100:00100000:2.0:1783951948.924813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951948.924911:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465425664:0@lo:400:kworker.0 00000100:00100000:2.0:1783951948.924952:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951948.924981:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465425664 00000100:00100000:2.0:1783951948.924987:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465425664 00000100:00100000:2.0:1783951948.925025:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1783951948.925032:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465425664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951948.925073:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465425664:12345-0@lo:400:kworker.0 Request processed in 42us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951948.925095:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1783951948.925131:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465425664:0@lo:400:kworker.0 00000100:00100000:2.0:1783951948.925139:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465426176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783951948.925167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951948.925187:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465426176 00000100:00100000:2.0:1783951948.925197:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465426176 00000100:00100000:2.0:1783951948.925222:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1783951948.925228:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465426176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951948.925261:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951948.925298:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465426176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951948.925304:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1783951948.925336:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465426176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951948.925841:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465425152 00000100:00100000:1.0:1783951948.925912:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465425152 00000100:00100000:1.0:1783951948.925972:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1783951948.925980:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465425152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951948.926034:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465425152:12345-0@lo:400:kworker.0 Request processed in 56us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951948.926041:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00080000:2.0:1783951948.926450:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951948.926484:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14debbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465425152:0@lo:400:kworker.0 00000001:00080000:2.0:1783951948.928933:0:87120:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182402 is committed 00000100:00100000:3.0:1783951948.931963:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951948.932067:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14debb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465425536:0@lo:400:kworker.0 00000100:00100000:3.0:1783951948.932148:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951948.932171:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465426048:0@lo:400:kworker.0 00000100:00100000:3.0:1783951948.932220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951948.932267:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465425024 00000100:00100000:3.0:1783951948.932277:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465425024 00000100:00100000:3.0:1783951948.932364:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465425536 00000100:00100000:3.0:1783951948.932367:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465425536 00000100:00100000:3.0:1783951948.932387:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465426048 00000100:00100000:3.0:1783951948.932389:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465426048 00000100:00100000:3.0:1783951948.932411:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1783951948.932420:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465425024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951948.932483:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465425024:12345-0@lo:400:kworker.0 Request processed in 64us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951948.932490:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1783951948.932520:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1783951948.932545:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465425536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951948.932578:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465425536:12345-0@lo:400:kworker.0 Request processed in 34us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951948.932584:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1783951948.932622:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1783951948.932629:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465426048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951948.932657:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465426048:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951948.932663:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00080000:3.0:1783951948.932693:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951948.932731:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465426048:0@lo:400:kworker.0 00000100:00100000:3.0:1783951948.932764:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465425024:0@lo:400:kworker.0 00000100:00100000:3.0:1783951948.932774:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14debb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465425536:0@lo:400:kworker.0 00000100:00100000:0.0:1783951948.933808:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465425792:0@lo:400:kworker.0 00000100:00100000:2.0:1783951949.296922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951949.296975:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951949.297019:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951949.297053:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951949.297097:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951949.297209:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447705984 00000100:00100000:1.0:1783951949.297223:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447705984 00000100:00100000:1.0:1783951949.297301:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447706112 00000100:00100000:1.0:1783951949.297304:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447706112 00000100:00100000:1.0:1783951949.297332:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2648 00000100:00100000:1.0:1783951949.297344:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447705984:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951949.297449:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447705984:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 107us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951949.297458:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2648 00000100:00100000:1.0:1783951949.297506:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2649 00000100:00100000:1.0:1783951949.297515:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447706112:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951949.297545:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447706112:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 32us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951949.297560:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2649 00000100:00100000:0.0:1783951949.298345:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447705600 00000100:00100000:0.0:1783951949.298358:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447705600 00000100:00100000:0.0:1783951949.298411:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:0.0:1783951949.298421:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447705600:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951949.298515:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447705600:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 96us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951949.298523:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00080000:2.0:1783951949.298961:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951949.298968:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951949.299387:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447705728 00000100:00100000:3.0:1783951949.299397:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447705728 00000100:00100000:3.0:1783951949.299639:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447705856 00000100:00100000:3.0:1783951949.299643:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447705856 00000100:00100000:1.0:1783951949.299767:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1140 00000100:00100000:1.0:1783951949.299780:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:2398:x1870605447705728:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951949.299857:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:2398:x1870605447705728:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 81us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951949.299865:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1140 00000100:00080000:2.0:1783951949.302986:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783951949.303008:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951949.305100:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1141 00000100:00100000:3.0:1783951949.305122:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447705856:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951949.305424:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447705856:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 310us (8368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951949.305434:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1141 00010000:00010000:3.0:1783951949.345504:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951949.409580:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465426432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951949.409879:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951949.409986:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465426432 00000100:00100000:0.0:1783951949.409996:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465426432 00000100:00100000:0.0:1783951949.410063:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1783951949.410074:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465426432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783951949.410106:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951949.411900:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951949.411929:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465426560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951949.412024:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951949.412077:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465426560 00000100:00100000:3.0:1783951949.412086:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465426560 00000100:00100000:3.0:1783951949.412132:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:3.0:1783951949.412140:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465426560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951949.412191:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951949.412239:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465426560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951949.412246:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:3.0:1783951949.412303:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465426560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951949.416890:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465426432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6801us (6994us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951949.416912:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:1.0:1783951949.421282:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465426432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783951950.370124:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783951950.484236:0:87946:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 10:12:29 (1783951949) 00000100:00100000:0.0:1783951950.611974:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951950.612061:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447706240 00000100:00100000:3.0:1783951950.612071:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447706240 00000100:00100000:3.0:1783951950.612135:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1145 00000100:00100000:3.0:1783951950.612146:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:67814:x1870605447706240:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783951950.612168:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951950.612202:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1d3 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612273:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612288:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612300:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612333:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4951 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612340:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612347:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612392:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612399:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612405:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612424:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612431:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951950.612435:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612442:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612455:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531c600) 00010000:00010000:3.0:1783951950.612458:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951950.612463:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612487:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb494a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612499:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612505:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4951 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612511:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612516:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951950.612519:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612525:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4951 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612532:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff97b158d55900) 00010000:00010000:3.0:1783951950.612535:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951950.612537:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4951 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612543:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4951 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612573:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4943 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1d3 expref: 9 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612627:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531c600) 00010000:00010000:3.0:1783951950.612630:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951950.612634:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb4943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1d3 expref: 9 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.612644:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71e00, rc 0) 00000100:00100000:3.0:1783951950.612704:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:67814:x1870605447706240:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 560us (741us total) trans 0 rc 301/301 00000100:00100000:3.0:1783951950.612711:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1145 00000100:00100000:1.0:1783951950.617772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951950.617844:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447706496 00000100:00100000:3.0:1783951950.617856:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447706496 00000100:00100000:3.0:1783951950.617915:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1146 00000100:00100000:3.0:1783951950.617926:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:67814:x1870605447706496:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783951950.617948:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951950.617952:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783951950.617978:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb48da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1b7 expref: 8 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.617995:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531c600) 00010000:00010000:3.0:1783951950.618007:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951950.618023:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb4958 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1da expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618123:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb495f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618151:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb495f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618160:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb495f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618172:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618178:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618184:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618799:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618811:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618819:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951950.618829:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:3.0:1783951950.618852:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb495f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618859:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb495f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618866:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb495f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618880:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951950.618885:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb495f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618892:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb495f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618901:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b158d55100) 00010000:00010000:3.0:1783951950.618904:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951950.618908:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb495f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618915:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb495f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951950.618927:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000055b00705 reply state 00000000ceabc143 transno 107374182403 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618938:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618943:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff97b158d55700) 00010000:00010000:3.0:1783951950.618945:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951950.618948:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783951950.618976:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb4958 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1da expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.618993:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1da expref: 9 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.619012:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:3.0:1783951950.619014:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783951950.619016:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71000, rc 0) 00000100:00100000:3.0:1783951950.620571:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+10:67814:x1870605447706496:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2639us (2801us total) trans 107374182403 rc 0/0 00000100:00100000:3.0:1783951950.620584:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1146 00000100:00100000:0.0:1783951950.629092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951950.629168:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447706752 00000100:00100000:3.0:1783951950.629186:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447706752 00000100:00100000:3.0:1783951950.629250:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1147 00000100:00100000:3.0:1783951950.629261:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:67814:x1870605447706752:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783951950.629285:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951950.629309:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb497b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1e1 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.629431:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.629446:0:66236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1da expref: 11 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.629455:0:66236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.629495:0:66236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1da expref: 11 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951950.629507:0:66236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1da expref: 11 pid: 83761 timeout: 3765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951950.629529:0:66236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66236:1870605465426688:192.168.202.48@tcp:104: 00000100:00100000:3.0:1783951950.629644:0:66236:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951950.638152:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951950.638254:0:66236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66236:1870605465426688:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783951950.638280:0:66236:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951950.642666:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447706880 00000100:00100000:2.0:1783951950.642680:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447706880 00010000:00010000:2.0:1783951950.642720:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1da expref: 12 pid: 83761 timeout: 3765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951950.642760:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2544 00000100:00100000:2.0:1783951950.642769:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1472bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458183b2-4c6d-478c-9fed-a955779e6611+12:2401:x1870605447706880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783951950.642785:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951950.642792:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1da expref: 12 pid: 83761 timeout: 3765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.642806:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1da expref: 12 pid: 83761 timeout: 3765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.642829:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb496d lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1da expref: 12 pid: 83761 timeout: 3765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.642842:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:2.0:1783951950.642848:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.642857:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.642865:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.642892:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951950.642938:0:66236:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.642946:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951950.642963:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:2.0:1783951950.643172:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.643194:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.643201:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.643207:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951950.643212:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.643228:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.643238:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:2.0:1783951950.643241:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783951950.643245:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.643252:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb4982 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.643300:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb497b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1e1 expref: 12 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.643319:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b158d55900) 00010000:00010000:2.0:1783951950.643321:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783951950.643325:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb497b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1e1 expref: 12 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951950.643337:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71e00, rc 0) 00000100:00100000:2.0:1783951950.643388:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:67814:x1870605447706752:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 14129us (14307us total) trans 107374182404 rc 301/301 00000100:00100000:2.0:1783951950.643396:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1147 00000100:00100000:2.0:1783951950.643428:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1472bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:2401:x1870605447706880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 660us (5286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951950.643435:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2544 00000100:00100000:2.0:1783951950.648877:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951950.648953:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447707136 00000100:00100000:3.0:1783951950.648963:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447707136 00000100:00100000:3.0:1783951950.649021:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 222 00000100:00100000:3.0:1783951950.649032:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:67814:x1870605447707136:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1783951950.649253:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:67814:x1870605447707136:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 223us (385us total) trans 107374182405 rc 0/0 00000100:00100000:3.0:1783951950.649261:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 222 00000100:00100000:0.0:1783951950.658016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951950.658087:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447707392 00000100:00100000:3.0:1783951950.658096:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447707392 00000100:00100000:3.0:1783951950.658155:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 223 00000100:00100000:3.0:1783951950.658165:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177061c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:458183b2-4c6d-478c-9fed-a955779e6611+11:67814:x1870605447707392:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1783951950.658527:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177061c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:458183b2-4c6d-478c-9fed-a955779e6611+12:67814:x1870605447707392:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 362us (518us total) trans 107374182406 rc 0/0 00000100:00100000:3.0:1783951950.658536:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 223 00010000:00010000:1.0:1783951951.393063:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783951951.487065:0:87120:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182406 is committed 00010000:00010000:1.0:1783951951.487150:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951951.487163:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951951.487170:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951951.487177:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951951.487182:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951951.487191:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951951.487207:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff97b158d55700) 00010000:00010000:1.0:1783951951.487220:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951951.487232:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951951.487255:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4966 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951951.581365:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951951.581563:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447707520 00000100:00100000:3.0:1783951951.581584:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447707520 00000100:00100000:2.0:1783951951.586111:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1148 00000100:00100000:2.0:1783951951.586127:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:67823:x1870605447707520:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783951951.586166:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951951.586188:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb4990 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1e8 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.586261:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4997 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.586275:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.586292:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951951.586337:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783951951.586342:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951951.586362:0:66238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.586387:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb4990 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1e8 expref: 9 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.586414:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4997 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1e8 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.586423:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b1584d4b00) 00010000:00010000:2.0:1783951951.586426:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783951951.586429:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216bc00, rc 0) 00000100:00100000:2.0:1783951951.586508:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:67823:x1870605447707520:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 385us (5153us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951951.586515:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1148 00000100:00080000:1.0:1783951951.590396:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783951951.606030:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951951.606359:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447707648 00000100:00100000:1.0:1783951951.606370:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447707648 00000100:00100000:1.0:1783951951.606423:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1149 00000100:00100000:1.0:1783951951.606432:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:67823:x1870605447707648:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:1.0:1783951951.606481:0:66237:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:1.0:1783951951.606548:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:67823:x1870605447707648:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 116us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951951.606557:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1149 00000100:00100000:3.0:1783951951.609620:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951951.609713:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447707776 00000100:00100000:2.0:1783951951.609723:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447707776 00000100:00100000:2.0:1783951951.609789:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1150 00000100:00100000:2.0:1783951951.609799:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:67823:x1870605447707776:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:2.0:1783951951.609838:0:68591:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783951951.609915:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:67823:x1870605447707776:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 116us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951951.609929:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1150 00000100:00080000:1.0:1783951951.610119:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951951.621273:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951951.621389:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447707904 00000100:00100000:0.0:1783951951.621397:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447707904 00000100:00080000:1.0:1783951951.621464:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951951.621553:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2071 00000100:00100000:0.0:1783951951.621565:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:67823:x1870605447707904:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783951951.621830:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951951.621898:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:67823:x1870605447707904:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 335us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951951.621906:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2071 00000100:00100000:3.0:1783951951.625815:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951951.625854:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447708032 00000100:00100000:3.0:1783951951.625863:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447708032 00000100:00100000:3.0:1783951951.625937:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2072 00000100:00100000:3.0:1783951951.625947:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:67823:x1870605447708032:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783951951.625991:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951951.626055:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:67823:x1870605447708032:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951951.626063:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2072 00000100:00080000:3.0:1783951951.626083:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951951.739559:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951951.739723:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447708288 00000100:00100000:3.0:1783951951.739733:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447708288 00000100:00100000:3.0:1783951951.739793:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1151 00000100:00100000:3.0:1783951951.739805:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:67830:x1870605447708288:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00010000:3.0:1783951951.739861:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951951.739887:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4997 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1e8 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.739905:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b1584d4b00) 00010000:00010000:3.0:1783951951.739916:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783951951.739974:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.739988:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.739998:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740012:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740019:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740038:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740390:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740398:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740404:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740498:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740505:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951951.740510:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740517:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740525:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b158d55100) 00010000:00010000:3.0:1783951951.740528:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951951.740700:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740708:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb499e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951951.740724:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019dae989 reply state 000000000e967195 transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740742:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.740748:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b158d55a00) 00010000:00010000:3.0:1783951951.740750:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951951.740752:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783951951.740866:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+9:67830:x1870605447708288:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 1062us (1314us total) trans 107374182407 rc 0/0 00000100:00100000:3.0:1783951951.740873:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1151 00000100:00100000:3.0:1783951951.775748:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951951.776304:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447708416 00000100:00100000:1.0:1783951951.776315:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447708416 00000100:00100000:1.0:1783951951.776428:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1152 00000100:00100000:1.0:1783951951.776438:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+9:67833:x1870605447708416:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:1.0:1783951951.776462:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951951.776512:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb49ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1ef expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.776867:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb49b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.776882:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb49b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.776894:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb49b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951951.776937:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951951.776941:0:66237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951951.776958:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb49b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.776980:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb49ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1ef expref: 11 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.776997:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb49b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1ef expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951951.777025:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b164ef8300) 00010000:00010000:3.0:1783951951.777028:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951951.777032:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70800, rc 0) 00000100:00100000:3.0:1783951951.777121:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:67833:x1870605447708416:12345-192.168.202.48@tcp:101:rm.0 Request processed in 684us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951951.777128:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1152 00000100:00100000:0.0:1783951951.782558:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951951.782630:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447708544 00000100:00100000:2.0:1783951951.782641:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447708544 00000100:00100000:2.0:1783951951.782697:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1153 00000100:00100000:2.0:1783951951.782707:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+10:67833:x1870605447708544:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:2.0:1783951951.782730:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951951.782751:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb49ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1f6 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.782817:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.782832:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.782844:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.782855:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb49c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.782861:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb49c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.782867:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb49c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.782952:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb49cf lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.782978:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb49cf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.782985:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb49cf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783951951.783025:0:68591:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783951951.783029:0:68591:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783951951.783049:0:68591:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb49cf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783061:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb49cf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783076:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783082:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783087:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783093:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783099:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216bc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951951.783103:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783111:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783133:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b164ef8300) 00010000:00010000:2.0:1783951951.783136:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951951.783141:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783147:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb49c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783160:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb49c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783166:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb49c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783172:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb49c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783177:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951951.783180:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb49c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783185:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb49c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783192:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b158d55a00) 00010000:00010000:2.0:1783951951.783194:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951951.783197:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb49c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783202:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b200/0x22c73c7857bb49c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783237:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b000/0x22c73c7857bb49ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1f6 expref: 12 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783250:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb49cf lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1f6 expref: 11 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.783258:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff97b1584d4200) 00010000:00010000:2.0:1783951951.783260:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783951951.783263:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b400, rc 0) 00000100:00100000:2.0:1783951951.783325:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+11:67833:x1870605447708544:12345-192.168.202.48@tcp:101:rm.0 Request processed in 620us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951951.783333:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1153 00000100:00100000:1.0:1783951951.787843:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951951.787969:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447708800 00000100:00100000:2.0:1783951951.787980:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447708800 00000100:00100000:2.0:1783951951.788048:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1154 00000100:00100000:2.0:1783951951.788060:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+11:67833:x1870605447708800:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:2.0:1783951951.788113:0:67035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783951951.788135:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b400/0x22c73c7857bb49cf lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1f6 expref: 11 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788151:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff97b1584d4200) 00010000:00010000:2.0:1783951951.788168:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb49b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1ef expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788178:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b164ef8300) 00010000:00010000:2.0:1783951951.788186:0:67035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951951.788228:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788241:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788251:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788263:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788271:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788278:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788353:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb49e4 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788359:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb49e4 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788364:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb49e4 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788566:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788576:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788583:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788967:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788974:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.788980:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789040:0:67035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951951.789060:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb49e4 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789067:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb49e4 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789074:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb49e4 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789081:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951951.789085:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb49e4 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789092:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb49e4 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789102:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff97b1584d4d00) 00010000:00010000:2.0:1783951951.789105:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783951951.789109:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb49e4 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789125:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a200/0x22c73c7857bb49e4 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789145:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789152:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789157:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789163:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789169:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951951.789172:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789177:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789185:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b1584d4300) 00010000:00010000:2.0:1783951951.789188:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951951.789190:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789196:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216b800/0x22c73c7857bb49d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951951.789210:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fdafd219 reply state 000000007643f212 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789228:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951951.789234:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b158d55a00) 00010000:00010000:2.0:1783951951.789237:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951951.789240:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783951951.789327:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+11:67833:x1870605447708800:12345-192.168.202.48@tcp:36:rm.0 Request processed in 1268us (1492us total) trans 107374182408 rc 0/0 00000100:00100000:2.0:1783951951.789336:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1154 00010000:00010000:0.0:1783951951.789814:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951951.789821:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951951.789827:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ba00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951951.789831:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951951.789848:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951951.789860:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff97b1584d4d00) 00010000:00010000:0.0:1783951951.789862:0:7459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783951951.789865:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951951.790018:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb49eb lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951951.790039:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951951.790041:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951951.790043:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951952.424787:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951953.441693:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951953.504716:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951953.504738:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465426816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951953.504801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951953.504846:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465426816 00000100:00100000:3.0:1783951953.504852:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465426816 00000100:00100000:3.0:1783951953.504897:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:3.0:1783951953.504905:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465426816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951953.504935:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951953.504972:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465426816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951953.504978:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00080000:3.0:1783951953.504996:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951953.505025:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465426816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951953.524606:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465426944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951953.524682:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951953.524784:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465426944 00000100:00100000:3.0:1783951953.524794:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465426944 00000100:00100000:3.0:1783951953.524853:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:3.0:1783951953.524863:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465426944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951953.524895:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951953.528178:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465426944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3306us (3487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951953.528203:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00080000:3.0:1783951953.528239:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951953.530345:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465426944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951954.016782:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951954.016811:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465427072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951954.016902:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465427584:0@lo:400:kworker.0 00000100:00100000:2.0:1783951954.016922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951954.016967:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465427456:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.016983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951954.017013:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465427072 00000100:00100000:2.0:1783951954.017020:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465427072 00000100:00100000:3.0:1783951954.017045:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465428096:0@lo:400:kworker.0 00000100:00100000:2.0:1783951954.017091:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:2.0:1783951954.017104:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465427072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783951954.017150:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951954.017151:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951954.017212:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465427200:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.017247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951954.017276:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465427712:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.017297:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951954.017314:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465428224:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.017335:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951954.017354:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783951954.017360:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465427328:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.017381:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951954.017397:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465427840:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.017416:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951954.017433:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465428352:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.017463:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951954.017511:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465427584 00000100:00100000:3.0:1783951954.017519:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465427584 00000100:00100000:2.0:1783951954.017570:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465427072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 466us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951954.017579:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1783951954.017580:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465427712 00000100:00100000:3.0:1783951954.017631:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465427712 00000100:00100000:3.0:1783951954.017655:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465427328 00000100:00100000:3.0:1783951954.017659:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465427328 00000100:00100000:3.0:1783951954.017714:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1783951954.017727:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465427584:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783951954.017757:0:83761:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e77480 x1870605465427584/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:215/0 lens 224/224 e 0 to 0 dl 1783951965 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951954.017821:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465427584:12345-0@lo:400:kworker.0 Request processed in 98us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.017828:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1783951954.017845:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1783951954.017851:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465427712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.017883:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465427712:12345-0@lo:400:kworker.0 Request processed in 32us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.017888:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1783951954.017899:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1783951954.017904:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465427328:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783951954.017914:0:83761:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b047a1b480 x1870605465427328/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:215/0 lens 224/224 e 0 to 0 dl 1783951965 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951954.017941:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465427328:12345-0@lo:400:kworker.0 Request processed in 36us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.017948:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1783951954.017993:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465428096 00000100:00100000:3.0:1783951954.017997:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465428096 00000100:00100000:3.0:1783951954.018040:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465427840 00000100:00100000:3.0:1783951954.018045:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465427840 00000100:00100000:3.0:1783951954.018076:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1783951954.018089:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465428096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951954.018124:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:3.0:1783951954.018136:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465428096:12345-0@lo:400:kworker.0 Request processed in 50us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.018154:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1783951954.018178:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465427200 00000100:00100000:3.0:1783951954.018183:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465427200 00000100:00100000:3.0:1783951954.018206:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783951954.018213:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465427200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.018243:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465427200:12345-0@lo:400:kworker.0 Request processed in 31us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.018248:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783951954.018281:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465428224 00000100:00100000:3.0:1783951954.018284:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465428224 00000100:00100000:3.0:1783951954.018311:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465428352 00000100:00100000:3.0:1783951954.018313:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465428352 00000100:00100000:3.0:1783951954.018332:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:3.0:1783951954.018338:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465428224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.018366:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465428224:12345-0@lo:400:kworker.0 Request processed in 29us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.018372:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00100000:3.0:1783951954.018382:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:3.0:1783951954.018388:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465428352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.018415:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465428352:12345-0@lo:400:kworker.0 Request processed in 28us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.018420:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00080000:3.0:1783951954.018442:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951954.018457:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951954.018460:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951954.018462:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951954.018488:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951954.018521:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465427968:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.018546:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951954.018563:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465428480:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.018583:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951954.018643:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465427072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951954.018671:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465427456 00000100:00100000:3.0:1783951954.018674:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465427456 00000100:00100000:3.0:1783951954.018702:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465427968 00000100:00100000:3.0:1783951954.018704:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465427968 00000100:00100000:3.0:1783951954.018717:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465428480 00000100:00100000:3.0:1783951954.018719:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465428480 00000100:00100000:3.0:1783951954.018734:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1783951954.018739:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465427456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.018775:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465427456:12345-0@lo:400:kworker.0 Request processed in 36us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.018781:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1783951954.018793:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1783951954.018798:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465427968:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783951954.018810:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b048fba680 x1870605465427968/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:215/0 lens 224/224 e 0 to 0 dl 1783951965 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951954.018834:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465427968:12345-0@lo:400:kworker.0 Request processed in 36us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.018839:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1783951954.018849:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:3.0:1783951954.018854:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465428480:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783951954.018866:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b048fb8e00 x1870605465428480/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:215/0 lens 224/224 e 0 to 0 dl 1783951965 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951954.018899:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465428480:12345-0@lo:400:kworker.0 Request processed in 45us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.018905:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00080000:3.0:1783951954.018927:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951954.018947:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465427328:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.018959:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465428352:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.018967:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465427200:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.018975:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465427712:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.018982:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465428224:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.019011:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465427584:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.019019:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465428096:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.019040:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465427456:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.019049:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465427968:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.019057:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465428480:0@lo:400:kworker.0 00000100:00100000:2.0:1783951954.020099:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465427840:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783951954.020158:0:8445:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b047a19c00 x1870605465427840/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:215/0 lens 224/224 e 0 to 0 dl 1783951965 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951954.022681:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465427840:12345-0@lo:400:kworker.0 Request processed in 4516us (5245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951954.022700:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:2.0:1783951954.022909:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465427840:0@lo:400:kworker.0 00000100:00100000:3.0:1783951954.025697:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951954.025722:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465428608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951954.025788:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951954.025995:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465428608 00000100:00100000:2.0:1783951954.026011:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465428608 00000100:00100000:2.0:1783951954.026092:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:2.0:1783951954.026104:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465428608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951954.026156:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00010000:00000080:2.0:1783951954.026177:0:8444:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e76a00 x1870605465428608/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:215/0 lens 224/368 e 0 to 0 dl 1783951965 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951954.027266:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465428608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1157us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951954.027278:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1783951954.028911:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465428608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951954.416394:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951954.416562:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447709056 00000100:00100000:3.0:1783951954.416575:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447709056 00000100:00100000:1.0:1783951954.417028:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951954.417114:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951954.417149:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951954.417180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951954.417295:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447709184 00000100:00100000:3.0:1783951954.417300:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447709184 00000100:00100000:3.0:1783951954.417330:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1148 00000100:00100000:3.0:1783951954.417340:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:2399:x1870605447709056:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000080:3.0:1783951954.417387:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b166fb0700 x1870605447709056/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:215/0 lens 224/224 e 0 to 0 dl 1783951965 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951954.417478:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:2399:x1870605447709056:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 139us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.417487:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1148 00000100:00100000:3.0:1783951954.417507:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1149 00000100:00100000:3.0:1783951954.417515:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447709184:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951954.417543:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447709184:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.417550:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1149 00000100:00080000:3.0:1783951954.417570:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951954.417575:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951954.419037:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447708928 00000100:00100000:1.0:1783951954.419049:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447708928 00000100:00100000:1.0:1783951954.419096:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:1.0:1783951954.419104:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2399:x1870605447708928:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951954.419172:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2399:x1870605447708928:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 69us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951954.419179:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:2.0:1783951954.419363:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447709312 00000100:00100000:2.0:1783951954.419370:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447709312 00000100:00100000:2.0:1783951954.419472:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447709440 00000100:00100000:2.0:1783951954.419476:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447709440 00000100:00100000:3.0:1783951954.419637:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2652 00000100:00100000:3.0:1783951954.419657:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447709312:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951954.419702:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447709312:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 58us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951954.419709:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2652 00000100:00080000:1.0:1783951954.421345:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951954.421355:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951954.432728:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2653 00000100:00100000:1.0:1783951954.432749:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447709440:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951954.432873:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+5:2399:x1870605447709440:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 131us (15691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951954.432881:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2653 00010000:00010000:0.0:1783951954.470584:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951954.529108:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465428736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783951954.529159:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465428864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951954.529220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951954.529274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951954.529392:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465428864 00000100:00100000:2.0:1783951954.529403:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465428864 00000100:00100000:2.0:1783951954.529490:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465428736 00000100:00100000:2.0:1783951954.529494:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465428736 00000100:00100000:2.0:1783951954.529513:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:2.0:1783951954.529522:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465428864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783951954.529627:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951954.529685:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465428864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951954.529694:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000100:00100000:2.0:1783951954.529716:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:2.0:1783951954.529723:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465428736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951954.529736:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951954.529763:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465428864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783951954.529768:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465428736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951954.529773:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:2.0:1783951954.529802:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465428736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783951955.494551:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951956.522130:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951957.545694:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783951958.051825:0:87120:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:3.0:1783951958.052056:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052071:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052104:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052111:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951958.052117:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052127:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052148:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b158d55a00) 00010000:00010000:3.0:1783951958.052151:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951958.052157:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052165:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49a5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052191:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052198:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052205:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052210:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216be00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783951958.052214:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052244:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052254:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b158d55a00) 00010000:00010000:3.0:1783951958.052257:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783951958.052260:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951958.052266:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb49dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951958.566270:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951958.625351:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465429120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951958.625444:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951958.625489:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951958.625495:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465428992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951958.625517:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951958.625763:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465429120 00000100:00100000:3.0:1783951958.625780:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465429120 00000100:00080000:1.0:1783951958.625823:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951958.625866:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465428992 00000100:00100000:3.0:1783951958.625872:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465428992 00000100:00100000:3.0:1783951958.625920:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00080000:1.0:1783951958.625928:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951958.625934:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465429120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951958.625982:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951958.626082:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:3.0:1783951958.626091:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465429120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951958.626102:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:2.0:1783951958.626109:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465428992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783951958.626152:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951958.626219:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465428992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951958.626226:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00100000:1.0:1783951958.629790:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465428992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951958.629811:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465429120:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1783951959.100094:0:88343:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1783951959.139175:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465429248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783951959.139254:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951959.139375:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465429248 00000100:00100000:0.0:1783951959.139383:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465429248 00000100:00100000:0.0:1783951959.139446:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:0.0:1783951959.139455:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465429248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783951959.139492:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00010000:00000080:0.0:1783951959.139512:0:8445:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e74700 x1870605465429248/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:220/0 lens 224/368 e 0 to 0 dl 1783951970 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951959.139554:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465429248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951959.139562:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00100000:3.0:1783951959.139686:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465429248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783951959.140921:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465429376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951959.140967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.140993:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465429888:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.141018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.141034:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465430400:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.141053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.141069:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465430912:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.141087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.141107:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783951959.141113:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465429760:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.141132:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951959.141236:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465429888 00000100:00100000:3.0:1783951959.141243:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465429888 00000100:00100000:3.0:1783951959.141297:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465430400 00000100:00100000:3.0:1783951959.141300:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465430400 00000100:00100000:3.0:1783951959.141317:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465430912 00000100:00100000:3.0:1783951959.141320:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465430912 00000100:00100000:3.0:1783951959.141328:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465429760 00000100:00100000:3.0:1783951959.141330:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465429760 00000100:00100000:3.0:1783951959.141345:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1783951959.141353:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465429888:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783951959.141373:0:83761:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e0700 x1870605465429888/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:220/0 lens 224/224 e 0 to 0 dl 1783951970 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951959.141422:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465429888:12345-0@lo:400:kworker.0 Request processed in 70us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951959.141429:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1783951959.141445:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1783951959.141451:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465430400:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783951959.141462:0:83761:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e2a00 x1870605465430400/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:220/0 lens 224/224 e 0 to 0 dl 1783951970 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951959.141486:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465430400:12345-0@lo:400:kworker.0 Request processed in 36us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951959.141492:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1783951959.141502:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1783951959.141507:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465430912:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783951959.141517:0:83761:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e2d80 x1870605465430912/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:220/0 lens 224/224 e 0 to 0 dl 1783951970 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783951959.141541:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465430912:12345-0@lo:400:kworker.0 Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951959.141556:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1783951959.141569:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1783951959.141575:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465429760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951959.141625:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465429760:12345-0@lo:400:kworker.0 Request processed in 50us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951959.141631:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1783951959.142251:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465430272:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.142324:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465430784:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.142381:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465429888:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142414:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465430400:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142427:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465430912:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142453:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465429760:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142482:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465429504:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142512:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.142539:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465430016:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142563:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.142580:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465430528:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142623:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.142645:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783951959.142651:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465429632:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.142686:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465430144:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142704:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.142719:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465430656:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142739:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951959.142777:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465429376 00000100:00100000:1.0:1783951959.142782:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465429376 00000100:00100000:1.0:1783951959.142812:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465430528 00000100:00100000:1.0:1783951959.142815:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465430528 00000100:00100000:1.0:1783951959.142831:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1783951959.142838:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465429376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783951959.142867:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:1.0:1783951959.142904:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465429376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951959.142917:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1783951959.142932:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:1.0:1783951959.142938:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465430528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.142969:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465430528:12345-0@lo:400:kworker.0 Request processed in 31us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951959.142975:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:1.0:1783951959.142993:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465430016 00000100:00100000:1.0:1783951959.142996:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465430016 00000100:00100000:1.0:1783951959.143015:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465429632 00000100:00100000:1.0:1783951959.143017:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465429632 00000100:00100000:1.0:1783951959.143029:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1783951959.143034:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465430016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.143062:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465430016:12345-0@lo:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951959.143068:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1783951959.143079:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1783951959.143085:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465429632:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783951959.143097:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e3100 x1870605465429632/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:220/0 lens 224/224 e 0 to 0 dl 1783951970 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951959.143122:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465429632:12345-0@lo:400:kworker.0 Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951959.143128:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1783951959.145098:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465430272 00000100:00100000:3.0:1783951959.145111:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465430272 00000100:00100000:3.0:1783951959.145170:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465430784 00000100:00100000:3.0:1783951959.145175:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465430784 00000100:00100000:3.0:1783951959.145196:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465430144 00000100:00100000:3.0:1783951959.145199:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465430144 00000100:00100000:3.0:1783951959.149358:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:3.0:1783951959.149382:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465430272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951959.149485:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465430272:12345-0@lo:400:kworker.0 Request processed in 113us (7192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951959.149493:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:3.0:1783951959.149519:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465430656 00000100:00100000:3.0:1783951959.149526:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465430656 00000100:00100000:0.0:1783951959.149633:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1783951959.149643:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465430784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951959.149680:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465430784:12345-0@lo:400:kworker.0 Request processed in 40us (7332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951959.149686:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1783951959.149699:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:0.0:1783951959.149705:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465430144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951959.149731:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465430144:12345-0@lo:400:kworker.0 Request processed in 27us (7027us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951959.149737:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:0.0:1783951959.149746:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:0.0:1783951959.149752:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465430656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951959.149775:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465430656:12345-0@lo:400:kworker.0 Request processed in 24us (7035us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951959.149781:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:0.0:1783951959.150947:0:87125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465429504 00000100:00100000:0.0:1783951959.150957:0:87125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465429504 00000100:00100000:0.0:1783951959.151000:0:87125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783951959.151008:0:87125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465429504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951959.151065:0:87125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465429504:12345-0@lo:400:kworker.0 Request processed in 59us (8553us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951959.151072:0:87125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1783951959.153296:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951959.153306:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951959.153310:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951959.153313:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783951959.153418:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465429632:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.153437:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465430144:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.153448:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465430656:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.153459:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465429504:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.153471:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465430016:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.153483:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465430528:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.153534:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465430272:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.153546:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465430784:0@lo:400:kworker.0 00000100:00100000:1.0:1783951959.153562:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465429376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951959.185372:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951959.185452:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447709568 00000100:00100000:3.0:1783951959.185462:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447709568 00000100:00100000:3.0:1783951959.185543:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1155 00000100:00100000:3.0:1783951959.185554:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+7:67902:x1870605447709568:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783951959.185574:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951959.185628:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a1fd expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951959.185719:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb49f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951959.185734:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb49f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951959.185747:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb49f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783951959.185790:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783951959.185794:0:66237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783951959.185828:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb49f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951959.185853:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb49f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1fd expref: 9 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951959.185870:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb49f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1fd expref: 8 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951959.185879:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b158d55300) 00010000:00010000:3.0:1783951959.185881:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783951959.185885:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70e00, rc 0) 00010000:00000080:3.0:1783951959.185894:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e0380 x1870605447709568/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:220/0 lens 576/688 e 0 to 0 dl 1783951970 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783951959.185966:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:67902:x1870605447709568:12345-192.168.202.48@tcp:101:dd.0 Request processed in 414us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951959.185973:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1155 00000100:00080000:1.0:1783951959.186163:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783951959.193877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951959.196933:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447709824 00000100:00100000:1.0:1783951959.196949:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447709824 00000100:00100000:1.0:1783951959.197027:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1156 00000100:00100000:1.0:1783951959.197038:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:67902:x1870605447709824:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783951959.197060:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951959.197063:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783951959.197090:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb49f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1fd expref: 8 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197105:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b158d55300) 00010000:00010000:1.0:1783951959.197116:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783951959.197132:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb4a00 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a204 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197263:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197276:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197285:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197298:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb4a0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197305:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb4a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197311:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb4a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197371:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197379:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197387:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951959.197502:0:66238:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1783951959.197506:0:66238:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1783951951 00000004:00010000:1.0:1783951959.197509:0:66238:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1783951951 00000004:00010000:1.0:1783951959.197516:0:66238:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1783951951 00000004:00010000:1.0:1783951959.197518:0:66238:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:1.0:1783951959.197522:0:66238:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:1.0:1783951959.197529:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197536:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197544:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197551:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197558:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951959.197563:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197570:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197580:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396e200) 00010000:00010000:1.0:1783951959.197583:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951959.197613:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197621:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb4a07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197631:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb4a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197646:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb4a0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197651:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb4a0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197656:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aea00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951959.197660:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb4a0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197667:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb4a0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197675:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff97b14396e700) 00010000:00010000:1.0:1783951959.197678:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951959.197681:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb4a0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197688:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb4a0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197723:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb4a00 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 10 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197738:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 9 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.197745:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b14396ee00) 00010000:00010000:1.0:1783951959.197747:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1783951959.197755:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af200, rc 0) 00010000:00000080:1.0:1783951959.197762:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e74e00 x1870605447709824/t107374182409(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:220/0 lens 752/824 e 0 to 0 dl 1783951970 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783951959.197828:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+9:67902:x1870605447709824:12345-192.168.202.48@tcp:101:dd.0 Request processed in 792us (3960us total) trans 107374182409 rc 0/0 00000100:00100000:1.0:1783951959.197836:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1156 00000100:00100000:1.0:1783951959.202781:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951959.202853:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447709952 00000100:00100000:0.0:1783951959.202862:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447709952 00000100:00100000:0.0:1783951959.202927:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1157 00000100:00100000:0.0:1783951959.202937:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:67902:x1870605447709952:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783951959.202967:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951959.202999:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb4a23 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a20b expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951959.203035:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb4a2a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951959.203049:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb4a2a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951959.203061:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb4a2a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951959.203166:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb4a23 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a20b expref: 11 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951959.203183:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb4a2a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a20b expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951959.203192:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b14396ee00) 00010000:00010000:0.0:1783951959.203196:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783951959.203200:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22000, rc 0) 00010000:00000080:0.0:1783951959.203207:0:83761:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e1f80 x1870605447709952/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:220/0 lens 568/1272 e 0 to 0 dl 1783951970 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783951959.203266:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+10:67902:x1870605447709952:12345-192.168.202.48@tcp:101:dd.0 Request processed in 330us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951959.203273:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1157 00000100:00100000:1.0:1783951959.207196:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951959.207424:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447710208 00000100:00100000:3.0:1783951959.207442:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447710208 00000100:00100000:3.0:1783951959.207534:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1158 00000100:00100000:3.0:1783951959.207547:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:67902:x1870605447710208:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:3.0:1783951959.207789:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951959.207813:0:66237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 10 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951959.207824:0:66237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951959.208135:0:66237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 10 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951959.208153:0:66237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 10 pid: 66238 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951959.208827:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66237:1870605465431040:192.168.202.48@tcp:104: 00000100:00100000:3.0:1783951959.209131:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046424780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951959.235946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951959.235954:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66237:1870605465431040:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783951959.236002:0:66237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951959.236004:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447710336 00000100:00100000:2.0:1783951959.236017:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447710336 00010000:00010000:2.0:1783951959.237001:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 11 pid: 66238 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951959.237067:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2545 00000100:00100000:2.0:1783951959.237080:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458183b2-4c6d-478c-9fed-a955779e6611+11:2401:x1870605447710336:12345-192.168.202.48@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1783951959.237122:0:7927:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 11 pid: 66238 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951959.237138:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 11 pid: 66238 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951959.237154:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 11 pid: 66238 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951959.237164:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b14396ee00) 00010000:00010000:2.0:1783951959.237167:0:7927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1783951959.237184:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951959.237197:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951959.237204:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951959.237420:0:7927:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 11 pid: 66238 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951959.237511:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:458183b2-4c6d-478c-9fed-a955779e6611+11:2401:x1870605447710336:12345-192.168.202.48@tcp:102:ldlm_bl.0 Request processed in 433us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951959.237520:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2545 00010000:00010000:1.0:1783951959.238114:0:66237:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.238129:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951959.238266:0:66237:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1783951959.238270:0:66237:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1783951951 -> 1783951960 00000004:00010000:1.0:1783951959.238272:0:66237:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1783951951 -> 1783951951 00000004:00010000:1.0:1783951959.238275:0:66237:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1783951951 -> 1783951960 00000004:00010000:1.0:1783951959.238277:0:66237:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1783951959.238284:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1154f67 reply state 0000000082223c94 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.238301:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951959.238322:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b14396ee00) 00010000:00010000:1.0:1783951959.238325:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951959.238329:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1783951959.238383:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e1880 x1870605447710208/t107374182410(0) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:220/0 lens 488/456 e 0 to 0 dl 1783951970 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951959.238465:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+12:67902:x1870605447710208:12345-192.168.202.48@tcp:36:dd.0 Request processed in 30920us (31277us total) trans 107374182410 rc 0/0 00000100:00100000:1.0:1783951959.238474:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1158 00000100:00100000:2.0:1783951959.241556:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951959.241721:0:66263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447710464 00000100:00100000:3.0:1783951959.241731:0:66263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447710464 00002000:00010000:3.0:1783951959.241771:0:66263:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:3.0:1783951959.241777:0:66263:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff97b049ac6300 with x1870605447710464 00000100:00100000:3.0:1783951959.241817:0:66263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:3.0:1783951959.241827:0:66263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:2401:x1870605447710464:12345-192.168.202.48@tcp:10:dd.0 00000004:00010000:3.0:1783951959.242020:0:66263:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1783951959.242023:0:66263:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1783951960 -> 1783951960 00000004:00010000:3.0:1783951959.242026:0:66263:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1783951951 -> 1783951951 00000004:00010000:3.0:1783951959.242027:0:66263:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1783951960 -> 1783951960 00000004:00010000:3.0:1783951959.242029:0:66263:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783951959.242047:0:66263:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049ac6300 x1870605447710464/t107374182411(0) o10->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:220/0 lens 440/432 e 0 to 0 dl 1783951970 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783951959.242112:0:66263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:458183b2-4c6d-478c-9fed-a955779e6611+13:2401:x1870605447710464:12345-192.168.202.48@tcp:10:dd.0 Request processed in 287us (566us total) trans 107374182411 rc 0/0 00000100:00100000:3.0:1783951959.242119:0:66263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00002000:00010000:3.0:1783951959.242123:0:66263:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:3.0:1783951959.242125:0:66263:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff97b049ac6300 with x1870605447710464 00000100:00100000:3.0:1783951959.250630:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951959.253614:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447710720 00000100:00100000:0.0:1783951959.253638:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447710720 00000100:00100000:0.0:1783951959.253702:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 224 00000100:00100000:0.0:1783951959.253713:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+13:67902:x1870605447710720:12345-192.168.202.48@tcp:35:dd.0 00010000:00000080:0.0:1783951959.253916:0:66239:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e74000 x1870605447710720/t107374182412(0) o35->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:220/0 lens 392/456 e 0 to 0 dl 1783951970 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783951959.253994:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+14:67902:x1870605447710720:12345-192.168.202.48@tcp:35:dd.0 Request processed in 282us (3372us total) trans 107374182412 rc 0/0 00000100:00100000:0.0:1783951959.254002:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 224 00000100:00100000:2.0:1783951959.537085:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951959.537260:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951959.537997:0:87131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447710848 00000100:00100000:0.0:1783951959.538013:0:87131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447710848 00000100:00100000:0.0:1783951959.538090:0:87131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 87 00000100:00100000:0.0:1783951959.538116:0:87131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447710848:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951959.538229:0:87131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447710848:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 116us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951959.538238:0:87131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 87 00000100:00100000:2.0:1783951959.538986:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951959.541851:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951959.541962:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447711232 00000100:00100000:3.0:1783951959.541976:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447711232 00000100:00100000:3.0:1783951959.542058:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2658 00000100:00100000:3.0:1783951959.542069:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447711232:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951959.542425:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447711232:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 356us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951959.542435:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2658 00000100:00100000:1.0:1783951959.543527:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447710976 00000100:00100000:1.0:1783951959.543543:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447710976 00000100:00100000:1.0:1783951959.543634:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447711104 00000100:00100000:1.0:1783951959.543638:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447711104 00000100:00100000:1.0:1783951959.543677:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1156 00000100:00100000:1.0:1783951959.543686:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+14:2401:x1870605447710976:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000080:1.0:1783951959.543727:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049ac6d80 x1870605447710976/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:220/0 lens 224/224 e 0 to 0 dl 1783951970 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951959.543792:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+14:2401:x1870605447710976:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 107us (6724us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951959.543800:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1156 00000100:00100000:1.0:1783951959.543818:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1157 00000100:00100000:1.0:1783951959.543824:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447711104:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951959.543852:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447711104:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (4870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951959.543859:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1157 00000100:00080000:1.0:1783951959.543919:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783951959.543925:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783951959.545563:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951959.546019:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447711360 00000100:00100000:0.0:1783951959.546031:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447711360 00000100:00100000:0.0:1783951959.546220:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2659 00000100:00100000:0.0:1783951959.546232:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447711360:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951959.548723:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447711360:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 2475us (3149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951959.548742:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2659 00000100:00080000:2.0:1783951959.549009:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783951959.586349:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951959.649314:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465431168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783951959.649426:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951959.649624:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465431168 00000100:00100000:3.0:1783951959.649637:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465431168 00000100:00100000:2.0:1783951959.650559:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:2.0:1783951959.650580:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465431168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783951959.650634:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951959.651368:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783951959.651390:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465431296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951959.651475:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951959.651521:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465431296 00000100:00100000:0.0:1783951959.651529:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465431296 00000100:00100000:0.0:1783951959.651572:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:0.0:1783951959.651581:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465431296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783951959.651620:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951959.651665:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465431296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951959.651674:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1783951959.652426:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465431168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1849us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951959.652436:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:0.0:1783951959.653351:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465431296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951959.653376:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465431168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783951960.610869:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783951961.489776:0:88440:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783951961.489865:0:88440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.489883:0:88440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.489893:0:88440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.489900:0:88440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.489926:0:88440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783951961.489932:0:88440:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1783951961.489939:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951961.489949:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.489957:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a600 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783951961.489961:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.489971:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783951961.489977:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:1.0:1783951961.489978:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951961.489983:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 10000000:01000000:1.0:1783951961.489984:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951961.489987:0:15262:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:2.0:1783951961.489989:0:88440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:01000000:1.0:1783951961.489990:0:15262:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:2.0:1783951961.490022:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b1447cd000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783951961.490040:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.490047:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783951961.490187:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951961.490264:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465431424:0@lo:39:umount.0 00000100:00100000:0.0:1783951961.490392:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783951961.490510:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.490520:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a600/0x22c73c7857bb45c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb45ca expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.490535:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.490546:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.490548:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951961.490570:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465431424 00000100:00100000:1.0:1783951961.490580:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465431424 00000100:00100000:1.0:1783951961.490666:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:1.0:1783951961.490677:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465431424:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783951961.490713:0:66236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb46c6 00000100:00080000:1.0:1783951961.490731:0:66236:0:(import.c:65:import_set_state_nolock()) ffff97b174692800 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1783951961.490767:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd4df80 x1870605465431424/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:222/0 lens 224/224 e 0 to 0 dl 1783951972 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783951961.490821:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1870605465431424:12345-0@lo:39:umount.0 Request processed in 145us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951961.490829:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000020:00000080:1.0:1783951961.490843:0:66236:0:(genops.c:906:class_export_put()) final put ffff97b17407c800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1783951961.490895:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783951961.490904:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783951961.490958:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b174692800 for lustre-MDT0000 00000100:00080000:1.0:1783951961.491001:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1447cd000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783951961.491013:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465431424:0@lo:39:umount.0 00000100:00080000:0.0:1783951961.491990:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951961.491997:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783951961.492004:0:88440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783951961.493965:0:88440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.493987:0:88440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.493996:0:88440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494149:0:88440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494182:0:88440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951961.494191:0:88440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494198:0:88440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494204:0:88440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494210:0:88440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494221:0:88440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783951961.494229:0:88440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494235:0:88440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494239:0:88440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494245:0:88440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494265:0:88440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783951961.494271:0:88440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494278:0:88440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494284:0:88440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494289:0:88440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951961.494298:0:88440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1783951961.494302:0:88440:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1783951961.494423:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783951961.494433:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494442:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a000 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783951961.494446:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494457:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951961.494473:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951961.494480:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951961.494482:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1783951961.494485:0:7459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1783951961.494533:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494541:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951961.494566:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494574:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb44e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb44ea expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494608:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783951961.494612:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494619:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a200 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783951961.494622:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494629:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951961.494636:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951961.494652:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951961.494654:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783951961.494657:0:7459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783951961.494671:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494677:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951961.494699:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494705:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb45ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb45f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494715:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951961.494718:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494725:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbcc00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783951961.494728:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494735:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951961.494741:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951961.494747:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783951961.494750:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783951961.494752:0:7459:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783951961.494774:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494781:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951961.494787:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494794:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb45b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb45bc expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494803:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951961.494806:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494812:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783951961.494814:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494821:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951961.494827:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951961.494833:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783951961.494835:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783951961.494837:0:7459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783951961.494851:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494857:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783951961.494863:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494876:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb44ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb44d5 expref: -99 pid: 87119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.494886:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.494888:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.494890:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.494897:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951961.494920:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465432064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951961.495003:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1783951961.495196:0:88440:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783951961.495202:0:88440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1783951961.495208:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1783951961.495215:0:88440:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:1.0:1783951961.496267:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951961.496289:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465431680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951961.496440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951961.496496:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465431808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951961.496524:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951961.496548:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951961.496554:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465431936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783951961.496577:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951961.496630:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465432064 00000100:00100000:3.0:1783951961.496640:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465431680 00000100:00100000:1.0:1783951961.496640:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465432064 00000100:00100000:3.0:1783951961.496645:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465431680 00000100:00100000:2.0:1783951961.496750:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465431808 00000100:00100000:2.0:1783951961.496755:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465431808 00000100:00100000:1.0:1783951961.496817:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465431936 00000100:00100000:1.0:1783951961.496822:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465431936 00000004:00000080:0.0:1783951961.497897:0:88440:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:2.0:1783951961.498133:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1783951961.498154:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1783951961.498154:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+27:3644:x1870605465432064:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951961.498163:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+27:3644:x1870605465431680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951961.498174:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951961.498188:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951961.498202:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb44ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb44e3 expref: 27 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.498202:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb44d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb44ce expref: 27 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951961.498225:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783951961.498225:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951961.498301:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3644:x1870605465431680:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951961.498306:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1783951961.498311:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1783951961.498315:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3642:x1870605465431808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951961.498323:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783951961.498331:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1783951961.498337:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465431936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783951961.498345:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783951961.498355:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbd800/0x22c73c7857bb45bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb45b5 expref: 24 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951961.498364:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783951961.498407:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3642:x1870605465431936:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951961.498414:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00010000:00010000:1.0:1783951961.498417:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbca00/0x22c73c7857bb45f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb45ed expref: 23 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.498437:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951961.498463:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3642:x1870605465431808:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951961.498470:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00010000:00010000:1.0:1783951961.498502:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.498611:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951961.498702:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465431936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951961.498715:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465431808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951961.498811:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3644:x1870605465432064:12345-0@lo:103:ldlm_bl.0 Request processed in 666us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951961.498819:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1783951961.498883:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465431552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951961.498909:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465431680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951961.498918:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465432064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783951961.498928:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951961.499102:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465431552 00000100:00100000:1.0:1783951961.499109:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465431552 00000100:00100000:1.0:1783951961.499187:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1783951961.499195:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3645:x1870605465431552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951961.499205:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783951961.499216:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbd000/0x22c73c7857bb45ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb45c3 expref: 20 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.499228:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783951961.499258:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3645:x1870605465431552:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951961.499264:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1783951961.499307:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465431552:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1783951961.500057:0:87120:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182412 is committed 00010000:00010000:2.0:1783951961.500095:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.500107:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.500115:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.500122:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951961.500128:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.500157:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.500178:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b14396ee00) 00010000:00010000:2.0:1783951961.500181:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951961.500187:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951961.500194:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4a31 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783951961.500786:0:88440:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1783951961.500795:0:88440:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b17407f000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951961.500804:0:88440:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b174078800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951961.500809:0:88440:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b17407d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951961.500814:0:88440:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b174b15000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783951961.500822:0:88440:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b174b17000 458183b2-4c6d-478c-9fed-a955779e6611 192.168.202.48@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 107374182412 stale:0 00000020:00080000:2.0:1783951961.500829:0:88440:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff97b0476a8000) has exports, disconnecting them 00000020:00080000:2.0:1783951961.500834:0:88440:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b17407f000), last request at 1783951928 00000020:00000080:2.0:1783951961.500845:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb46bf 00000100:00080000:2.0:1783951961.500855:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b17407e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951961.500888:0:88440:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b17407f000): rc 0 00000020:00000080:2.0:1783951961.500891:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b17407f000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1783951961.500902:0:88440:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b174078800), last request at 1783951959 00000020:00000080:2.0:1783951961.500905:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb46b8 00000100:00080000:2.0:1783951961.500909:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b17407b800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783951961.500922:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407f000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:2.0:1783951961.500930:0:88440:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b174078800): rc 0 00000020:00000080:2.0:1783951961.500933:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b174078800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1783951961.500940:0:88440:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b17407d000), last request at 1783951959 00000020:00000080:2.0:1783951961.500942:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb46b1 00000100:00080000:2.0:1783951961.500947:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b17407d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951961.500957:0:88440:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b17407d000): rc 0 00000020:00000080:2.0:1783951961.500959:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b17407d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1783951961.500967:0:88440:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b174b15000), last request at 1783951922 00000020:00000080:2.0:1783951961.500980:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4537 00000020:00000080:1.0:1783951961.500987:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b17407e800 for lustre-MDT0000 00000100:00080000:2.0:1783951961.500991:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b1746cc800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783951961.500992:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174078800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783951961.501018:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783951961.501036:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b17407b800 for lustre-MDT0000 00000020:00000080:1.0:1783951961.501040:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b17407d800 for lustre-MDT0000 00010000:00010000:1.0:1783951961.501051:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.501057:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.501249:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.501263:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783951961.501343:0:88440:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b174b15000): rc 0 00000020:00000080:2.0:1783951961.501346:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b174b15000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1783951961.501366:0:88440:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.48@tcp (ffff97b174b17000), last request at 1783951959 00000020:00000080:2.0:1783951961.501370:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4530 00000020:00010000:2.0:1783951961.501388:0:88440:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b174b17000: total 1 00000100:00080000:2.0:1783951961.501393:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b04b215800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783951961.501413:0:88440:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b174b17000): rc 0 00000004:00000080:2.0:1783951961.501421:0:88440:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa80a41db7ae0 00000020:00010000:3.0:1783951961.501430:0:6506:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b174b17000: total 1 00000100:00080000:2.0:1783951961.501448:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783951961.501452:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1783951961.501630:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b174b17000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1783951961.501673:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb4a2a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a20b expref: 4 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951961.501703:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ae00/0x22c73c7857bb4904 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1be expref: 3 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951961.501726:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4a15 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 2 pid: 66238 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783951961.501797:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b15000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00010000:00010000:3.0:1783951961.501872:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b174b17000, canceled 3 locks, left on hash table 0. 00000020:00000080:1.0:1783951961.503242:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1746cc800 for lustre-MDT0000 00000100:00080000:2.0:1783951961.504426:0:88440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783951961.504476:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b174b22800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783951961.504557:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465432192:0@lo:39:umount.0 00000100:00100000:1.0:1783951961.504681:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951961.504813:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465432192 00000100:00100000:0.0:1783951961.504824:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465432192 00000100:00100000:0.0:1783951961.504893:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:0.0:1783951961.504903:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465432192:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783951961.504939:0:26467:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4576 00000100:00080000:0.0:1783951961.504949:0:26467:0:(import.c:65:import_set_state_nolock()) ffff97b1762c6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951961.504974:0:26467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411435 00010000:00010000:1.0:1783951961.505376:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783951961.505614:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3641:x1870605465432192:12345-0@lo:39:umount.0 Request processed in 685us (905us total) trans 77309411436 rc 0/0 00000100:00100000:0.0:1783951961.505644:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00080000:1.0:1783951961.505767:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b174b22800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783951961.505777:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465432192:0@lo:39:umount.0 00000100:00080000:2.0:1783951961.505951:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783951961.505957:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968951 gen 3 00000004:00080000:2.0:1783951961.506124:0:88440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783951961.512358:0:88440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1783951961.512429:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b1762c7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783951961.512458:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783951961.512477:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968951 gen 3 00000004:00080000:2.0:1783951961.512496:0:88440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783951961.514180:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465432320:0@lo:9:umount.0 00000100:00100000:1.0:1783951961.514302:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951961.514402:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465432320 00000100:00100000:0.0:1783951961.514659:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465432320 00000100:00100000:0.0:1783951961.514741:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4909 00000100:00100000:0.0:1783951961.514753:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465432320:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783951961.514862:0:26198:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4592 00000100:00080000:0.0:1783951961.514873:0:26198:0:(import.c:65:import_set_state_nolock()) ffff97b144764000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783951961.514917:0:26198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968951 00000100:00100000:0.0:1783951961.515097:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465432320:12345-0@lo:9:umount.0 Request processed in 347us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951961.515105:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4909 00000100:00080000:2.0:1783951961.515752:0:88440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783951961.516612:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783951961.516636:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951961.516667:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b046ae4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783951961.516706:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1762c7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783951961.516731:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783951961.516734:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00080000:2.0:1783951961.516740:0:88440:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b0476a8000) has no exports 00000100:00100000:1.0:1783951961.516744:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465432320:0@lo:9:umount.0 00000100:00100000:1.0:1783951961.516792:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465432448:0@lo:9:umount.0 00000100:00100000:1.0:1783951961.516879:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951961.517075:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465432448 00000100:00100000:1.0:1783951961.517083:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465432448 00000100:00100000:1.0:1783951961.517152:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4910 00000100:00100000:1.0:1783951961.517162:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465432448:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783951961.517195:0:26200:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb45a0 00000100:00080000:1.0:1783951961.517276:0:26200:0:(import.c:65:import_set_state_nolock()) ffff97b04d9f5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951961.517344:0:26200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968951 00000100:00100000:1.0:1783951961.517543:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465432448:12345-0@lo:9:umount.0 Request processed in 382us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951961.517573:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4910 00000100:00080000:1.0:1783951961.517623:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783951961.517632:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783951961.517912:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046ae4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783951961.517939:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783951961.517942:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783951961.517949:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465432448:0@lo:9:umount.0 00000020:00080000:2.0:1783951961.519945:0:88440:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b0476a8000) has no exports 00000020:00000080:3.0:1783951961.542650:0:6506:0:(genops.c:906:class_export_put()) final put ffff97b174b17000/458183b2-4c6d-478c-9fed-a955779e6611 00010000:00010000:3.0:1783951961.542698:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951961.542701:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951961.542704:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783951961.542839:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b17000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-MDT0000 00000020:00000080:1.0:1783951961.542950:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04b215800 for lustre-MDT0000 00000020:00000080:2.0:1783951961.603418:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb454c 00000020:00000080:2.0:1783951961.603434:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b176be3000/lustre-QMT0000_UUID 00000020:01000000:2.0:1783951961.603454:0:88440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783951961.603630:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176be3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783951961.603694:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951961.603715:0:88440:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783951961.603721:0:88440:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff97b0489bcd40) has no exports 00000020:00000080:3.0:1783951961.604192:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4545 00000020:00000080:3.0:1783951961.604203:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b1514ba000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951961.604283:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951961.604294:0:88440:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783951961.604298:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b0410dc000/lustre-QMT0000_UUID 00000020:00000080:3.0:1783951961.604301:0:88440:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0410dc000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783951961.604307:0:88440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1783951961.604404:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1514ba000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783951961.604916:0:88440:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b17425e0c0 - data ffff97b181ceebd0/ffff97b17598ec00 00000020:01000000:3.0:1783951961.605113:0:88440:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b17639b360 - data ffff97b181cf3438/ffff97b14de3a000 00010000:00010000:1.0:1783951961.633034:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951961.675795:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783951961.675810:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783951961.675828:0:88440:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff97b047acd880 x1870605465432192/t77309411436(77309411436) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951971 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951961.675858:0:88440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783951961.684635:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783951961.684644:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968951 gen 4 00000004:00080000:2.0:1783951961.684662:0:88440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783951961.684666:0:88440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783951961.685167:0:87138:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783951961.685176:0:87138:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:3.0:1783951961.685191:0:87138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:2.0:1783951961.686046:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783951961.686052:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968951 gen 4 00000004:00080000:2.0:1783951961.686125:0:88440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783951961.686128:0:88440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783951961.691387:0:87140:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783951961.691412:0:87140:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:3.0:1783951961.691430:0:87140:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:2.0:1783951961.693832:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb44ff 00000020:00000080:2.0:1783951961.693846:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b14de81000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951961.693906:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14de81000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783951961.696301:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4514 00000020:00000080:2.0:1783951961.696315:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b16e9fa000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783951961.696333:0:88440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783951961.696338:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951961.696349:0:88440:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783951961.696353:0:88440:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff97b0476acd40) has no exports 00000004:01000000:2.0:1783951961.696526:0:88440:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783951961.696549:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4599 00000020:00000080:2.0:1783951961.696553:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b046486800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783951961.696557:0:88440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783951961.696560:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951961.696567:0:88440:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783951961.696570:0:88440:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff97b0489bb380) has no exports 00000020:00000080:2.0:1783951961.696575:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb458b 00000020:00000080:2.0:1783951961.696578:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b046ae6800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951961.696686:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b16e9fa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1783951961.696714:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046486800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783951961.696726:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046ae6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783951961.697110:0:88440:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783951961.697116:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783951961.697120:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968951 gen 5 00000004:00080000:2.0:1783951961.697126:0:88440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783951961.697128:0:88440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783951961.697179:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951961.697188:0:88440:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951961.697194:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb457d 00000020:00000080:2.0:1783951961.697198:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b0478e7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783951961.697202:0:88440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783951961.697206:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951961.697210:0:88440:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783951961.697212:0:88440:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff97b0489b99c0) has no exports 00000020:00000080:2.0:1783951961.697216:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb456f 00000020:00000080:2.0:1783951961.697219:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b1762c1800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1783951961.697532:0:88440:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783951961.697535:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783951961.697537:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968951 gen 5 00000004:00080000:2.0:1783951961.697540:0:88440:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783951961.697541:0:88440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783951961.697561:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783951961.697566:0:88440:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1783951961.697574:0:88440:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783951961.697578:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4561 00000020:00000080:3.0:1783951961.698972:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b046ae4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783951961.698985:0:8:0:(genops.c:906:class_export_put()) final put ffff97b1514b9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951961.698988:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1514b9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783951961.698996:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951961.699084:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0478e7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783951961.699090:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783951961.699094:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1762c7800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783951961.699098:0:8:0:(genops.c:906:class_export_put()) final put ffff97b14de85000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951961.699100:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14de85000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783951961.699103:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783951961.699249:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b14de82800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783951961.699266:0:88440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1783951961.699407:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783951961.699418:0:88440:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783951961.699421:0:88440:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff97b0465d4d40) has no exports 00000020:00000080:2.0:1783951961.699427:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb455a 00000020:00000080:2.0:1783951961.699432:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b174b00000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783951961.701168:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14de82800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783951961.701182:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b00000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783951961.702652:0:88440:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1783951961.702658:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783951961.702663:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783951961.702669:0:88440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783951961.702779:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951961.702793:0:88440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951961.702821:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951961.702826:0:88440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951961.702831:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b046619800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951961.702835:0:88440:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046619800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783951961.702854:0:88440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783951961.703752:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb451b 00000020:00000080:3.0:1783951961.703760:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b16e9ff800/lustre-MDD0000_UUID 00000020:00000080:0.0:1783951961.704681:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b174b22800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783951961.704690:0:8:0:(genops.c:906:class_export_put()) final put ffff97b14de80800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951961.704693:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14de80800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1783951961.704707:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783951961.708895:0:88440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1783951961.708907:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951961.708920:0:88440:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783951961.708925:0:88440:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff97b0476a99c0) has no exports 00000020:00000080:3.0:1783951961.708953:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951961.708960:0:88440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1783951961.708967:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4522 00000020:00000080:3.0:1783951961.708976:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b16e9fb800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783951961.708984:0:88440:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b176bcd000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1783951961.708987:0:88440:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b176bcd000 3 00000020:01000004:3.0:1783951961.708990:0:88440:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b176bcd000 from lustre-MDT0000 00000020:00000080:3.0:1783951961.709012:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951961.709016:0:88440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1783951961.709019:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b14de86000/lustre-MDT0000_UUID 00000020:00000080:3.0:1783951961.709022:0:88440:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14de86000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1783951961.709033:0:88440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1783951961.709106:0:88440:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1783951961.709110:0:88440:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1783951961.709113:0:88440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1783951961.709116:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951961.709119:0:88440:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1783951961.709125:0:88440:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b046483000 75da5dc4-aa7e-42cf-a965-1b5f01232c6f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783951961.709134:0:88440:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b04d9f7000 e66faa19-2cbc-412c-8aef-9c55427739f8 192.168.202.48@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783951961.709138:0:88440:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff97b1449b3380) has exports, disconnecting them 00000020:00080000:3.0:1783951961.709142:0:88440:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97b046483000), last request at 1783951922 00000020:00000080:3.0:1783951961.709165:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb44c7 00000020:00010000:3.0:1783951961.709170:0:88440:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b046483000: total 2 00000100:00080000:3.0:1783951961.709174:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b046484800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783951961.709203:0:88440:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b046483000): rc 0 00000020:00080000:3.0:1783951961.709207:0:88440:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.48@tcp (ffff97b04d9f7000), last request at 1783951918 00000020:00000080:3.0:1783951961.709262:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb44a4 00000020:00010000:3.0:1783951961.709265:0:88440:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b04d9f7000: total 2 00000100:00080000:3.0:1783951961.709268:0:88440:0:(import.c:65:import_set_state_nolock()) ffff97b04d9f6000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783951961.709276:0:88440:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b04d9f7000): rc 0 00000020:00080000:3.0:1783951961.709281:0:88440:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff97b1449b3380) has no exports 00000100:00100000:0.0:1783951961.709485:0:87125:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97b150f02a00:87125] 1 exiting: rc = 0 00000100:00100000:0.0:1783951961.709582:0:87127:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97b049cc4c00:87127] 2 exiting: rc = 0 00000100:00100000:0.0:1783951961.709650:0:87131:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff97b04b0a3600:87131] 3 exiting: rc = 0 00000100:00100000:0.0:1783951961.709694:0:87124:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97b049cc5600:87124] 0 exiting: rc = 1 00000020:00000080:0.0:1783951961.709730:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b16e9ff800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783951961.709735:0:8:0:(genops.c:906:class_export_put()) final put ffff97b174b26000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783951961.709737:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b26000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783951961.709741:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783951961.709798:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b16e9fb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1783951961.710000:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710008:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710014:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710020:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710030:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710040:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710047:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710054:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710060:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710067:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710073:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710079:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710091:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:1.0:1783951961.710093:0:15262:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b046483000: total 0 00000100:00100000:3.0:1783951961.710105:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710112:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710118:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710123:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710129:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710134:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710140:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710146:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710154:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710168:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710180:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783951961.710187:0:15262:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b046483000, canceled 0 locks, left on hash table 13. 00000100:00100000:3.0:1783951961.710200:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710206:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710223:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710230:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710243:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783951961.710243:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1444fe200/0x22c73c7857bb4672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb466b expref: 14 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951961.710262:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710275:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710288:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783951961.710293:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb4602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb45fb expref: 13 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951961.710310:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710329:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710339:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783951961.710345:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb4680 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4679 expref: 12 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951961.710358:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710386:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710395:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783951961.710410:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b600/0x22c73c7857bb4610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4609 expref: 11 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951961.710411:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710427:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783951961.710439:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86a800/0x22c73c7857bb468e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4687 expref: 10 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951961.710444:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710459:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783951961.710472:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a800/0x22c73c7857bb461e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4617 expref: 9 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951961.710474:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710492:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783951961.710506:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1444ff000/0x22c73c7857bb469c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4695 expref: 8 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951961.710513:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710525:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710532:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710548:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710561:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710571:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1783951961.710575:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1444fec00/0x22c73c7857bb462c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4625 expref: 7 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.710647:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86b800/0x22c73c7857bb4648 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4641 expref: 6 pid: 87131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.710665:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1444fea00/0x22c73c7857bb46aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb46a3 expref: 5 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.710680:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1444fee00/0x22c73c7857bb463a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4633 expref: 4 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.710691:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb4664 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb465d expref: 3 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.710708:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc800/0x22c73c7857bb4656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb464f expref: 2 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.710718:0:15262:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b046483000, canceled 13 locks, left on hash table 0. 00000100:00100000:3.0:1783951961.710727:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710745:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783951961.710750:0:15262:0:(genops.c:906:class_export_put()) final put ffff97b046483000/75da5dc4-aa7e-42cf-a965-1b5f01232c6f 00000100:00100000:3.0:1783951961.710758:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.710765:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:1.0:1783951961.710772:0:15262:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b04d9f7000: total 1 00010000:00010000:1.0:1783951961.710797:0:15262:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b04d9f7000, canceled 0 locks, left on hash table 4. 00000020:00000080:0.0:1783951961.710800:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046483000/75da5dc4-aa7e-42cf-a965-1b5f01232c6f for MGS 00010000:00010000:1.0:1783951961.710818:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86ac00/0x22c73c7857bb44b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a19b expref: 5 pid: 87125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.710842:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc400/0x22c73c7857bb44c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1a9 expref: 4 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783951961.710845:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b046484800 for MGS 00010000:00010000:1.0:1783951961.710872:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1444ff200/0x22c73c7857bb45e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1b0 expref: 3 pid: 87124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.710895:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb44b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a1a2 expref: 2 pid: 87127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951961.710905:0:15262:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b04d9f7000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1783951961.710917:0:15262:0:(genops.c:906:class_export_put()) final put ffff97b04d9f7000/e66faa19-2cbc-412c-8aef-9c55427739f8 00010000:00010000:1.0:1783951961.710943:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.710946:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.710948:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951961.710960:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783951961.710967:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f7000/e66faa19-2cbc-412c-8aef-9c55427739f8 for MGS 00000020:00000080:0.0:1783951961.711001:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04d9f6000 for MGS 00000100:00100000:3.0:1783951961.711046:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.711059:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.711069:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.711077:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.711085:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.711093:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.711103:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.711119:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.711125:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783951961.711131:0:88440:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1783951961.719998:0:88440:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b04989e420 - data ffff97b181edcd80/ffff97b165008800 00000020:01000000:3.0:1783951961.720129:0:88440:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b152217480 - data ffff97b045e200d8/ffff97b16dc92c00 00000020:00000080:3.0:1783951961.720563:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb449d 00000020:00000080:3.0:1783951961.720572:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b144767000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783951961.720585:0:88440:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b176bcd000 from MGS, refs=2 00000020:01000004:3.0:1783951961.720609:0:88440:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b176bcd000 2 00000020:01000004:3.0:1783951961.720613:0:88440:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b176bcd000 from MGS 00000020:00000080:3.0:1783951961.720630:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783951961.720637:0:88440:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783951961.720639:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b144761000/MGS 00000020:00000080:3.0:1783951961.720642:0:88440:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144761000/MGS for MGS 00000020:01000000:3.0:1783951961.720648:0:88440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1783951961.720719:0:88440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1783951961.720723:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783951961.720733:0:88440:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783951961.720740:0:88440:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97b1447ce000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783951961.720745:0:88440:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff97b14545cd40) has exports, disconnecting them 00000020:00080000:3.0:1783951961.720749:0:88440:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97b1447ce000), last request at 1783951923 00000020:00000080:3.0:1783951961.720752:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb45d8 00000020:00080000:3.0:1783951961.720762:0:88440:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b1447ce000): rc 0 00000020:00000080:3.0:1783951961.720766:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b1447ce000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783951961.721392:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144767000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783951961.721401:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1447ce000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783951961.750695:0:88440:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783951961.750707:0:88440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783951961.750713:0:88440:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783951961.750722:0:88440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783951961.750754:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1447cd000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783951961.750910:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783951961.750927:0:88440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783951961.750943:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b047adb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783951961.750947:0:88440:0:(genops.c:865:class_export_destroy()) destroying export ffff97b047adb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783951961.750956:0:88440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783951961.751058:0:88440:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b176bcd000 1 00000020:00000080:0.0:1783951961.751064:0:88440:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb448f 00000020:00000080:0.0:1783951961.751071:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b144766000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783951961.751078:0:88440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783951961.751085:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144766000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783951961.751091:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783951961.751096:0:88440:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783951961.751100:0:88440:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff97b1449b4d40) has no exports 00000020:00000080:1.0:1783951961.921116:0:88440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783951961.921133:0:88440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783951961.921139:0:88440:0:(genops.c:906:class_export_put()) final put ffff97b176bce000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783951961.921144:0:88440:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176bce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783951961.921157:0:88440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783951961.921283:0:88440:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97b176bca000 00000020:02000400:1.0:1783951961.921354:0:88440:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1783951962.657145:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951963.684485:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951963.744953:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951963.744976:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465432576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951963.745046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951963.745105:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465432576 00000100:00100000:1.0:1783951963.745113:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465432576 00000100:00100000:1.0:1783951963.745176:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:1.0:1783951963.745185:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465432576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951963.745216:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951963.745260:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465432576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951963.745267:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00080000:1.0:1783951963.745303:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951963.745487:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465432704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951963.745518:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951963.745563:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465432704 00000100:00100000:2.0:1783951963.745568:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465432704 00000100:00100000:2.0:1783951963.745618:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1783951963.745626:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465432704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951963.745643:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951963.745675:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465432704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951963.745682:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1783951963.745713:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465432704:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783951963.746011:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951963.746121:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465432576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951964.256902:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465432832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951964.256977:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951964.257117:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465432832 00000100:00100000:0.0:1783951964.257125:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465432832 00000100:00100000:0.0:1783951964.257172:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:0.0:1783951964.257179:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1870605465432832:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1783951964.257200:0:8444:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783951964.257249:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1870605465432832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (271us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951964.257256:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:02020000:2.0:1783951964.257331:0:3643:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1783951964.257336:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783951964.257362:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783951964.257366:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783951964.257372:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951964.257381:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3643 00000100:00080000:2.0:1783951964.257387:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951964.257417:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd6dc00 x1870605465432960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951964.257762:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465432960:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1783951964.257793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951964.257874:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465432960 00000100:00100000:3.0:1783951964.257879:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465432960 00000100:00100000:3.0:1783951964.257912:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:3.0:1783951964.257918:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465432960:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1783951964.257937:0:23862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951964.257991:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465432960:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 71us (196us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951964.257998:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00080000:2.0:1783951964.258072:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951964.258076:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951964.258080:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465432960:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1783951964.258405:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465433472:0@lo:400:kworker.0 00000100:00100000:0.0:1783951964.258438:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951964.258457:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465433984:0@lo:400:kworker.0 00000100:00100000:0.0:1783951964.258478:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951964.258495:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783951964.258500:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465433344:0@lo:400:kworker.0 00000100:00100000:0.0:1783951964.258519:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951964.258536:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465433856:0@lo:400:kworker.0 00000100:00100000:0.0:1783951964.258558:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951964.258584:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465433472 00000100:00100000:0.0:1783951964.258614:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465433472 00000100:00100000:0.0:1783951964.258641:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465433984 00000100:00100000:0.0:1783951964.258644:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465433984 00000100:00100000:0.0:1783951964.258656:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1783951964.258661:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1870605465433472:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783951964.258667:0:68591:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783951964.258695:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1870605465433472:12345-0@lo:400:kworker.0 Request processed in 33us (257us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951964.258702:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1783951964.258712:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465433344 00000100:00100000:0.0:1783951964.258723:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465433344 00000100:00100000:0.0:1783951964.258757:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1783951964.258763:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465433344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951964.258800:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465433344:12345-0@lo:400:kworker.0 Request processed in 37us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951964.258805:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1783951964.258818:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1783951964.258822:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1870605465433984:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783951964.258826:0:68591:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783951964.258846:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1870605465433984:12345-0@lo:400:kworker.0 Request processed in 23us (367us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951964.258852:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00080000:0.0:1783951964.258871:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783951964.258898:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465433344:0@lo:400:kworker.0 00000100:00080000:0.0:1783951964.258907:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783951964.258911:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783951964.258914:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783951964.258919:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951964.258923:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3643 00000100:00080000:0.0:1783951964.258927:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951964.258946:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b144914000 x1870605465434112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951964.258962:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465433472:0@lo:400:kworker.0 00000100:00080000:0.0:1783951964.258973:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783951964.258976:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783951964.258985:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783951964.258989:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951964.258992:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3643 00000100:00080000:0.0:1783951964.258995:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951964.259008:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1f800 x1870605465434240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951964.259019:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465433984:0@lo:400:kworker.0 00000100:00100000:2.0:1783951964.259103:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465433216:0@lo:400:kworker.0 00000100:00100000:2.0:1783951964.259134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951964.259158:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465433728:0@lo:400:kworker.0 00000100:00100000:2.0:1783951964.259179:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951964.259197:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783951964.259201:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465433088:0@lo:400:kworker.0 00000400:00000100:2.0:1783951964.259219:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465433088 offset 0 length 224: 4 00000100:00100000:2.0:1783951964.259240:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465433600:0@lo:400:kworker.0 00000100:00100000:2.0:1783951964.259259:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951964.259281:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465433216 00000100:00100000:2.0:1783951964.259284:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465433216 00000100:00100000:2.0:1783951964.259302:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465433600 00000100:00100000:2.0:1783951964.259304:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465433600 00000100:00100000:2.0:1783951964.259324:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1783951964.259330:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465433600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951964.259376:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465433600:12345-0@lo:400:kworker.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951964.259382:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1783951964.259403:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1783951964.259406:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3645:x1870605465433216:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783951964.259411:0:83761:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783951964.259432:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3645:x1870605465433216:12345-0@lo:400:kworker.0 Request processed in 24us (298us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783951964.259436:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00080000:2.0:1783951964.259450:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951964.259459:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465434112:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783951964.259481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951964.259496:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465434240:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783951964.259516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951964.259540:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465434112 00000100:00100000:2.0:1783951964.259544:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465434112 00000100:00100000:2.0:1783951964.259556:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465434240 00000100:00100000:2.0:1783951964.259558:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465434240 00000100:00100000:2.0:1783951964.259567:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1783951964.259571:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465434112:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783951964.259613:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951964.259643:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465434112:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 70us (161us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951964.259649:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1783951964.259660:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1783951964.259664:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465434240:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783951964.259673:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951964.259696:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465434240:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 30us (178us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951964.259709:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1783951964.259736:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465433600:0@lo:400:kworker.0 00000100:00080000:2.0:1783951964.259745:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783951964.259748:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783951964.259751:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783951964.259755:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951964.259758:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3643 00000100:00080000:2.0:1783951964.259763:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951964.259778:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b048e37800 x1870605465434368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951964.259790:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465433216:0@lo:400:kworker.0 00000100:00100000:2.0:1783951964.259809:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465434368:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783951964.259833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783951964.259853:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951964.259857:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951964.259860:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465434112:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1783951964.259868:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951964.259871:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951964.259874:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465434240:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783951964.259894:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465434368 00000100:00100000:2.0:1783951964.259897:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465434368 00000100:00100000:2.0:1783951964.259913:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1783951964.259917:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465434368:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1783951964.259932:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951964.259960:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465434368:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 41us (125us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951964.259967:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00080000:2.0:1783951964.259990:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951964.259993:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951964.259995:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465434368:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1783951964.260240:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465433856 00000100:00100000:3.0:1783951964.260245:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465433856 00000100:00100000:3.0:1783951964.260282:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465433728 00000100:00100000:3.0:1783951964.260285:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465433728 00000100:00100000:3.0:1783951964.260309:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:3.0:1783951964.260316:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465433856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951964.260375:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465433856:12345-0@lo:400:kworker.0 Request processed in 59us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951964.260381:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:3.0:1783951964.260403:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:3.0:1783951964.260410:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465433728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951964.260445:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465433728:12345-0@lo:400:kworker.0 Request processed in 35us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951964.260450:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00100000:3.0:1783951964.260480:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465433728:0@lo:400:kworker.0 00000100:00100000:3.0:1783951964.260505:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465433856:0@lo:400:kworker.0 00000400:00000100:2.0:1783951964.658671:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447711488 offset 0 length 224: 4 00000100:00100000:2.0:1783951964.658726:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951964.658773:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951964.658808:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951964.658838:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951964.659127:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447711744 00000100:00100000:0.0:1783951964.659138:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447711744 00000100:00100000:0.0:1783951964.659204:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447711616 00000100:00100000:0.0:1783951964.659208:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447711616 00000100:00100000:0.0:1783951964.659230:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1160 00000100:00100000:0.0:1783951964.659240:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447711744:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783951964.659388:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447712000 00000100:00100000:1.0:1783951964.659393:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447712000 00000100:00100000:1.0:1783951964.659425:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447711872 00000100:00100000:1.0:1783951964.659428:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447711872 00000100:00100000:1.0:1783951964.659451:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2662 00000100:00100000:1.0:1783951964.659458:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447712000:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951964.659564:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1166 00000100:00100000:3.0:1783951964.660370:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1870605447711616:12345-192.168.202.48@tcp:400:kworker.0 00000020:00080000:3.0:1783951964.660383:0:83761:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.48@tcp 00000100:00100000:0.0:1783951964.665728:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447711744:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 6472us (6985us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951964.665750:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1160 00000100:00100000:0.0:1783951964.665841:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2663 00000100:00100000:0.0:1783951964.665858:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447711872:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951964.665928:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447711872:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 77us (7088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951964.665934:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2663 00000100:00100000:0.0:1783951964.666162:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951964.666242:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951964.666308:0:66265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447712128 00000100:00100000:0.0:1783951964.666324:0:66265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447712128 00000100:00100000:0.0:1783951964.666369:0:66265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:0.0:1783951964.666488:0:66265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2400:x1870605447712128:12345-192.168.202.48@tcp:4:dd.0 00000020:00080000:0.0:1783951964.666499:0:66265:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.202.48@tcp 00000100:00100000:0.0:1783951964.666546:0:66265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2400:x1870605447712128:12345-192.168.202.48@tcp:4:dd.0 Request processed in 65us (386us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951964.666558:0:66265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1 00000100:00100000:0.0:1783951964.666610:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447712256 00000100:00100000:0.0:1783951964.666615:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447712256 00000100:00100000:0.0:1783951964.666732:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1167 00000100:00100000:0.0:1783951964.666739:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870605447712256:12345-192.168.202.48@tcp:16:kworker.0 00000020:00080000:0.0:1783951964.666750:0:67035:0:(tgt_handler.c:807:tgt_request_handle()) operation 16 on unconnected OST from 12345-192.168.202.48@tcp 00000100:00100000:0.0:1783951964.666775:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870605447712256:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 34us (533us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783951964.666782:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1167 00000100:00080000:0.0:1783951964.666813:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951964.666818:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783951964.666821:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951964.676009:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447712000:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 16536us (17219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951964.676026:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2662 00000100:00100000:3.0:1783951964.676703:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1870605447711616:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 16324us (17879us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783951964.676721:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1166 00000100:00100000:2.0:1783951964.680495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951964.680544:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447712384 00000100:00100000:0.0:1783951964.680556:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447712384 00000100:00100000:0.0:1783951964.680648:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1168 00000100:00100000:0.0:1783951964.680659:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447712384:12345-192.168.202.48@tcp:38:ptlrpcd_01_00.0 00010000:00020000:0.0:1783951964.680689:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951964.680949:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447712384:12345-192.168.202.48@tcp:38:ptlrpcd_01_00.0 Request processed in 290us (469us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951964.680958:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1168 00010000:00010000:1.0:1783951964.705098:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951965.728838:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951966.752781:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783951966.821741:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783951966.821760:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411436 is committed 00000020:00000080:3.0:1783951966.821766:0:75694:0:(genops.c:906:class_export_put()) final put ffff97b1762c2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951966.821832:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783951966.821928:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1762c6000 for lustre-MDT0001 00000001:00100000:2.0:1783951966.826693:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783951966.826705:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b144763800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783951966.827531:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144763800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783951966.827683:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144764000 for lustre-OST0000 00000001:00100000:1.0:1783951966.828806:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783951966.828817:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b04d9f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783951966.828891:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783951966.828953:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04d9f5000 for lustre-OST0001 00010000:00010000:2.0:1783951967.777644:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951968.800999:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951968.869027:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951968.869068:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465434496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951968.869175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951968.869556:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465434496 00000100:00100000:2.0:1783951968.869567:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465434496 00000100:00100000:2.0:1783951968.869685:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:2.0:1783951968.869696:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465434496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951968.869742:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951968.869806:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465434496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951968.869813:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:2.0:1783951968.869874:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465434496:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783951968.870769:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951968.872130:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465434624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951968.872212:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951968.872822:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465434624 00000100:00100000:0.0:1783951968.872834:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465434624 00000100:00100000:0.0:1783951968.872926:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:0.0:1783951968.872937:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465434624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783951968.872976:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783951968.873050:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465434624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951968.873058:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:3.0:1783951968.873629:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465434624:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783951968.873777:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783951969.378137:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951969.378146:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951969.378151:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951969.378162:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3679 00000100:00080000:1.0:1783951969.378170:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951969.378180:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951969.378212:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049c31f80 x1870605465434880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951969.378256:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951969.378260:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951969.378280:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951969.378283:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3679 00000100:00080000:1.0:1783951969.378286:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951969.378290:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951969.378303:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1762f3100 x1870605465435136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951969.378349:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951969.378353:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951969.378354:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951969.378358:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3679 00000100:00080000:1.0:1783951969.378360:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951969.380433:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951969.380906:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465434752:0@lo:400:kworker.0 00000400:00000100:3.0:1783951969.380993:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465434752 offset 0 length 224: 4 00000100:00100000:3.0:1783951969.381092:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783951969.381107:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465435264:0@lo:400:kworker.0 00000100:00100000:3.0:1783951969.381154:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951969.381171:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465434880:0@lo:38:kworker.0 00000100:00100000:2.0:1783951969.381216:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951969.381244:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465435136:0@lo:38:kworker.0 00000100:00100000:2.0:1783951969.381269:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951969.381318:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465435264 00000100:00100000:2.0:1783951969.381328:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465435264 00000100:00100000:3.0:1783951969.381427:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465434880 00000100:00100000:3.0:1783951969.381433:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465434880 00000100:00100000:0.0:1783951969.381516:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465435008:0@lo:400:kworker.0 00000100:00100000:0.0:1783951969.381554:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951969.381933:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1762f0380 x1870605465435392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951969.382007:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951969.382012:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951969.382016:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951969.382021:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3679 00000100:00080000:1.0:1783951969.382027:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783951969.382033:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951969.382053:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de29c00 x1870605465435776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951969.382079:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783951969.382089:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465435520:0@lo:400:kworker.0 00000100:00100000:1.0:1783951969.382133:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951969.382202:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465435520 00000100:00100000:1.0:1783951969.382206:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465435520 00000100:00100000:1.0:1783951969.382246:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:1.0:1783951969.382256:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465435520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951969.382326:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465435520:12345-0@lo:400:kworker.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951969.382333:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:1.0:1783951969.382685:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465435520:0@lo:400:kworker.0 00000100:00100000:1.0:1783951969.382784:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465435648:0@lo:400:kworker.0 00000100:00100000:1.0:1783951969.382819:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951969.382850:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465435648 00000100:00100000:1.0:1783951969.382854:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465435648 00000100:00100000:1.0:1783951969.382882:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:1.0:1783951969.382887:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17743ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465435648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951969.382919:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17743ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465435648:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951969.382925:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:1.0:1783951969.383148:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465435648:0@lo:400:kworker.0 00000100:00100000:3.0:1783951969.384562:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465435136 00000100:00100000:3.0:1783951969.384573:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465435136 00000100:00100000:0.0:1783951969.384626:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1783951969.384652:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465435264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951969.384740:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1783951969.384744:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465435264:12345-0@lo:400:kworker.0 Request processed in 100us (3589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951969.384753:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465434880:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783951969.384758:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1783951969.384784:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00010000:00020000:3.0:1783951969.384789:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951969.384791:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465435136:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783951969.384805:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951969.384872:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465435008 00000100:00100000:2.0:1783951969.384878:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465435008 00000100:00080000:1.0:1783951969.384909:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951969.384929:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:1.0:1783951969.384939:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465435392:0@lo:38:kworker.0 00000100:00100000:2.0:1783951969.384940:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465435008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951969.385113:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465434880:12345-0@lo:38:kworker.0 Request processed in 362us (3897us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951969.385148:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465435008:12345-0@lo:400:kworker.0 Request processed in 209us (3591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951969.385155:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1783951969.385162:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:3.0:1783951969.385212:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465435264:0@lo:400:kworker.0 00000100:00100000:0.0:1783951969.385288:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465435136:12345-0@lo:38:kworker.0 Request processed in 496us (4018us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951969.385296:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:0.0:1783951969.385341:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465435008:0@lo:400:kworker.0 00000100:00100000:1.0:1783951969.385349:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951969.385498:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465435392 00000100:00100000:2.0:1783951969.385512:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465435392 00000100:00100000:2.0:1783951969.385623:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:2.0:1783951969.385629:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465435392:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951969.385643:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951969.385676:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465435776:0@lo:38:kworker.0 00000100:00100000:2.0:1783951969.385682:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465435392:12345-0@lo:38:kworker.0 Request processed in 50us (332us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951969.385691:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00100000:1.0:1783951969.385715:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951969.385747:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465435776 00000100:00080000:1.0:1783951969.385751:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783951969.385753:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465435776 00000100:00080000:1.0:1783951969.385759:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951969.385763:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465434880:0@lo:38:kworker.0 00000100:00100000:0.0:1783951969.385785:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00080000:1.0:1783951969.385788:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783951969.385794:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465435776:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1783951969.385797:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951969.385804:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465435136:0@lo:38:kworker.0 00010000:00020000:0.0:1783951969.385809:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1783951969.385832:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951969.385838:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951969.385842:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465435392:0@lo:38:kworker.0 00000100:00100000:0.0:1783951969.385848:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465435776:12345-0@lo:38:kworker.0 Request processed in 54us (131us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783951969.385855:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783951969.385859:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:1.0:1783951969.385862:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951969.385867:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465435776:0@lo:38:kworker.0 00000400:00000100:0.0:1783951969.783545:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447712512 offset 0 length 224: 4 00000100:00100000:0.0:1783951969.784032:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951969.784131:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951969.790861:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951969.790904:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951969.790955:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447713024 00000100:00100000:0.0:1783951969.790964:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447713024 00000100:00100000:0.0:1783951969.791030:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447712896 00000100:00100000:0.0:1783951969.791034:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447712896 00000100:00100000:0.0:1783951969.791059:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2666 00000100:00100000:0.0:1783951969.791069:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447713024:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951969.791148:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447713024:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 81us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951969.791155:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2666 00000100:00100000:0.0:1783951969.791170:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2667 00000100:00100000:0.0:1783951969.791176:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447712896:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951969.791199:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447712896:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 23us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951969.791218:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2667 00000100:00080000:1.0:1783951969.791493:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783951969.791499:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951969.791689:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447712768 00000100:00100000:3.0:1783951969.791694:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447712768 00000100:00100000:3.0:1783951969.791773:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447712640 00000100:00100000:3.0:1783951969.791777:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447712640 00000100:00100000:3.0:1783951969.791792:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1163 00000100:00100000:3.0:1783951969.791799:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447712768:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951969.791831:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447712768:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 33us (7802us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951969.791836:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1163 00000100:00100000:3.0:1783951969.791849:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1172 00000100:00100000:3.0:1783951969.791853:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447712640:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783951969.791871:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951969.791907:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447712640:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 52us (7775us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951969.791913:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1172 00000100:00080000:1.0:1783951969.792793:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783951969.825079:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951970.850878:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951971.872888:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951972.896794:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951973.920879:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951973.984932:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465435904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951973.985008:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951973.986184:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465435904 00000100:00100000:2.0:1783951973.986195:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465435904 00000100:00100000:2.0:1783951973.986289:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:2.0:1783951973.986299:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465435904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951973.986344:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951973.986405:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465435904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951973.986412:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00080000:3.0:1783951973.986488:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951973.986606:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783951973.986715:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465435904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783951973.995766:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465436032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951973.995846:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951973.996017:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465436032 00000100:00100000:1.0:1783951973.996026:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465436032 00000100:00100000:1.0:1783951973.996133:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:1.0:1783951973.996143:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465436032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951973.996175:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951973.996239:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465436032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951973.996271:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00080000:3.0:1783951973.996317:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951973.996439:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465436032:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783951974.496783:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951974.496790:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951974.496794:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951974.496802:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3684 00000100:00080000:1.0:1783951974.496809:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951974.496817:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951974.496839:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b147742d80 x1870605465436288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951974.496889:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951974.496893:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951974.496894:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951974.496898:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3684 00000100:00080000:1.0:1783951974.496900:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951974.496903:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951974.496917:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de29c00 x1870605465436544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951974.496932:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951974.496935:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951974.496937:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951974.496939:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3684 00000100:00080000:1.0:1783951974.496941:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951974.496958:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951974.496970:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049d70e00 x1870605465436800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951974.497007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783951974.497010:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783951974.497012:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783951974.497015:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3684 00000100:00080000:1.0:1783951974.497017:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783951974.497021:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951974.497033:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab01f80 x1870605465437184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783951974.497067:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465436672:0@lo:400:kworker.0 00000100:00100000:1.0:1783951974.497131:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951974.497172:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951974.497178:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465436416:0@lo:400:kworker.0 00000100:00100000:3.0:1783951974.497355:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465436288:0@lo:38:kworker.0 00000100:00100000:3.0:1783951974.497385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951974.497416:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465436544:0@lo:38:kworker.0 00000100:00100000:3.0:1783951974.497437:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951974.497454:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465436800:0@lo:38:kworker.0 00000100:00100000:3.0:1783951974.497476:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951974.497493:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465437184:0@lo:38:kworker.0 00000100:00100000:3.0:1783951974.497511:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951974.497552:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465436672 00000100:00100000:3.0:1783951974.497560:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465436672 00000100:00100000:3.0:1783951974.497633:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465436288 00000100:00100000:3.0:1783951974.497636:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465436288 00000100:00100000:3.0:1783951974.497651:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465436544 00000100:00100000:3.0:1783951974.497654:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465436544 00000100:00100000:3.0:1783951974.497661:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465437184 00000100:00100000:3.0:1783951974.497664:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465437184 00000100:00100000:3.0:1783951974.497676:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:3.0:1783951974.497685:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465436672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951974.497734:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465436672:12345-0@lo:400:kworker.0 Request processed in 50us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951974.497740:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:3.0:1783951974.497755:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1783951974.497759:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465436288:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951974.497776:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951974.497806:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465436288:12345-0@lo:38:kworker.0 Request processed in 45us (420us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951974.497812:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1783951974.497823:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:3.0:1783951974.497827:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465436544:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951974.497843:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951974.497869:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465436544:12345-0@lo:38:kworker.0 Request processed in 40us (430us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951974.497874:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:3.0:1783951974.497884:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:3.0:1783951974.497888:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465437184:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951974.497896:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951974.497917:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465437184:12345-0@lo:38:kworker.0 Request processed in 28us (405us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951974.497923:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:3.0:1783951974.498005:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465436800 00000100:00100000:3.0:1783951974.498010:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465436800 00000100:00100000:3.0:1783951974.498032:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:3.0:1783951974.498036:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465436800:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951974.498045:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951974.498072:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465436800:12345-0@lo:38:kworker.0 Request processed in 34us (595us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951974.498077:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00080000:3.0:1783951974.498096:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783951974.498130:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951974.498134:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951974.498138:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465436288:0@lo:38:kworker.0 00000100:00080000:3.0:1783951974.498146:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951974.498150:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951974.498152:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465436544:0@lo:38:kworker.0 00000100:00080000:3.0:1783951974.498170:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951974.498174:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951974.498177:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465436800:0@lo:38:kworker.0 00000100:00100000:2.0:1783951974.498352:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465436928:0@lo:400:kworker.0 00000100:00080000:3.0:1783951974.498385:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951974.498389:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951974.498392:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465437184:0@lo:38:kworker.0 00000100:00100000:0.0:1783951974.499062:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465436160:0@lo:400:kworker.0 00000100:00100000:1.0:1783951974.501651:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951974.501712:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465436672:0@lo:400:kworker.0 00000100:00100000:1.0:1783951974.501780:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465436416 00000100:00100000:1.0:1783951974.501787:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465436416 00000100:00100000:1.0:1783951974.501842:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1783951974.501850:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465436416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951974.501903:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465436416:12345-0@lo:400:kworker.0 Request processed in 53us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951974.501910:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1783951974.501940:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465436416:0@lo:400:kworker.0 00000100:00080000:3.0:1783951974.502061:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951974.504385:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951974.504648:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465436928 00000100:00100000:1.0:1783951974.504671:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465436928 00000100:00100000:1.0:1783951974.504717:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:1.0:1783951974.504726:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465436928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951974.504791:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465436928:12345-0@lo:400:kworker.0 Request processed in 65us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951974.504797:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00100000:3.0:1783951974.504927:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465436928:0@lo:400:kworker.0 00000400:00000100:0.0:1783951974.507272:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465436160 offset 0 length 224: 4 00000100:00100000:0.0:1783951974.507322:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465437056:0@lo:400:kworker.0 00000100:00100000:0.0:1783951974.507363:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951974.511941:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465437056 00000100:00100000:1.0:1783951974.512027:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465437056 00000100:00100000:1.0:1783951974.512152:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:1.0:1783951974.512163:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465437056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951974.512284:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465437056:12345-0@lo:400:kworker.0 Request processed in 123us (4920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951974.512442:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465437056:0@lo:400:kworker.0 00000100:00100000:1.0:1783951974.513646:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:2.0:1783951974.893675:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:2.0:1783951974.893705:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447713152 offset 0 length 224: 4 00000100:00100000:2.0:1783951974.893722:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951974.893755:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951974.893785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951974.893826:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447713536 00000100:00100000:1.0:1783951974.893829:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447713664 00000100:00100000:2.0:1783951974.893834:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447713536 00000100:00100000:1.0:1783951974.893834:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447713664 00000100:00100000:3.0:1783951974.893890:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447713408 00000100:00100000:1.0:1783951974.893892:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4911 00000100:00100000:3.0:1783951974.893894:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447713408 00000100:00100000:1.0:1783951974.893902:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+5:2397:x1870605447713664:12345-192.168.202.48@tcp:9:kworker.0 00000100:00100000:0.0:1783951974.893951:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447713280 00000100:00100000:0.0:1783951974.893955:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447713280 00000100:00100000:0.0:1783951974.893983:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1176 00000100:00100000:0.0:1783951974.893989:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447713280:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:0.0:1783951974.894010:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783951974.894068:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447713280:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 77us (344us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783951974.894075:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1176 00000100:00100000:2.0:1783951974.894127:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4912 00000100:00100000:2.0:1783951974.894133:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:458183b2-4c6d-478c-9fed-a955779e6611+5:2397:x1870605447713536:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:2.0:1783951974.894157:0:26202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb48e1 00000100:00080000:2.0:1783951974.894166:0:26202:0:(import.c:65:import_set_state_nolock()) ffff97b04b212000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1783951974.894196:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783951974.894200:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783951974.894202:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:2.0:1783951974.894209:0:26202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968951 00000020:00000080:1.0:1783951974.894267:0:26206:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb48e8 00000100:00080000:1.0:1783951974.894273:0:26206:0:(import.c:65:import_set_state_nolock()) ffff97b04965a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783951974.894308:0:26206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968951 00000100:00100000:2.0:1783951974.894348:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:458183b2-4c6d-478c-9fed-a955779e6611+2:2397:x1870605447713536:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 214us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951974.894355:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4912 00000100:00100000:1.0:1783951974.894375:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+2:2397:x1870605447713664:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 475us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951974.894381:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4911 00010000:00010000:2.0:1783951974.894389:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951974.894616:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951974.895108:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1166 00000100:00100000:3.0:1783951974.895118:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447713408:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951974.895175:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447713408:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 59us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951974.895183:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1166 00010000:00010000:1.0:1783951974.945055:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951975.968903:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951976.994163:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951978.025085:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951979.047299:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951979.104805:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783951979.104825:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465437312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951979.104899:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951979.104977:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465437312 00000100:00100000:2.0:1783951979.104984:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465437312 00000100:00100000:2.0:1783951979.105056:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:2.0:1783951979.105066:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465437312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783951979.105106:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783951979.105150:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465437312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951979.105158:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00080000:1.0:1783951979.105302:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783951979.105337:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465437312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951979.122325:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783951979.122348:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465437440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951979.122417:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951979.122458:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465437440 00000100:00100000:1.0:1783951979.122465:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465437440 00000100:00100000:1.0:1783951979.122515:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:1.0:1783951979.122523:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465437440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951979.122551:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951979.122614:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465437440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951979.122620:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00080000:1.0:1783951979.122638:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951979.122667:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465437440:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783951979.621062:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951979.621069:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951979.621073:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951979.621081:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3689 00000100:00080000:2.0:1783951979.621086:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783951979.621094:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951979.621118:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04b603800 x1870605465437696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951979.621141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951979.621144:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951979.621147:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951979.621150:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3689 00000100:00080000:2.0:1783951979.621152:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783951979.621155:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951979.621166:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04b601f80 x1870605465437952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951979.621187:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951979.621190:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951979.621192:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951979.621195:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3689 00000100:00080000:2.0:1783951979.621207:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783951979.621223:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951979.621237:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04671d180 x1870605465438208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951979.621247:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951979.621250:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951979.621251:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951979.621255:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3689 00000100:00080000:2.0:1783951979.621257:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783951979.621260:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951979.621271:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04671e300 x1870605465438336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951979.621416:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465437568:0@lo:400:kworker.0 00000400:00000100:3.0:1783951979.621481:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465437568 offset 0 length 224: 4 00000100:00100000:3.0:1783951979.621523:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951979.621529:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465437824:0@lo:400:kworker.0 00000100:00100000:3.0:1783951979.621563:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951979.621626:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465437696:0@lo:38:kworker.0 00000100:00100000:3.0:1783951979.621651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951979.621667:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465437952:0@lo:38:kworker.0 00000100:00100000:3.0:1783951979.621698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951979.621718:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465438208:0@lo:38:kworker.0 00000100:00100000:3.0:1783951979.621741:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951979.621759:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465438336:0@lo:38:kworker.0 00000100:00100000:3.0:1783951979.621778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951979.621809:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465437824 00000100:00100000:3.0:1783951979.621816:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465437824 00000100:00100000:3.0:1783951979.621866:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465437696 00000100:00100000:3.0:1783951979.621869:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465437696 00000100:00100000:3.0:1783951979.621883:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465437952 00000100:00100000:3.0:1783951979.621886:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465437952 00000100:00100000:3.0:1783951979.621895:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465438336 00000100:00100000:3.0:1783951979.621897:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465438336 00000100:00100000:3.0:1783951979.621908:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:3.0:1783951979.621916:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465437824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951979.621966:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465437824:12345-0@lo:400:kworker.0 Request processed in 51us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951979.621973:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:3.0:1783951979.621990:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1783951979.621995:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465437696:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951979.622014:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951979.622062:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465437696:12345-0@lo:38:kworker.0 Request processed in 64us (409us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951979.622069:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1783951979.622080:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1783951979.622084:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465437952:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951979.622093:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951979.622124:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465437952:12345-0@lo:38:kworker.0 Request processed in 38us (425us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951979.622130:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1783951979.622143:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1783951979.622147:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465438336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951979.622156:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951979.622180:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465438336:12345-0@lo:38:kworker.0 Request processed in 31us (401us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951979.622185:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1783951979.622207:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465438208 00000100:00100000:3.0:1783951979.622210:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465438208 00000100:00100000:3.0:1783951979.622243:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:3.0:1783951979.622248:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465438208:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951979.622256:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951979.622279:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465438208:12345-0@lo:38:kworker.0 Request processed in 30us (537us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951979.622285:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00080000:3.0:1783951979.622302:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951979.622791:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465437824:0@lo:400:kworker.0 00000100:00080000:3.0:1783951979.622824:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951979.622829:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951979.622833:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465437696:0@lo:38:kworker.0 00000100:00080000:3.0:1783951979.622842:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951979.622846:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951979.622849:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465437952:0@lo:38:kworker.0 00000100:00080000:3.0:1783951979.622870:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951979.622873:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951979.622876:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465438208:0@lo:38:kworker.0 00000100:00080000:3.0:1783951979.622885:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951979.622887:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951979.622890:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465438336:0@lo:38:kworker.0 00000100:00100000:1.0:1783951979.625795:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465438080:0@lo:400:kworker.0 00000100:00100000:1.0:1783951979.625864:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951979.625968:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465438080 00000100:00100000:2.0:1783951979.625977:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465438080 00000100:00100000:2.0:1783951979.626043:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1783951979.626052:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465438080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951979.626108:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465438080:12345-0@lo:400:kworker.0 Request processed in 57us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951979.626114:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00080000:1.0:1783951979.626232:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783951979.626262:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465438080:0@lo:400:kworker.0 00000400:00000100:2.0:1783951980.012922:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447713792 offset 0 length 520: 4 00000100:00100000:2.0:1783951980.012975:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951980.013077:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447713920 00000100:00100000:3.0:1783951980.013087:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447713920 00000100:00100000:3.0:1783951980.013131:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1180 00000100:00100000:3.0:1783951980.013139:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447713920:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783951980.013161:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951980.013360:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447713920:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 219us (383us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951980.013368:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1180 00000100:00100000:2.0:1783951980.020236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951980.020458:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447714048 00000100:00100000:3.0:1783951980.020468:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447714048 00000100:00100000:3.0:1783951980.020534:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1169 00000100:00100000:3.0:1783951980.020544:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447714048:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951980.020630:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447714048:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 87us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951980.020637:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1169 00000100:00080000:1.0:1783951980.020714:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783951980.066833:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1783951980.642960:0:3645:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951964/real 1783951964] req@ffff97b16dd4d180 x1870605465433088/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783951980 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951980.643014:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff97b16dd4d180 x1870605465433088/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783951980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951980.643023:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783951980.643027:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1783951980.643030:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.148@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783951980.643032:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783951980.643035:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b16dd4d180 x1870605465433088/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783951980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951980.643044:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b047acfb80 x1870605465434752/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951985 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951980.643055:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b147740700 x1870605465436160/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951990 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951980.643063:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b04b603480 x1870605465437568/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783951995 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783951980.643076:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783951980.643080:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783951980.643082:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783951980.643084:0:3645:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1783951980.643107:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465436160:0@lo:400:kworker.0 00000100:00100000:2.0:1783951980.643113:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465433088:0@lo:400:kworker.0 00000100:00100000:2.0:1783951980.643146:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465437568:0@lo:400:kworker.0 00000100:00080000:3.0:1783951980.643285:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951980.643291:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783951980.643295:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951980.643312:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3637 00000100:00080000:3.0:1783951980.643322:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951980.643359:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b147740700 x1870605465438464/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951980.643388:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951980.643392:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951980.643394:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951980.643397:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3694 00000100:00080000:3.0:1783951980.643399:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951980.643403:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951980.643419:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04b603480 x1870605465438592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951980.643443:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951980.643447:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951980.643448:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951980.643452:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3694 00000100:00080000:3.0:1783951980.643454:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951980.643457:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951980.643468:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04b603800 x1870605465438848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951980.643486:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951980.643489:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951980.643490:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951980.643493:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3694 00000100:00080000:3.0:1783951980.643495:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951980.643504:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951980.643519:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b048fbbb80 x1870605465439104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951980.643544:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951980.643547:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951980.643548:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951980.643552:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3694 00000100:00080000:3.0:1783951980.643554:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951980.643557:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951980.643567:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14474ca80 x1870605465439488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951980.643628:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465438720:0@lo:400:kworker.0 00000100:00100000:3.0:1783951980.643692:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951980.643723:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951980.643729:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14474f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465439360:0@lo:400:kworker.0 00000100:00100000:3.0:1783951980.643752:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951980.643783:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465439360 00000100:00100000:3.0:1783951980.643790:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465439360 00000100:00100000:3.0:1783951980.643833:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:3.0:1783951980.643841:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465439360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951980.643888:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465439360:12345-0@lo:400:kworker.0 Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951980.643895:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00100000:3.0:1783951980.643946:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14474f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465439360:0@lo:400:kworker.0 00000100:00100000:1.0:1783951980.644480:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465434752:0@lo:400:kworker.0 00000100:00100000:2.0:1783951980.644575:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465438464:0@lo:250:kworker.0 00000400:00000100:2.0:1783951980.644642:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465438464 offset 0 length 520: 4 00000100:00100000:2.0:1783951980.644667:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465438592:0@lo:38:kworker.0 00000100:00100000:2.0:1783951980.644706:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951980.644730:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465438848:0@lo:38:kworker.0 00000100:00100000:2.0:1783951980.644751:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951980.644775:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465439104:0@lo:38:kworker.0 00000100:00100000:2.0:1783951980.644800:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951980.644818:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465439488:0@lo:38:kworker.0 00000100:00100000:2.0:1783951980.644837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951980.644870:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465438720 00000100:00100000:2.0:1783951980.644875:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465438720 00000100:00100000:1.0:1783951980.645055:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465438592 00000100:00100000:1.0:1783951980.645059:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465438592 00000100:00100000:1.0:1783951980.645083:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1783951980.645092:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465438720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951980.645145:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465438720:12345-0@lo:400:kworker.0 Request processed in 55us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951980.645152:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1783951980.645167:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465438848 00000100:00100000:1.0:1783951980.645170:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465438848 00000100:00100000:1.0:1783951980.645180:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465439488 00000100:00100000:1.0:1783951980.645182:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465439488 00000100:00100000:1.0:1783951980.645192:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1783951980.645196:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465438592:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783951980.645223:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951980.645256:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465438592:12345-0@lo:38:kworker.0 Request processed in 58us (549us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951980.645262:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1783951980.645275:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1783951980.645279:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465438848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783951980.645287:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951980.645310:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465438848:12345-0@lo:38:kworker.0 Request processed in 30us (558us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951980.645315:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1783951980.645325:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1783951980.645328:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465439488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783951980.645335:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783951980.645354:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465439488:12345-0@lo:38:kworker.0 Request processed in 24us (516us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783951980.645359:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1783951980.645396:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465438720:0@lo:400:kworker.0 00000100:00080000:1.0:1783951980.645420:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951980.645425:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951980.645428:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465438592:0@lo:38:kworker.0 00000100:00080000:1.0:1783951980.645437:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951980.645440:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951980.645442:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465438848:0@lo:38:kworker.0 00000100:00080000:1.0:1783951980.645449:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951980.645452:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951980.645454:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465439488:0@lo:38:kworker.0 00000100:00100000:2.0:1783951980.645519:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465439104 00000100:00100000:2.0:1783951980.645523:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465439104 00000100:00100000:2.0:1783951980.645553:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:2.0:1783951980.645557:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465439104:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951980.645568:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951980.645628:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465439104:12345-0@lo:38:kworker.0 Request processed in 69us (827us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951980.645633:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:2.0:1783951980.645659:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465438976:0@lo:400:kworker.0 00000100:00100000:2.0:1783951980.645683:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951980.645701:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951980.645707:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04920d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465439232:0@lo:400:kworker.0 00000100:00100000:2.0:1783951980.645729:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951980.645858:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465439232 00000100:00100000:1.0:1783951980.645862:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465439232 00000100:00100000:1.0:1783951980.645894:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:1.0:1783951980.645910:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465439232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951980.645947:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465439232:12345-0@lo:400:kworker.0 Request processed in 47us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951980.645952:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00100000:1.0:1783951980.645976:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04920d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465439232:0@lo:400:kworker.0 00000100:00100000:1.0:1783951980.645992:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465438976 00000100:00100000:1.0:1783951980.645995:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465438976 00000100:00100000:1.0:1783951980.646015:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1783951980.646020:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465438976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951980.646049:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465438976:12345-0@lo:400:kworker.0 Request processed in 30us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951980.646065:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1783951980.646091:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465438976:0@lo:400:kworker.0 00000100:00080000:1.0:1783951980.646110:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951980.646114:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951980.646116:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465439104:0@lo:38:kworker.0 00010000:00010000:2.0:1783951981.089622:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783951981.161082:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:2.0:1783951981.161093:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b04965b000/458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:0.0:1783951981.161186:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965b000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-OST0001 00000020:00000080:0.0:1783951981.161250:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04965a800 for lustre-OST0001 00000001:00100000:3.0:1783951981.170363:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:3.0:1783951981.170380:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b14374f000/458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:1.0:1783951981.170604:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14374f000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-OST0000 00000020:00000080:1.0:1783951981.170658:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04b212000 for lustre-OST0000 00010000:00010000:0.0:1783951982.112892:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951983.136747:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951984.163764:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951984.225081:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465439616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951984.225153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951984.225229:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465439616 00000100:00100000:1.0:1783951984.225237:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465439616 00000100:00100000:1.0:1783951984.225308:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:1.0:1783951984.225316:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465439616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951984.225347:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951984.225389:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465439616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951984.225397:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00080000:1.0:1783951984.225418:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783951984.225451:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465439616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783951984.225786:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465439744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783951984.225816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951984.227161:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465439744 00000100:00100000:3.0:1783951984.227180:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465439744 00000100:00100000:3.0:1783951984.227289:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:3.0:1783951984.227300:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465439744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951984.227336:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783951984.227532:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951984.227574:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465439744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 276us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951984.227581:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00100000:1.0:1783951984.228119:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465439744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951985.136265:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951985.136370:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447714176 00000100:00100000:3.0:1783951985.136380:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447714176 00000100:00100000:3.0:1783951985.136439:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1184 00000100:00100000:3.0:1783951985.136447:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447714176:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783951985.136470:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951985.136826:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447714176:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 376us (567us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951985.136834:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1184 00000100:00100000:1.0:1783951985.139205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951985.139279:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447714304 00000100:00100000:2.0:1783951985.139287:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447714304 00000100:00100000:2.0:1783951985.139357:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1172 00000100:00100000:2.0:1783951985.139368:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447714304:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951985.139456:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447714304:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 90us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951985.139463:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1172 00000100:00080000:0.0:1783951985.140039:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783951985.184833:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783951985.401924:0:89059:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783951985.401931:0:89059:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783951985.401933:0:89059:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783951985.402039:0:89059:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97b174b31800 00000020:01000004:0.0:1783951985.402054:0:89059:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783951985.402068:0:89059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783951985.402082:0:89059:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97b048b5cd40) 00000020:00000080:0.0:1783951985.402100:0:89059:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783951985.589409:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783951985.592231:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783951985.605551:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.606290:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.606693:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.606959:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783951985.607896:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783951985.608147:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783951985.608487:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783951985.608729:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783951985.612863:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.614422:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.618825:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.621375:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783951985.632724:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.633577:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.634026:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.634661:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.635173:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.641704:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.642794:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.643235:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.643552:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.643892:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.644168:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.645065:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.645428:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.646099:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.646521:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.646969:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.647277:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.647617:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.647979:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.648380:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.648690:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.649140:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.649638:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.650053:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.650371:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.650687:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.651019:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.651325:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.651723:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.652130:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783951985.652462:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.653250:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.653533:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783951985.668834:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.669713:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.669964:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.670539:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.671773:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1783951985.677572:0:89059:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1783951985.679316:0:89059:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783951985.679556:0:89059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783951985.679566:0:89059:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783951985.679579:0:89059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb4a3f 00000020:01000004:2.0:1783951985.679636:0:89059:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783951985.679650:0:89059:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783951985.679659:0:89059:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b174b31800 from MGS 00000020:01000004:2.0:1783951985.679662:0:89059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783951985.679673:0:89059:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97b14545b380) 00000020:00000080:2.0:1783951985.679685:0:89059:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1783951985.679745:0:89059:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b174b31800 from MGS, refs=2 00080000:01000000:2.0:1783951985.679750:0:89059:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783951985.679756:0:89059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb4a4d 00010000:00010000:0.0:1783951985.683325:0:89059:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1783951985.695092:0:89059:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783951985.696093:0:89063:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783951985.696151:0:89059:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783951985.696195:0:89059:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783951985.697104:0:89059:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783951985.697424:0:89059:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783951985.697562:0:89059:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783951985.697568:0:89059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783951985.698423:0:89059:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783951985.698431:0:89059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783951985.698794:0:89059:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783951985.698801:0:89059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783951985.700551:0:89059:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783951985.700575:0:89059:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1783951985.700576:0:89059:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1783951985.700579:0:89059:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1783951985.700585:0:89059:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 71, was 0): CONNECTING 00000100:00100000:2.0:1783951985.700617:0:89059:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00080000:3.0:1783951985.760892:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951985.760902:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951985.760905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951985.760909:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951985.760913:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951985.760920:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3695 00000100:00080000:3.0:1783951985.760924:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951985.760932:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951985.760984:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e1c00 x1870605465439872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951985.761084:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1783951985.761103:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951985.761106:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951985.761108:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951985.761111:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3695 00000100:00080000:3.0:1783951985.761114:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951985.761118:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951985.761142:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e3480 x1870605465440128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783951985.761179:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951985.761182:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951985.761184:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951985.761188:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3695 00000100:00080000:3.0:1783951985.761190:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951985.761194:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951985.761206:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e1f80 x1870605465440384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951985.761272:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783951985.761285:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465440640:0@lo:400:kworker.0 00000100:00100000:1.0:1783951985.761286:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465439872:0@lo:38:kworker.0 00000100:00100000:2.0:1783951985.761329:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465440000:0@lo:400:kworker.0 00000100:00100000:0.0:1783951985.761457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951985.761514:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465440640 00000100:00100000:0.0:1783951985.761521:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465440640 00000100:00100000:0.0:1783951985.761562:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:0.0:1783951985.761570:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465440640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951985.761637:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465440640:12345-0@lo:400:kworker.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951985.761644:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:0.0:1783951985.761680:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465440640:0@lo:400:kworker.0 00000100:00080000:3.0:1783951985.765100:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951985.765110:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951985.765113:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951985.765130:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3695 00000100:00080000:3.0:1783951985.765135:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951985.765142:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951985.765205:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e3b80 x1870605465440768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951985.765260:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465440256:0@lo:400:kworker.0 00000100:00100000:3.0:1783951985.765324:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951985.765370:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783951985.765377:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465440512:0@lo:400:kworker.0 00000100:00100000:3.0:1783951985.765408:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951985.765454:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465440256 00000100:00100000:1.0:1783951985.765459:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951985.765461:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465440256 00000100:00100000:1.0:1783951985.765481:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465440128:0@lo:38:kworker.0 00000100:00100000:1.0:1783951985.765505:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951985.765511:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465439872 00000100:00100000:3.0:1783951985.765514:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465439872 00000100:00100000:1.0:1783951985.765519:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465440384:0@lo:38:kworker.0 00000100:00100000:3.0:1783951985.765528:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465440128 00000100:00100000:3.0:1783951985.765531:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465440128 00000100:00100000:1.0:1783951985.765541:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951985.765546:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1783951985.765554:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465440256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951985.765558:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465440768:0@lo:38:kworker.0 00000100:00100000:1.0:1783951985.765601:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951985.765614:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465440256:12345-0@lo:400:kworker.0 Request processed in 60us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951985.765621:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1783951985.765634:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465440768 00000100:00100000:3.0:1783951985.765637:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465440768 00000100:00100000:3.0:1783951985.765648:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1783951985.765652:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465439872:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951985.765670:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951985.765724:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465439872:12345-0@lo:38:kworker.0 Request processed in 70us (263us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951985.765730:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:3.0:1783951985.765741:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1783951985.765751:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465440128:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951985.765762:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951985.765785:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465440128:12345-0@lo:38:kworker.0 Request processed in 33us (279us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951985.765790:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1783951985.765801:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1783951985.765805:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465440768:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951985.765824:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951985.765847:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465440768:12345-0@lo:38:kworker.0 Request processed in 40us (269us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951985.765853:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1783951985.765870:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465440512 00000100:00100000:3.0:1783951985.765873:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465440512 00000100:00100000:3.0:1783951985.765898:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:3.0:1783951985.765904:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465440512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951985.765934:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465440512:12345-0@lo:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951985.765940:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00080000:3.0:1783951985.765959:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951985.765984:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465440384 00000100:00100000:3.0:1783951985.765987:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465440384 00000100:00100000:3.0:1783951985.766005:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:3.0:1783951985.766009:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465440384:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951985.766019:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951985.766045:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465440384:12345-0@lo:38:kworker.0 Request processed in 34us (503us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951985.766059:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:3.0:1783951985.766097:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465440512:0@lo:400:kworker.0 00000100:00100000:3.0:1783951985.766107:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465440256:0@lo:400:kworker.0 00000100:00080000:1.0:1783951985.766684:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951985.766690:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951985.766693:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465440768:0@lo:38:kworker.0 00000100:00080000:1.0:1783951985.766703:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951985.766706:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951985.766709:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465439872:0@lo:38:kworker.0 00000100:00080000:1.0:1783951985.766717:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951985.766720:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951985.766731:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465440128:0@lo:38:kworker.0 00000100:00080000:1.0:1783951985.766741:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951985.766744:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951985.766747:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465440384:0@lo:38:kworker.0 00000100:00100000:2.0:1783951985.769926:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951985.770042:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465440000 00000100:00100000:3.0:1783951985.770051:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465440000 00000100:00100000:3.0:1783951985.770231:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:3.0:1783951985.770242:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465440000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951985.770311:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465440000:12345-0@lo:400:kworker.0 Request processed in 71us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951985.770318:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00080000:0.0:1783951985.770370:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951985.774693:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465440000:0@lo:400:kworker.0 00010000:00010000:0.0:1783951986.209493:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951987.233516:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951988.259047:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951989.281471:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951989.346074:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951989.346109:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465440896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951989.346256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951989.346401:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465440896 00000100:00100000:1.0:1783951989.346416:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465440896 00000100:00100000:1.0:1783951989.346512:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:1.0:1783951989.346526:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465440896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951989.346572:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951989.346660:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465440896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951989.346669:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00100000:2.0:1783951989.346740:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951989.346752:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465441024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951989.346790:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951989.346824:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465441024 00000100:00100000:1.0:1783951989.346829:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465441024 00000100:00100000:1.0:1783951989.346861:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:1.0:1783951989.346868:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465441024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951989.346888:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951989.346934:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465441024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951989.346941:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:2.0:1783951989.346960:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465441024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783951989.347069:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465440896:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783951989.349467:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783951989.349479:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783951990.254422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951990.254534:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447714688 00000100:00100000:2.0:1783951990.254549:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447714688 00000100:00100000:2.0:1783951990.254659:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1175 00000100:00100000:2.0:1783951990.254669:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447714688:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951990.254749:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447714688:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 83us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951990.254754:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1175 00000100:00080000:0.0:1783951990.254804:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951990.256170:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951990.256215:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951990.256287:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447714560 00000100:00100000:3.0:1783951990.256298:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447714560 00000100:00100000:3.0:1783951990.256348:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1188 00000100:00100000:3.0:1783951990.256357:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447714560:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783951990.256388:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951990.256462:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447714560:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 105us (245us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951990.256470:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1188 00000100:00100000:0.0:1783951990.256551:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447714432 00000100:00100000:0.0:1783951990.256572:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447714432 00000100:00100000:0.0:1783951990.256643:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 0 00000100:00100000:0.0:1783951990.256658:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1870605447714432:12345-192.168.202.48@tcp:250:kworker.0 00010000:00080000:0.0:1783951990.256681:0:89064:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e66faa19-2cbc-412c-8aef-9c55427739f8@192.168.202.48@tcp t0 exp 0000000000000000 cur 3705 last 0 00000020:00000080:0.0:1783951990.256714:0:89064:0:(genops.c:1406:class_connect()) connect: client e66faa19-2cbc-412c-8aef-9c55427739f8, cookie 0x22c73c7857bb4a54 00000100:00080000:0.0:1783951990.256890:0:89064:0:(import.c:65:import_set_state_nolock()) ffff97b0410dc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783951990.256934:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+5:2397:x1870605447714432:12345-192.168.202.48@tcp:250:kworker.0 Request processed in 276us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951990.256942:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 0 00010000:00010000:0.0:1783951990.305096:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951990.881067:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783951980/real 1783951980] req@ffff97b147740700 x1870605465438464/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951990 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951990.881122:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97b147740700 x1870605465438464/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783951990 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951990.881151:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783951990.881182:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783951990.881216:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465438464:0@lo:250:kworker.0 10000000:01000000:0.0:1783951990.882422:0:89059:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1783951990.882453:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb4695 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb469c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.882467:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb4695 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb469c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.882484:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1783951990.882506:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.882519:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb4695 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb469c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.882546:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86ba00/0x22c73c7857bb45fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4602 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.882552:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86ba00/0x22c73c7857bb45fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4602 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.882557:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951990.882642:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.882650:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86ba00/0x22c73c7857bb45fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4602 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.882665:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86aa00/0x22c73c7857bb4617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb461e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.882672:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86aa00/0x22c73c7857bb4617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb461e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.882678:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951990.882687:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.882691:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86aa00/0x22c73c7857bb4617 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb461e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.882706:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86a000/0x22c73c7857bb4641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4648 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.882714:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a000/0x22c73c7857bb4641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4648 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.882719:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951990.882732:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.882737:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86a000/0x22c73c7857bb4641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4648 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.882747:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1444ff400/0x22c73c7857bb464f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4656 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.882753:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1444ff400/0x22c73c7857bb464f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4656 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.882770:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951990.882785:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.882790:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1444ff400/0x22c73c7857bb464f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4656 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.882800:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb466b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4672 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.882807:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb466b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4672 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.882812:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951990.882817:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.882821:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb466b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4672 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.882832:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1444ffe00/0x22c73c7857bb4679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4680 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.882840:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1444ffe00/0x22c73c7857bb4679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4680 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.882845:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951990.882849:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.882852:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1444ffe00/0x22c73c7857bb4679 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4680 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.882863:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbc000/0x22c73c7857bb46a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb46aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.882879:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbc000/0x22c73c7857bb46a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb46aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.882885:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951990.882889:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.882893:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbc000/0x22c73c7857bb46a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb46aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.882907:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb4609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4610 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.882913:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb4609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4610 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.882918:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951990.882922:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.882925:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb4609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4610 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.882950:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb4625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb462c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.882957:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb4625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb462c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.882963:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1783951990.882968:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.882976:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb4625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb462c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.883000:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb4633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb463a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.883007:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb4633 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb463a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.883012:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951990.883022:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.883028:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb4633 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb463a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.883039:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb465d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4664 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.883045:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb465d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4664 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.883050:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951990.883065:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.883068:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb465d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4664 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951990.883077:0:89059:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1444ff600/0x22c73c7857bb4687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb468e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783951990.883083:0:89059:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1444ff600/0x22c73c7857bb4687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb468e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951990.883087:0:89059:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783951990.883097:0:89059:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783951990.883101:0:89059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1444ff600/0x22c73c7857bb4687 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb468e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783951990.883135:0:89059:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 71, was 0): DISCONN 00000100:00080000:0.0:1783951990.883143:0:89059:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951990.883152:0:89059:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3695 00000100:00080000:0.0:1783951990.883159:0:89059:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783951990.883167:0:89059:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951990.883210:0:89059:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd4e680 x1870605465441152/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951990.883242:0:89059:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1783951990.883322:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465441152:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783951990.883427:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783951990.883437:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951990.883445:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783951990.883459:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951990.883464:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951990.883467:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951990.883474:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3700 00000100:00080000:3.0:1783951990.883478:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951990.883484:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951990.883511:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e1f80 x1870605465441280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951990.883560:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465441152 00000100:00080000:3.0:1783951990.883565:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951990.883568:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951990.883570:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783951990.883570:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465441152 00000100:00080000:3.0:1783951990.883574:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3700 00000100:00080000:3.0:1783951990.883577:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951990.883580:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951990.883612:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e1c00 x1870605465441536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951990.883631:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783951990.883640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783951990.883640:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3641:x1870605465441152:12345-0@lo:250:mount.lustre.0 00000100:00080000:3.0:1783951990.883644:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951990.883646:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951990.883649:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3700 00000100:00080000:3.0:1783951990.883651:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783951990.883654:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783951990.883666:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e3800 x1870605465441792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:2.0:1783951990.883685:0:89066:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo t0 exp 0000000000000000 cur 3705 last 0 00000100:00080000:3.0:1783951990.883707:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783951990.883712:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783951990.883714:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783951990.883718:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3700 00000100:00080000:3.0:1783951990.883721:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000020:00000080:2.0:1783951990.883722:0:89066:0:(genops.c:1406:class_connect()) connect: client 75da5dc4-aa7e-42cf-a965-1b5f01232c6f, cookie 0x22c73c7857bb4a5b 00000100:00080000:3.0:1783951990.883726:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951990.883742:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465441280:0@lo:38:kworker.0 00000100:00100000:3.0:1783951990.883745:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049d74000 x1870605465442176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783951990.883815:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465441408:0@lo:400:kworker.0 00000100:00100000:1.0:1783951990.883829:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951990.883887:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951990.883896:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465441536:0@lo:38:kworker.0 00000100:00080000:2.0:1783951990.883928:0:89066:0:(import.c:65:import_set_state_nolock()) ffff97b146940000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951990.883935:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783951990.883944:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04796e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465442048:0@lo:400:kworker.0 00000100:00100000:1.0:1783951990.883951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951990.884265:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465441280 00000100:00100000:0.0:1783951990.884271:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465441280 00000100:00100000:0.0:1783951990.884296:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465441408 00000100:00100000:0.0:1783951990.884298:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465441408 00000100:00100000:0.0:1783951990.884332:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465441536 00000100:00100000:0.0:1783951990.884334:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465441536 00000100:00100000:0.0:1783951990.884348:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1783951990.884356:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465441408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951990.885121:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951990.885135:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:3641:x1870605465441152:12345-0@lo:250:mount.lustre.0 Request processed in 1494us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951990.885146:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783951990.885185:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465441664:0@lo:400:kworker.0 00000100:00100000:2.0:1783951990.885186:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1783951990.885192:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465441280:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783951990.885213:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783951990.885234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951990.885245:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465441280:12345-0@lo:38:kworker.0 Request processed in 52us (1442us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783951990.885249:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783951990.885251:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1783951990.885257:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465441920:0@lo:400:kworker.0 00000100:00100000:2.0:1783951990.885271:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465441664 00000100:00100000:2.0:1783951990.885277:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465441664 00000100:00100000:3.0:1783951990.885285:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951990.885309:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1783951990.885316:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465441664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951990.885329:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465441792:0@lo:38:kworker.0 00000100:00100000:3.0:1783951990.885342:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1783951990.885352:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465441536:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783951990.885364:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783951990.885497:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465441664:12345-0@lo:400:kworker.0 Request processed in 182us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951990.885505:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1783951990.885552:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465441664:0@lo:400:kworker.0 00000100:00100000:1.0:1783951990.885781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951990.885904:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465441792 00000100:00100000:2.0:1783951990.885925:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465441792 00000100:00100000:2.0:1783951990.885958:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:2.0:1783951990.885964:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465441792:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783951990.885975:0:3641:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.148@tcp: committing for last_committed 0 gen 26 00010000:00020000:2.0:1783951990.885979:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1783951990.885992:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.148@tcp: connect to target with instance 0 00000100:00080000:1.0:1783951990.886007:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783951990.886013:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783951990.886020:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783951990.886023:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00100000:2.0:1783951990.886031:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465441792:12345-0@lo:38:kworker.0 Request processed in 63us (249us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951990.886040:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00080000:1.0:1783951990.886066:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783951990.886073:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465441408:12345-0@lo:400:kworker.0 Request processed in 1711us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951990.886084:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1783951990.886096:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465441152:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1783951990.886131:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951990.886152:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465441408:0@lo:400:kworker.0 00000100:00100000:0.0:1783951990.886152:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465442048 00000100:00100000:1.0:1783951990.886153:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465442176:0@lo:38:kworker.0 00000100:00100000:0.0:1783951990.886160:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465442048 00000100:00100000:0.0:1783951990.886200:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465441920 00000100:00100000:0.0:1783951990.886204:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465441920 00000100:00100000:0.0:1783951990.886228:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:0.0:1783951990.886241:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465442048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951990.886280:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465442048:12345-0@lo:400:kworker.0 Request processed in 40us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951990.886286:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:0.0:1783951990.886302:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:0.0:1783951990.886307:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465441920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951990.886354:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465441920:12345-0@lo:400:kworker.0 Request processed in 47us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951990.886362:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:1.0:1783951990.886373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783951990.886411:0:86521:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.148@tcp 10000000:01000000:0.0:1783951990.886431:0:86521:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1783951990.886435:0:86521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783951990.886437:0:86521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783951990.886438:0:86521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951990.886440:0:86521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951990.886441:0:86521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951990.886442:0:86521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951990.886444:0:86521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951990.886446:0:86521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951990.886447:0:86521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783951990.886488:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465441920:0@lo:400:kworker.0 00000100:00100000:2.0:1783951990.886800:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465442176 00000100:00100000:2.0:1783951990.886806:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465442176 00000100:00080000:1.0:1783951990.886826:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951990.886834:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783951990.886840:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1783951990.886845:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465441280:0@lo:38:kworker.0 00000100:00100000:2.0:1783951990.886858:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465442176:12345-0@lo:38:kworker.0 00000020:01000000:0.0:1783951990.886862:0:86521:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00010000:00020000:2.0:1783951990.886876:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1783951990.886876:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 10000000:01000000:0.0:1783951990.886879:0:86521:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1783951990.886888:0:86521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000100:00080000:1.0:1783951990.886892:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000020:01000004:0.0:1783951990.886893:0:86521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783951990.886899:0:86521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951990.886901:0:86521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:1.0:1783951990.886906:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465441792:0@lo:38:kworker.0 00000020:01000004:0.0:1783951990.886907:0:86521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951990.886912:0:86521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951990.886918:0:86521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951990.886922:0:86521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951990.886924:0:86521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783951990.886937:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465442176:12345-0@lo:38:kworker.0 Request processed in 83us (566us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951990.886947:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00080000:1.0:1783951990.886957:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951990.886962:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783951990.886967:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465442176:0@lo:38:kworker.0 00000100:00100000:2.0:1783951990.886985:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951990.887000:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465442304:0@lo:253:kworker.0 00000100:00080000:1.0:1783951990.887043:0:89059:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000100:00100000:2.0:1783951990.887053:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1783951990.887061:0:89059:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:2.0:1783951990.887129:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465442304 00000020:01000004:1.0:1783951990.887134:0:89059:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000100:00100000:2.0:1783951990.887135:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465442304 10000000:01000000:1.0:1783951990.887143:0:89059:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00100000:2.0:1783951990.887173:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783951990.887181:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:3642:x1870605465442304:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783951990.887214:0:89065:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000040:01000000:1.0:1783951990.887283:0:89059:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783951990.887319:0:89059:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783951990.887324:0:89059:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783951990.887325:0:89059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783951990.887327:0:89059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951990.887328:0:89059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951990.887329:0:89059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951990.887330:0:89059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951990.887332:0:89059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783951990.887333:0:89059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783951990.887335:0:89059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951990.887336:0:89059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783951990.887339:0:89059:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783951990.887341:0:89059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783951990.887342:0:89059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783951990.887343:0:89059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951990.887344:0:89059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951990.887345:0:89059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951990.887346:0:89059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951990.887347:0:89059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783951990.887348:0:89059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783951990.887349:0:89059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951990.887350:0:89059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783951990.887374:0:89059:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783951990.887403:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465442432:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783951990.887456:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951990.887477:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434f6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951990.887522:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04796e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465442048:0@lo:400:kworker.0 00000020:01000000:0.0:1783951990.887566:0:86521:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1783951990.887572:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465442432 10000000:01000000:0.0:1783951990.887575:0:86521:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000100:00100000:1.0:1783951990.887580:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465442432 00000020:01000004:0.0:1783951990.887618:0:86521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783951990.887620:0:86521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783951990.887622:0:86521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951990.887624:0:86521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951990.887625:0:86521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951990.887627:0:86521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951990.887629:0:86521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951990.887631:0:86521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951990.887633:0:86521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1783951990.887656:0:86521:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1783951990.887672:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783951990.887684:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:89059:x1870605465442432:12345-0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783951990.887694:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465442560:0@lo:253:kworker.0 00000100:00100000:0.0:1783951990.887752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951990.887812:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951990.887821:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465442688:0@lo:253:kworker.0 00000100:00100000:0.0:1783951990.887853:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951990.887875:0:89066:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1783951990.887886:0:89066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1783951990.888164:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465442560 00000100:00100000:2.0:1783951990.888170:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465442560 00000100:00100000:2.0:1783951990.888195:0:89066:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1783951990.888202:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465442688 00000100:00100000:2.0:1783951990.888204:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465442688 00000100:00100000:0.0:1783951990.888338:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783951990.888346:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3644:x1870605465442560:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783951990.888389:0:89070:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:1.0:1783951990.888612:0:89069:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783951990.888758:0:89065:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 111 00000100:00100000:2.0:1783951990.894024:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465441536:12345-0@lo:38:kworker.0 Request processed in 8662us (10070us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783951990.894041:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00080000:3.0:1783951990.894107:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951990.894133:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783951990.894162:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465441536:0@lo:38:kworker.0 20000000:01000000:1.0:1783951990.895094:0:89071:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783951990.895101:0:89071:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1783951990.895104:0:89071:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783951990.895107:0:89071:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783951990.895339:0:89071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783951990.908976:0:89065:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783951990.909000:0:89065:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783951990.910446:0:89064:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783951990.910484:0:89064:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783951990.910492:0:89064:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1783951990.910503:0:89064:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783951990.915707:0:89065:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783951990.915724:0:89065:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783951990.915854:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:89059:x1870605465442432:12345-0@lo:253:mount.lustre.0 Request processed in 28159us (28384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951990.915880:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783951990.915943:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 20000000:01000000:1.0:1783951990.915946:0:89069:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783951990.915954:0:89069:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1783951990.915964:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:3644:x1870605465442688:12345-0@lo:253:kworker.0 00010000:00010000:1.0:1783951990.915988:0:89069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.916007:0:89069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783951990.916011:0:89064:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783951990.916024:0:89069:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071916s 00010000:00010000:1.0:1783951990.916030:0:89069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783951990.916037:0:89064:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1783951990.916038:0:89069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.916052:0:89069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.916059:0:89069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.916066:0:89069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951990.916071:0:89069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.916079:0:89069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.916123:0:89069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.916132:0:89069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.916139:0:89069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762af000/0x22c73c7857bb4a62 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951990.916253:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465442432:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783951990.916271:0:89059:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783951990.916275:0:89059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783951990.916277:0:89059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783951990.916279:0:89059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951990.916280:0:89059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951990.916281:0:89059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951990.916282:0:89059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951990.916284:0:89059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951990.916286:0:89059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783951990.916289:0:89059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951990.916290:0:89059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783951990.916318:0:89059:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b174b31800 from lustre-MDT0000 10000000:01000000:3.0:1783951990.916362:0:89059:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783951990.916366:0:89059:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783951990.916377:0:89059:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97b174b31800 10000000:01000000:3.0:1783951990.916382:0:89059:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783951990.916388:0:89059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97b174b31800 10000000:01000000:3.0:1783951990.916393:0:89059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783951990.916432:0:89059:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b174b31800 from 1 10000000:01000000:3.0:1783951990.916436:0:89059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783951990.916482:0:89059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951990.916493:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:3642:x1870605465442304:12345-0@lo:253:kworker.0 Request processed in 29303us (29432us total) trans 0 rc 0/0 00010000:00010000:3.0:1783951990.916499:0:89059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951990.916510:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783951990.916517:0:89059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951990.916548:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465442816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783951990.916648:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1783951990.916657:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783951990.916662:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783951990.916664:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783951990.916666:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783951990.916667:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783951990.916669:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783951990.916671:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783951990.916674:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783951990.916676:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783951990.916681:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465442304:0@lo:253:kworker.0 00000100:00100000:3.0:1783951990.916692:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1748af480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951990.916985:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465442816 00000100:00100000:2.0:1783951990.916993:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465442816 00000100:00100000:2.0:1783951990.917030:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783951990.917039:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:89059:x1870605465442816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951990.917054:0:89066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951990.917073:0:89066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216b400/0x22c73c7857bb4a70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4a69 expref: -99 pid: 89066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951990.917095:0:89066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216b400/0x22c73c7857bb4a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4a69 expref: 8 pid: 89066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951990.917105:0:89066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216b400/0x22c73c7857bb4a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4a69 expref: 8 pid: 89066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951990.917137:0:89066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b400, rc 0) 00000100:00100000:2.0:1783951990.917196:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:89059:x1870605465442816:12345-0@lo:101:mount.lustre.0 Request processed in 158us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951990.917203:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783951990.917533:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465442816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951990.917556:0:89059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951990.917568:0:89059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951990.917619:0:89059:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783951990.917637:0:89059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951990.917647:0:89059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951990.917667:0:89059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783951990.917682:0:89059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783951990.917689:0:89059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97b174b31800 10000000:01000000:3.0:1783951990.917692:0:89059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783951990.917695:0:89059:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783951990.917697:0:89059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783951990.917725:0:89059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951990.917733:0:89059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951990.917741:0:89059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951990.917760:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465442944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783951990.917802:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951990.917837:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1748af480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951990.920447:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465442944 00000100:00100000:2.0:1783951990.920464:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465442944 00000100:00100000:2.0:1783951990.920528:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783951990.920538:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:89059:x1870605465442944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951990.920555:0:89065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951990.920574:0:89065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216a200/0x22c73c7857bb4a7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4a77 expref: -99 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951990.920619:0:89065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216a200/0x22c73c7857bb4a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4a77 expref: 9 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951990.920631:0:89065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216a200/0x22c73c7857bb4a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4a77 expref: 9 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951990.920640:0:89065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a200, rc 0) 00000100:00100000:2.0:1783951990.920732:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:89059:x1870605465442944:12345-0@lo:101:mount.lustre.0 Request processed in 195us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951990.920739:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783951990.920976:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465442944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951990.920994:0:89059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951990.921003:0:89059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951990.921078:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465443072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951990.921143:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951990.921179:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1748af480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951990.921239:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465443072 00000100:00100000:0.0:1783951990.921244:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465443072 00000100:00100000:0.0:1783951990.921277:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783951990.921284:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:89059:x1870605465443072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951990.921444:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89059:x1870605465443072:12345-0@lo:501:mount.lustre.0 Request processed in 160us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951990.921451:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783951990.922704:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465443072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951990.922772:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465443200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951990.922840:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951990.922879:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1748af480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951990.922953:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465443200 00000100:00100000:2.0:1783951990.922960:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465443200 00000100:00100000:2.0:1783951990.923007:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783951990.923016:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89059:x1870605465443200:12345-0@lo:503:mount.lustre.0 20000000:01000000:3.0:1783951990.923899:0:89064:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783951990.923918:0:89064:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1783951990.923930:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89059:x1870605465443200:12345-0@lo:503:mount.lustre.0 Request processed in 913us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951990.923944:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783951990.924012:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465443200:0@lo:503:mount.lustre.0 20000000:01000000:0.0:1783951990.924197:0:89070:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783951990.924383:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:3644:x1870605465442688:12345-0@lo:253:kworker.0 Request processed in 8430us (36528us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951990.924390:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:0.0:1783951990.924735:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783951990.924738:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783951990.924739:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951990.924741:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951990.924742:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951990.924750:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783951990.924751:0:3644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783951990.924753:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951990.924755:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783951990.924759:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465442688:0@lo:253:kworker.0 20000000:01000000:1.0:1783951990.931089:0:89069:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783951990.931099:0:89069:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783951990.931138:0:89069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.931156:0:89069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783951990.931165:0:89069:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071916s 00010000:00010000:1.0:1783951990.931170:0:89069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.931178:0:89069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.931195:0:89069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.931202:0:89069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.931207:0:89069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afe00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951990.931212:0:89069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.931220:0:89069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.931233:0:89069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.931240:0:89069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.931246:0:89069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762afe00/0x22c73c7857bb4a85 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951990.931537:0:89072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89072:1870605465443328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951990.931646:0:89072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951990.931687:0:89072:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b15253bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951990.931959:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465443328 00000100:00100000:0.0:1783951990.931967:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465443328 00000100:00100000:0.0:1783951990.932013:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783951990.932023:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:89072:x1870605465443328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951990.933312:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:89072:x1870605465443328:12345-0@lo:502:llog_process_th.0 Request processed in 1284us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951990.933324:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783951990.933347:0:89072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89072:1870605465443328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783951990.933388:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951990.933408:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951990.933410:0:89072:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783951990.933416:0:89072:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783951990.933419:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951990.933433:0:89072:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97b0489b99c0) 00000020:00000080:3.0:1783951990.933456:0:89072:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1783951990.933462:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783951990.933552:0:89072:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783951990.933559:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb4a93 20000000:01000000:0.0:1783951990.933681:0:89070:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783951990.933695:0:89070:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000020:00000080:3.0:1783951990.933802:0:89072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783951990.933807:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783951990.933810:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951990.933812:0:89072:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783951990.933833:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783951990.933837:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783951990.933838:0:89072:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783951990.933842:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783951990.933848:0:89072:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97b0489bb380) 00000020:00000080:3.0:1783951990.933861:0:89072:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1783951990.933865:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783951990.933867:0:89072:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783951990.933870:0:89072:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783951990.933876:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783951990.933937:0:89072:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b174b31800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783951990.933949:0:89072:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97b0489bcd40) 00000020:00000080:3.0:1783951990.933959:0:89072:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000100:00100000:0.0:1783951990.933967:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3644:x1870605465442560:12345-0@lo:253:kworker.0 Request processed in 45621us (46215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951990.933975:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1783951990.934007:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783951990.934010:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000004:01000000:3.0:1783951990.934011:0:89072:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:01000004:0.0:1783951990.934011:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783951990.934012:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783951990.934014:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783951990.934015:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:00000080:3.0:1783951990.934016:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4aa8 00000020:01000004:0.0:1783951990.934016:0:3644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783951990.934019:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783951990.934020:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783951990.934023:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465442560:0@lo:253:kworker.0 20000000:01000000:1.0:1783951990.934087:0:89069:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783951990.934091:0:89069:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:00000080:3.0:1783951990.934103:0:89072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00010000:00010000:1.0:1783951990.934119:0:89069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:01000000:3.0:1783951990.934120:0:89072:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783951990.934125:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x22c73c7857bb4ab6 00080000:01000000:3.0:1783951990.934129:0:89072:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783951990.934132:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb4abd 00010000:00010000:1.0:1783951990.934134:0:89069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783951990.934144:0:89069:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071916s 00010000:00010000:1.0:1783951990.934154:0:89069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.934160:0:89069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.934167:0:89069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.934173:0:89069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.934179:0:89069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951990.934184:0:89069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.934192:0:89069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.934204:0:89069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.934211:0:89069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951990.934217:0:89069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762ae400/0x22c73c7857bb4aaf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951991.046486:0:89072:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1783951991.047329:0:89072:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 458183b2-4c6d-478c-9fed-a955779e6611 idx: 0 lr: 103079215113 srv lr: 107374182400 lx: 0 gen 23 00000001:00080000:1.0:1783951991.047374:0:89072:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 22 00000001:00000004:1.0:1783951991.047407:0:89072:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:1.0:1783951991.047515:0:89072:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1783951991.048658:0:89072:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b1434f6000: xid 1870605447707136, transno 107374182405, client gen 23, slot idx 0 00000001:00080000:1.0:1783951991.048682:0:89072:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b1500f1e40: xid 1870605447707392, transno 107374182406, client gen 23, slot idx 1 00000020:00000080:1.0:1783951991.052730:0:89072:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97b1449b4d40) 00000020:00000080:1.0:1783951991.052758:0:89072:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1783951991.052865:0:89072:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783951991.052873:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb4ad9 00000020:00000080:2.0:1783951991.056503:0:89072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783951991.073462:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x22c73c7857bb4ae0 00000020:00000080:2.0:1783951991.074191:0:89072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783951991.074204:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951991.074211:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951991.074213:0:89072:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783951991.074217:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783951991.074221:0:89072:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1783951991.074223:0:89072:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951991.074224:0:89072:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783951991.074225:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783951991.074228:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951991.074229:0:89072:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783951991.074232:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951991.074236:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951991.074237:0:89072:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783951991.074242:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783951991.074288:0:89072:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783951991.074307:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783951991.074310:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951991.074311:0:89072:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783951991.074314:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783951991.074317:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783951991.074318:0:89072:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1783951991.074321:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783951991.074325:0:89072:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:00000080:2.0:1783951991.074349:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783951991.074365:0:89072:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff97b1454599c0) 00000020:00000080:2.0:1783951991.074382:0:89072:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1783951991.074387:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783951991.074446:0:89072:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1783951991.074452:0:89072:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783951991.074466:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb4aee 00010000:00080000:2.0:1783951991.074496:0:89072:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b176be1000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:2.0:1783951991.081554:0:89072:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1783951991.084706:0:89072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951991.084734:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783951991.084771:0:89072:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783951991.084797:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4af5 00000100:00080000:1.0:1783951991.084819:0:89072:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783951991.084825:0:89072:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97b176be1000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951991.084862:0:89072:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b166fb1500 x1870605465443456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951991.084886:0:89072:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1783951991.084937:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951991.084941:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951991.084943:0:89072:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1783951991.084946:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783951991.084949:0:89072:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1783951991.084951:0:89072:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951991.084952:0:89072:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951991.084954:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783951991.084957:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951991.084958:0:89072:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783951991.084960:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783951991.084969:0:89072:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783951991.084973:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951991.084974:0:89072:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783951991.084977:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783951991.084981:0:89072:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:1.0:1783951991.085004:0:89072:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783951991.085006:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951991.085019:0:89072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97b1449b3380) 00000020:00000080:1.0:1783951991.085035:0:89072:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1783951991.085040:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783951991.085100:0:89072:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783951991.085117:0:89072:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783951991.085123:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb4b03 00010000:00080000:1.0:1783951991.085151:0:89072:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b1469d7800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1783951991.085327:0:89072:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:1.0:1783951991.086321:0:89072:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783951991.086346:0:89072:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:0.0:1783951991.086526:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951991.086531:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951991.086534:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951991.086540:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3705 00000100:00080000:0.0:1783951991.086550:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783951991.086555:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951991.086575:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd4e680 x1870605465443712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951991.086610:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951991.086613:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951991.086615:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951991.086618:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3705 00000100:00080000:0.0:1783951991.086620:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783951991.086623:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951991.086647:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd4f100 x1870605465443968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951991.086670:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951991.086673:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951991.086675:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951991.086678:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3705 00000100:00080000:0.0:1783951991.086680:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783951991.086683:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951991.086696:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047acea00 x1870605465444224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951991.086884:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783951991.086888:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783951991.086890:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783951991.086894:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3705 00000100:00080000:0.0:1783951991.086903:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783951991.086907:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951991.086921:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de96a00 x1870605465444608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783951991.086959:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465444096:0@lo:400:kworker.0 00000100:00100000:0.0:1783951991.087023:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.087057:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783951991.087063:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465444352:0@lo:400:kworker.0 00000100:00100000:0.0:1783951991.087089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.087152:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465444096 00000100:00100000:0.0:1783951991.087159:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465444096 00000100:00100000:0.0:1783951991.087203:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1783951991.087214:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465444096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951991.087267:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465444096:12345-0@lo:400:kworker.0 Request processed in 55us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951991.087275:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1783951991.087316:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465444096:0@lo:400:kworker.0 00000100:00100000:0.0:1783951991.087364:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465443584:0@lo:400:kworker.0 00000100:00100000:1.0:1783951991.087491:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465443840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951991.087522:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783951991.087610:0:89072:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:0.0:1783951991.088334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.088369:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465444480:0@lo:400:kworker.0 00000100:00100000:3.0:1783951991.088515:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465443456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783951991.088563:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.088582:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465443712:0@lo:38:kworker.0 00000100:00100000:3.0:1783951991.088619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.088648:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465443968:0@lo:38:kworker.0 00000100:00100000:3.0:1783951991.088672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.088686:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465444224:0@lo:38:kworker.0 00000100:00100000:3.0:1783951991.088706:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.088735:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465444608:0@lo:38:kworker.0 00000100:00100000:3.0:1783951991.088756:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.088801:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465443584 00000100:00100000:0.0:1783951991.089000:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.089069:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465443584 00000100:00100000:3.0:1783951991.089126:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951991.089135:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3642:x1870605465443584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951991.089185:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3642:x1870605465443584:12345-0@lo:400:kworker.0 Request processed in 51us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.089192:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783951991.089226:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465443456 00000100:00100000:3.0:1783951991.089230:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465443456 00000100:00100000:3.0:1783951991.089247:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465444224 00000100:00100000:3.0:1783951991.089250:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465444224 00000100:00100000:3.0:1783951991.089266:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:3.0:1783951991.089270:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465443456:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783951991.089294:0:8444:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3706 last 0 00000020:00000080:3.0:1783951991.089327:0:8444:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4b0a 00000004:00100000:3.0:1783951991.089343:0:8444:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783951991.089872:0:8444:0:(import.c:65:import_set_state_nolock()) ffff97b1445c2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951991.089922:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465443456:12345-0@lo:38:llog_process_th.0 Request processed in 651us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.089929:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:3.0:1783951991.089945:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:3.0:1783951991.089949:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465444224:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783951991.089980:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465444224:12345-0@lo:38:kworker.0 Request processed in 30us (1272us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783951991.089985:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:3.0:1783951991.090007:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465444352 00000100:00100000:3.0:1783951991.090011:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465444352 00000100:00100000:3.0:1783951991.090051:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465444480 00000100:00100000:3.0:1783951991.090054:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465444480 00000100:00100000:3.0:1783951991.090077:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:3.0:1783951991.090083:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465444352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951991.090131:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465444352:12345-0@lo:400:kworker.0 Request processed in 49us (3042us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.090137:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:3.0:1783951991.090148:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1783951991.090153:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465444480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951991.090177:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465444480:12345-0@lo:400:kworker.0 Request processed in 25us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.090183:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00080000:3.0:1783951991.090201:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951991.090204:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951991.090234:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465444352:0@lo:400:kworker.0 00000100:00100000:3.0:1783951991.090264:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465443584:0@lo:400:kworker.0 00000100:00100000:3.0:1783951991.090275:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465444480:0@lo:400:kworker.0 00000100:00100000:3.0:1783951991.090317:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465443840 00000100:00100000:3.0:1783951991.090321:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465443840 00000100:00100000:3.0:1783951991.090350:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465443712 00000100:00100000:3.0:1783951991.090353:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465443712 00000100:00100000:3.0:1783951991.090361:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465443968 00000100:00100000:3.0:1783951991.090362:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465443968 00000100:00100000:3.0:1783951991.090369:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465444608 00000100:00100000:3.0:1783951991.090371:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465444608 00000100:00100000:3.0:1783951991.090381:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1783951991.090387:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04796e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465443840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951991.090429:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04796e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465443840:12345-0@lo:400:kworker.0 Request processed in 43us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.090435:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1783951991.090448:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1783951991.090452:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465443712:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783951991.090481:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465443712:12345-0@lo:38:kworker.0 Request processed in 28us (1862us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783951991.090487:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1783951991.090497:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:3.0:1783951991.090501:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465443968:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783951991.090528:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465443968:12345-0@lo:38:kworker.0 Request processed in 26us (1856us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783951991.090534:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:3.0:1783951991.090544:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:3.0:1783951991.090548:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465444608:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783951991.090575:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465444608:12345-0@lo:38:kworker.0 Request processed in 26us (1818us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783951991.090580:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1783951991.090879:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465443840:0@lo:400:kworker.0 00000100:00100000:1.0:1783951991.090913:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783951991.090921:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1783951991.090928:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783951991.090933:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783951991.090935:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b176be1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783951991.090947:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465443456:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783951991.090958:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951991.090968:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951991.090972:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465443712:0@lo:38:kworker.0 00000100:00080000:1.0:1783951991.090985:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951991.090988:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951991.090991:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465443968:0@lo:38:kworker.0 00000100:00080000:1.0:1783951991.090999:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951991.091002:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951991.091005:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465444224:0@lo:38:kworker.0 00000100:00080000:1.0:1783951991.091013:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783951991.091016:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783951991.091018:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465444608:0@lo:38:kworker.0 00000100:00100000:1.0:1783951991.091083:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465444736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783951991.091130:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783951991.092160:0:89072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951991.092193:0:89072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:0.0:1783951991.092329:0:89072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000100:00100000:3.0:1783951991.095084:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465444736 00000100:00100000:3.0:1783951991.095101:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465444736 00000100:00100000:3.0:1783951991.095187:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:3.0:1783951991.095198:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465444736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951991.095239:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951991.095323:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465444736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (4193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.095330:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:3.0:1783951991.095394:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465444736:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1783951991.095706:0:89078:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:1.0:1783951991.095712:0:89078:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783951991.096213:0:89078:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:1.0:1783951991.096235:0:89078:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783951991.096369:0:89078:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:1.0:1783951991.096372:0:89078:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783951991.105151:0:89072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783951991.105168:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783951991.105213:0:89072:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783951991.105238:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4b11 00000100:00080000:1.0:1783951991.105249:0:89072:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783951991.105255:0:89072:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b1469d7800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783951991.105298:0:89072:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1756e1180 x1870605465444864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783951991.105330:0:89072:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783951991.105391:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783951991.105395:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951991.105397:0:89072:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783951991.105401:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783951991.105404:0:89072:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1783951991.105406:0:89072:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951991.105407:0:89072:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783951991.105408:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783951991.105410:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951991.105411:0:89072:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783951991.105414:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783951991.105418:0:89072:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783951991.105422:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783951991.105423:0:89072:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783951991.105426:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783951991.105429:0:89072:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:1.0:1783951991.105456:0:89072:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783951991.105458:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783951991.105470:0:89072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97b167c919c0) 00000020:00000080:1.0:1783951991.105485:0:89072:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783951991.105489:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783951991.105552:0:89072:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783951991.105559:0:89072:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783951991.105566:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb4b1f 00010000:00080000:1.0:1783951991.105630:0:89072:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b17407c800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1783951991.105833:0:89072:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1783951991.105909:0:89072:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783951991.105923:0:89072:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1783951991.106529:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465444864:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783951991.106643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951991.107700:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465444864 00000100:00100000:1.0:1783951991.107989:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465444864 00000100:00100000:1.0:1783951991.108032:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913 00000100:00100000:1.0:1783951991.108040:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3641:x1870605465444864:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783951991.108077:0:26199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3706 last 0 00000040:00080000:0.0:1783951991.108435:0:89072:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000020:00000080:1.0:1783951991.109016:0:26199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4b26 00002000:00100000:3.0:1783951991.109668:0:26199:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97b17407c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783951991.109675:0:26199:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783951991.109678:0:26199:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783951991.109754:0:26199:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783951991.109792:0:26199:0:(import.c:65:import_set_state_nolock()) ffff97b174695000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951991.110025:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465444864:12345-0@lo:8:llog_process_th.0 Request processed in 1983us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.110035:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913 00000100:00100000:3.0:1783951991.110095:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783951991.110104:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783951991.110125:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783951991.110130:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783951991.110133:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1469d7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783951991.110149:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783951991.110155:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465444864:0@lo:8:llog_process_th.0 00000040:00080000:0.0:1783951991.110375:0:89072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783951991.110405:0:89072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:0.0:1783951991.110531:0:89072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000004:00080000:1.0:1783951991.110924:0:89078:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783951991.110964:0:89078:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3706053375614ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783951991.110970:0:89078:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783951991.111896:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465444992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951991.111963:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.112020:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465444992 00000100:00100000:3.0:1783951991.112027:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465444992 00000100:00100000:3.0:1783951991.112076:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1783951991.112084:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465444992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951991.112124:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951991.112166:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465444992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.112174:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00080000:3.0:1783951991.112203:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951991.112237:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465444992:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1783951991.115192:0:89080:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:2.0:1783951991.115203:0:89080:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1783951991.115406:0:89080:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:2.0:1783951991.115430:0:89080:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1783951991.115570:0:89080:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:2.0:1783951991.115573:0:89080:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1783951991.116400:0:89060:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:0.0:1783951991.125209:0:89072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783951991.125224:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783951991.125269:0:89072:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783951991.125294:0:89072:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4b2d 00000100:00080000:0.0:1783951991.125306:0:89072:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783951991.125312:0:89072:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97b17407c800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951991.125348:0:89072:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de95180 x1870605465445120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951991.125377:0:89072:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783951991.125436:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951991.125441:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951991.125443:0:89072:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783951991.125446:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951991.125449:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951991.125450:0:89072:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783951991.125453:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783951991.125455:0:89072:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783951991.125458:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951991.125460:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951991.125461:0:89072:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783951991.125464:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951991.125466:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951991.125468:0:89072:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783951991.125472:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783951991.125506:0:89072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89072:1870605465445248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951991.125645:0:89072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.125685:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465445248 00000100:00100000:0.0:1783951991.125692:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465445248 00000100:00100000:3.0:1783951991.127177:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465445120:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783951991.127245:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951991.127351:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465445120 00000100:00100000:1.0:1783951991.127359:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465445120 00000100:00100000:1.0:1783951991.127397:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4914 00000100:00100000:1.0:1783951991.127405:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3641:x1870605465445120:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783951991.127437:0:26206:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3706 last 0 00000020:00000080:1.0:1783951991.127465:0:26206:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb4b34 00002000:00100000:1.0:1783951991.127479:0:26206:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97b17407d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783951991.127483:0:26206:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783951991.127486:0:26206:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783951991.127577:0:26206:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783951991.127625:0:26206:0:(import.c:65:import_set_state_nolock()) ffff97b17407b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783951991.127675:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465445120:12345-0@lo:8:llog_process_th.0 Request processed in 269us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951991.127682:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4914 00000100:00100000:0.0:1783951991.127995:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951991.128007:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:89072:x1870605465445248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951991.128145:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:89072:x1870605465445248:12345-0@lo:502:llog_process_th.0 Request processed in 141us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951991.128152:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783951991.128194:0:89072:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141323900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951991.128217:0:89072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89072:1870605465445248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951991.128249:0:89072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951991.128256:0:89072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951991.128257:0:89072:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783951991.128262:0:89072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783951991.128347:0:89059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783951991.128369:0:89059:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783951991.128385:0:89059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.128397:0:89059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951991.128406:0:89059:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b174b31800 from 1 10000000:01000000:0.0:1783951991.128408:0:89059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783951991.128440:0:89059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.128448:0:89059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.128465:0:89059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951991.128485:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465445376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951991.128519:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.128536:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141323900 going to sleep for 11 seconds 00000100:00100000:0.0:1783951991.128577:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465445376 00000100:00100000:0.0:1783951991.128582:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465445376 00000100:00100000:0.0:1783951991.128635:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783951991.128643:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:89059:x1870605465445376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951991.128652:0:89064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951991.128665:0:89064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d22000/0x22c73c7857bb4b42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4b3b expref: -99 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.128685:0:89064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d22000/0x22c73c7857bb4b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4b3b expref: 9 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.128696:0:89064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d22000/0x22c73c7857bb4b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4b3b expref: 9 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.128703:0:89064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22000, rc 0) 00000100:00100000:3.0:1783951991.128851:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783951991.128860:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783951991.128867:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783951991.128872:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783951991.128876:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b17407c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783951991.128890:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783951991.128895:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465445120:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783951991.128945:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783951991.128955:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465445504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951991.128983:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.129012:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465445504 00000100:00100000:3.0:1783951991.129016:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465445504 00000100:00100000:3.0:1783951991.129051:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:3.0:1783951991.129058:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465445504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951991.129079:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951991.129127:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465445504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.129134:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00080000:3.0:1783951991.129152:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951991.129179:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465445504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783951991.131089:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:89059:x1870605465445376:12345-0@lo:101:mount.lustre.0 Request processed in 2440us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951991.131100:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1783951991.131509:0:89080:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783951991.131632:0:89080:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3706074042758ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783951991.131654:0:89080:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1783951991.134445:0:89060:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783951991.138454:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465445376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783951991.138487:0:89059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951991.138523:0:89059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951991.139403:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465445632:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783951991.139480:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.139536:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141323b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783951991.139698:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465445632 00000100:00100000:2.0:1783951991.139706:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465445632 00000100:00100000:2.0:1783951991.139766:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783951991.139776:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:89059:x1870605465445632:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783951991.139798:0:89066:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783951991.139827:0:89066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783951991.139831:0:89066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783951991.139835:0:89066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783951991.139838:0:89066:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 114 00000100:00100000:2.0:1783951991.139928:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:89059:x1870605465445632:12345-0@lo:256:mount.lustre.0 Request processed in 154us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.139937:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783951991.140293:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465445632:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783951991.141379:0:89059:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783951991.141451:0:89059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.141463:0:89059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951991.141473:0:89059:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b174b31800 from 1 10000000:01000000:0.0:1783951991.141476:0:89059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951991.141513:0:89059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.141522:0:89059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.141530:0:89059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951991.141566:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465445760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783951991.141647:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.141675:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141323b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951991.141988:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465445760 00000100:00100000:3.0:1783951991.141994:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465445760 00000100:00100000:3.0:1783951991.142040:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783951991.142049:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:89059:x1870605465445760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783951991.142062:0:89064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951991.142077:0:89064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70200/0x22c73c7857bb4b50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4b49 expref: -99 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951991.142100:0:89064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70200/0x22c73c7857bb4b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4b49 expref: 10 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951991.142120:0:89064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70200/0x22c73c7857bb4b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4b49 expref: 10 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951991.142127:0:89064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70200, rc 0) 00000100:00100000:3.0:1783951991.142178:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89059:x1870605465445760:12345-0@lo:101:mount.lustre.0 Request processed in 130us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.142184:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783951991.142266:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465445760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951991.142281:0:89059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.142291:0:89059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951991.142358:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465445888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951991.142399:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951991.142429:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d9480 going to sleep for 11 seconds 00000100:00100000:3.0:1783951991.142475:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465445888 00000100:00100000:3.0:1783951991.142479:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465445888 00000100:00100000:3.0:1783951991.142511:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783951991.142518:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89059:x1870605465445888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783951991.142689:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89059:x1870605465445888:12345-0@lo:501:mount.lustre.0 Request processed in 170us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.142696:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783951991.142968:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465445888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951991.142999:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465446016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951991.143041:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951991.143065:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465446016 00000100:00100000:2.0:1783951991.143069:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465446016 00000100:00100000:2.0:1783951991.143093:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951991.143100:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89059:x1870605465446016:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951991.143189:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89059:x1870605465446016:12345-0@lo:503:mount.lustre.0 Request processed in 89us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.143196:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783951991.143234:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d9480 going to sleep for 11 seconds 00000100:00100000:2.0:1783951991.143246:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465446016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951991.144069:0:89082:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89082:1870605465446144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951991.144128:0:89082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.144156:0:89082:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141323900 going to sleep for 11 seconds 00000100:00100000:2.0:1783951991.144197:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465446144 00000100:00100000:2.0:1783951991.144201:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465446144 00000100:00100000:2.0:1783951991.144234:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783951991.144241:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89082:x1870605465446144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951991.144837:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89082:x1870605465446144:12345-0@lo:502:llog_process_th.0 Request processed in 594us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.144846:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783951991.145006:0:89082:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89082:1870605465446144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951991.145033:0:89082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951991.145048:0:89082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951991.145051:0:89082:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783951991.145058:0:89082:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b174b31800 00000020:00000080:0.0:1783951991.145060:0:89082:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783951991.145069:0:89082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951991.145072:0:89082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951991.145073:0:89082:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783951991.145075:0:89082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783951991.145077:0:89082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951991.145078:0:89082:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783951991.145081:0:89082:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b174b31800 00000020:00000080:0.0:1783951991.145084:0:89082:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783951991.145175:0:89082:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89082:1870605465446272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951991.145212:0:89082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.145239:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465446272 00000100:00100000:0.0:1783951991.145244:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465446272 00000100:00100000:0.0:1783951991.145271:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951991.145277:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89082:x1870605465446272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951991.145354:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89082:x1870605465446272:12345-0@lo:502:llog_process_th.0 Request processed in 76us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951991.145360:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783951991.145397:0:89082:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1530b5540 going to sleep for 11 seconds 00000100:00100000:0.0:1783951991.145409:0:89082:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89082:1870605465446272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783951991.145427:0:89082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783951991.145432:0:89082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783951991.145433:0:89082:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783951991.145437:0:89082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783951991.152363:0:89059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1783951991.152403:0:89059:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783951991.152429:0:89059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.152455:0:89059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951991.152517:0:89059:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783951991.152520:0:89059:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97b174b31800 10000000:01000000:2.0:1783951991.152523:0:89059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97b174b31800 10000000:01000000:2.0:1783951991.152527:0:89059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783951991.152533:0:89059:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174b31800 from 1 10000000:01000000:2.0:1783951991.152535:0:89059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783951991.152584:0:89059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.152615:0:89059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.152625:0:89059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951991.152650:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465446400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783951991.155120:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951991.155189:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951991.155472:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465446400 00000100:00100000:0.0:1783951991.155482:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465446400 00000100:00100000:0.0:1783951991.155554:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783951991.155576:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:89059:x1870605465446400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783951991.155656:0:89070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951991.155674:0:89070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d22200/0x22c73c7857bb4b5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4b57 expref: -99 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.155704:0:89070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d22200/0x22c73c7857bb4b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4b57 expref: 11 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.155989:0:89070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d22200/0x22c73c7857bb4b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4b57 expref: 11 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.155999:0:89070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22200, rc 0) 00000100:00100000:0.0:1783951991.156065:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89059:x1870605465446400:12345-0@lo:101:mount.lustre.0 Request processed in 493us (3349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951991.156073:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783951991.157085:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465446400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783951991.157118:0:89059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.157130:0:89059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951991.157236:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465446528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951991.157285:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951991.157326:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951991.157476:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465446528 00000100:00100000:0.0:1783951991.157482:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465446528 00000100:00100000:0.0:1783951991.157524:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783951991.157532:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89059:x1870605465446528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783951991.157980:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89059:x1870605465446528:12345-0@lo:501:mount.lustre.0 Request processed in 183us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951991.157989:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783951991.161497:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465446528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783951991.161558:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465446656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783951991.161650:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951991.161683:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951991.166145:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465446656 00000100:00100000:0.0:1783951991.166160:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465446656 00000100:00100000:0.0:1783951991.166256:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783951991.166267:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89059:x1870605465446656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783951991.166450:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89059:x1870605465446656:12345-0@lo:503:mount.lustre.0 Request processed in 185us (4800us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951991.166468:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783951991.166575:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465446656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783951991.173019:0:89085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89085:1870605465446784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783951991.173124:0:89085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.180658:0:89085:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783951991.184717:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465446784 00000100:00100000:2.0:1783951991.184734:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465446784 00000100:00100000:2.0:1783951991.184794:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783951991.184803:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89085:x1870605465446784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783951991.184995:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89085:x1870605465446784:12345-0@lo:502:llog_process_th.0 Request processed in 192us (11871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.185003:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783951991.190405:0:89085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89085:1870605465446784:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783951991.190484:0:89085:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783951991.190500:0:89085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97b0489b8000) 00000020:00000080:3.0:1783951991.190524:0:89085:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783951991.191744:0:89085:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b174b31800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783951991.191752:0:89085:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b174b31800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783951991.191755:0:89085:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174b31800 4 00010000:00080000:2.0:1783951991.191790:0:89085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b174b12800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:0.0:1783951991.198445:0:89085:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1783951991.198620:0:89085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783951991.198670:0:89085:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783951991.198682:0:89085:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x22c73c7857bb4b6c 00000100:00080000:0.0:1783951991.198692:0:89085:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783951991.198698:0:89085:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b174b12800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783951991.198749:0:89085:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de95880 x1870605465446912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783951991.198776:0:89085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783951991.199087:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465446912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783951991.199181:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.202940:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465446912 00000100:00100000:0.0:1783951991.202954:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465446912 00000100:00100000:0.0:1783951991.202996:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1783951991.203004:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465446912:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783951991.203103:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465446912:12345-0@lo:38:llog_process_th.0 Request processed in 98us (3922us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783951991.203121:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1783951991.203301:0:89085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89085:1870605465447040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951991.203360:0:89085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.203399:0:89085:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141323b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951991.203446:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465447040 00000100:00100000:1.0:1783951991.203451:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465447040 00000100:00100000:1.0:1783951991.203493:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783951991.203501:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89085:x1870605465447040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951991.203660:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89085:x1870605465447040:12345-0@lo:502:llog_process_th.0 Request processed in 159us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951991.203667:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783951991.203886:0:89085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89085:1870605465447040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951991.203925:0:89085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89085:1870605465447168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783951991.203956:0:89085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.203980:0:89085:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141323b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951991.204023:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465447168 00000100:00100000:1.0:1783951991.204027:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465447168 00000100:00100000:1.0:1783951991.204059:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783951991.204066:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89085:x1870605465447168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783951991.204142:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89085:x1870605465447168:12345-0@lo:502:llog_process_th.0 Request processed in 76us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951991.204149:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783951991.204216:0:89085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89085:1870605465447168:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783951991.204239:0:89085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:3.0:1783951991.207035:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783951991.207049:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b174b12800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783951991.207054:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783951991.207058:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465446912:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1783951991.207091:0:89059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783951991.207133:0:89059:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783951991.207153:0:89059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951991.207164:0:89059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783951991.207227:0:89059:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783951991.207229:0:89059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783951991.207229:0:89059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951991.207230:0:89059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951991.207231:0:89059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951991.207232:0:89059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951991.207233:0:89059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951991.207234:0:89059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783951991.207235:0:89059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951991.207241:0:89059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783951991.207245:0:89059:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783951991.207247:0:89059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783951991.207247:0:89059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783951991.207248:0:89059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951991.207249:0:89059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951991.207249:0:89059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951991.207250:0:89059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951991.207251:0:89059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951991.207251:0:89059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783951991.207252:0:89059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951991.207253:0:89059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783951991.207284:0:89059:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783951991.207303:0:89059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465447296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783951991.207368:0:89059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.207403:0:89059:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8e240 going to sleep for 11 seconds 00000100:00100000:2.0:1783951991.208309:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465447296 00000100:00100000:2.0:1783951991.208319:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465447296 00000100:00100000:2.0:1783951991.208375:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783951991.208384:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89059:x1870605465447296:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783951991.208418:0:89066:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783951991.208434:0:89066:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783951991.216995:0:89066:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783951991.217010:0:89066:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783951991.217136:0:89069:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783951991.217157:0:89069:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783951991.217197:0:89069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.217230:0:89069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b176d22000/0x22c73c7857bb4b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4b3b expref: 11 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.217240:0:89069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.217280:0:89069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b176d22000/0x22c73c7857bb4b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb4b3b expref: 11 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.217294:0:89069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b176d22000/0x22c73c7857bb4b42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb4b3b expref: 11 pid: 89064 timeout: 3806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951991.217309:0:89069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89069:1870605465447424:0@lo:104: 00000100:00100000:0.0:1783951991.217372:0:89069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951991.217426:0:89069:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141323b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783951991.220314:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465447424 00000100:00100000:1.0:1783951991.220328:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465447424 00000100:00100000:1.0:1783951991.220385:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1783951991.220396:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:89069:x1870605465447424:12345-0@lo:104: 00010000:00010000:1.0:1783951991.220415:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951991.220551:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783951991.220558:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:89069:x1870605465447424:12345-0@lo:104: Request processed in 165us (3186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951991.220566:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:1.0:1783951991.220608:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951991.220615:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951991.220623:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22c00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783951991.220627:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951991.220636:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783951991.220642:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951991.220648:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1783951991.220651:0:89069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89069:1870605465447424:0@lo:104: 00010000:00010000:0.0:1783951991.220674:0:89069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951991.220684:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951991.220690:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783951991.220785:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465447552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783951991.220855:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951991.220863:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b176d22c00/0x22c73c7857bb4b3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb4b42 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951991.220888:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951991.220890:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951991.220891:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951991.224101:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:89059:x1870605465447296:12345-0@lo:253:mount.lustre.0 Request processed in 15710us (16723us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.224127:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783951991.224187:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951991.224219:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465447552 00000100:00100000:2.0:1783951991.224228:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465447552 00010000:00010000:2.0:1783951991.224253:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b176d22000/0x22c73c7857bb4b42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb4b3b expref: 11 pid: 89064 timeout: 3806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951991.224287:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:2.0:1783951991.224296:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1472bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:3642:x1870605465447552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783951991.224310:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783951991.224316:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b176d22000/0x22c73c7857bb4b42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb4b3b expref: 11 pid: 89064 timeout: 3806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224328:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b176d22000/0x22c73c7857bb4b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb4b3b expref: 11 pid: 89064 timeout: 3806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224346:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b176d22000/0x22c73c7857bb4b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb4b3b expref: 11 pid: 89064 timeout: 3806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224360:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224368:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783951991.224384:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007227599s 00010000:00010000:2.0:1783951991.224389:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224411:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224418:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224425:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224432:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951991.224436:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224444:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224465:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.224475:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783951991.224495:0:89069:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.224502:0:89069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.224515:0:89069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b176d22400/0x22c73c7857bb4b73 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951991.224519:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1472bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:3642:x1870605465447552:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.224525:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:2.0:1783951991.224613:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465447552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783951991.224690:0:89059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:89059:1870605465447296:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783951991.224701:0:89059:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783951991.224704:0:89059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783951991.224706:0:89059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783951991.224707:0:89059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783951991.224708:0:89059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783951991.224710:0:89059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783951991.224724:0:89059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783951991.224726:0:89059:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783951991.224727:0:89059:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783951991.224729:0:89059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783951991.224730:0:89059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783951991.224743:0:89059:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1783951991.236322:0:89059:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411352 00000040:01000000:3.0:1783951991.238234:0:89059:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783951991.238580:0:89090:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411352 00000020:00080000:1.0:1783951991.238585:0:89090:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411352 00000040:01000000:0.0:1783951991.245049:0:89091:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783951991.245422:0:89059:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1783951991.245757:0:89091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783951991.246715:0:89092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89092:1870605465447680:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783951991.246784:0:89092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951991.246831:0:89092:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5ed80 going to sleep for 11 seconds 00000040:01000000:1.0:1783951991.246982:0:89059:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783951991.247015:0:89059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783951991.247818:0:89059:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783951991.247827:0:89059:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783951991.247870:0:89059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783951991.248973:0:89059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783951991.249535:0:89059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783951991.249569:0:89059:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783951991.249700:0:89059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783951991.250724:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465447680 00000100:00100000:2.0:1783951991.250736:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465447680 00000100:00100000:2.0:1783951991.250791:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:2.0:1783951991.250803:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89092:x1870605465447680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951991.250932:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89092:x1870605465447680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 131us (4147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.250939:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:2.0:1783951991.250992:0:89092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89092:1870605465447680:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1783951991.251027:0:89092:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783951991.251068:0:89092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89092:1870605465447808:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951991.251117:0:89092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951991.251146:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465447808 00000100:00100000:2.0:1783951991.251150:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465447808 00000100:00100000:2.0:1783951991.251171:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:2.0:1783951991.251176:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89092:x1870605465447808:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951991.251258:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89092:x1870605465447808:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.251264:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:2.0:1783951991.251284:0:89092:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951991.251297:0:89092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89092:1870605465447808:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951991.251354:0:89092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89092:1870605465447936:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951991.251382:0:89092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951991.251400:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465447936 00000100:00100000:2.0:1783951991.251404:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465447936 00000100:00100000:2.0:1783951991.251425:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:2.0:1783951991.251431:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89092:x1870605465447936:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783951991.251469:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89092:x1870605465447936:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 38us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.251485:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:2.0:1783951991.251500:0:89092:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b59000 going to sleep for 11 seconds 00000100:00100000:2.0:1783951991.251511:0:89092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89092:1870605465447936:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1783951991.251555:0:89092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783951991.253763:0:89092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783951991.253844:0:89092:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1783951991.253981:0:89091:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783951991.254026:0:89091:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783951991.254030:0:89091:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:0.0:1783951991.256210:0:89059:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00010000:00080000:2.0:1783951991.263325:0:89059:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182406 00010000:00080000:1.0:1783951991.265199:0:89093:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 89093 00010000:02000000:1.0:1783951991.265216:0:89093:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1783951991.265219:0:89093:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783951991.265223:0:89093:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1783951991.265360:0:89059:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783951991.265379:0:89059:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783951991.265399:0:89059:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783951991.265426:0:89059:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783951991.271149:0:89059:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951991.272091:0:89059:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783951991.332792:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783951991.726616:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951991.726744:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447714816 00000100:00100000:2.0:1783951991.726754:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447714816 00000100:00100000:2.0:1783951991.726821:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 27 00000100:00100000:2.0:1783951991.726831:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+5:42446:x1870605447714816:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951991.726849:0:89070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951991.726869:0:89070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4b7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a212 expref: -99 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.726898:0:89070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a212 expref: 6 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.726910:0:89070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a212 expref: 6 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.726919:0:89070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216ac00, rc 0) 00000100:00100000:2.0:1783951991.726976:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447714816:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 146us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.726993:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 27 00000100:00100000:2.0:1783951991.729949:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951991.730097:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447714944 00000100:00100000:3.0:1783951991.730117:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447714944 00000100:00100000:3.0:1783951991.730170:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 28 00000100:00100000:3.0:1783951991.730179:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447714944:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783951991.730205:0:89064:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1783951991.730221:0:89064:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783951991.730224:0:89064:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783951991.730227:0:89064:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783951991.730230:0:89064:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783951991.730232:0:89064:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:3.0:1783951991.739362:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447714944:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 Request processed in 9171us (9409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.739378:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 28 00000100:00100000:3.0:1783951991.772189:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951991.772398:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951991.772439:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447715072 00000100:00100000:3.0:1783951991.772448:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447715072 00000100:00100000:3.0:1783951991.772488:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1196 00000100:00100000:3.0:1783951991.772496:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447715072:12345-192.168.202.48@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1783951991.772527:0:83761:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '458183b2-4c6d-478c-9fed-a955779e6611' at ffff97b04d9f2800, cookie 0x22c73c7857bb4ac4 00010000:00080000:3.0:1783951991.772533:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp recovering/t107374182407 exp ffff97b04d9f2800 cur 3706 last 1783951991 00010000:02000400:3.0:1783951991.772542:0:83761:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1783951991.772549:0:83761:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1783951991.772568:0:83761:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783951991.772726:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b16e9fb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783951991.772818:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447715072:12345-192.168.202.48@tcp:38:ll_cfg_requeue.0 Request processed in 320us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.772835:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1196 00000100:00100000:0.0:1783951991.777422:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447715200 00000100:00100000:0.0:1783951991.777436:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447715200 00000100:00100000:0.0:1783951991.777547:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:0.0:1783951991.777558:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447715200:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951991.777577:0:89070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951991.777620:0:89070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d23600/0x22c73c7857bb4b81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a219 expref: -99 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.777652:0:89070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d23600/0x22c73c7857bb4b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a219 expref: 7 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.777663:0:89070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d23600/0x22c73c7857bb4b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a219 expref: 7 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.777673:0:89070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23600, rc 0) 00000100:00100000:0.0:1783951991.777754:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+7:42446:x1870605447715200:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 197us (5573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951991.777787:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 29 00000100:00100000:1.0:1783951991.786399:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951991.786499:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447708288 00000100:00100000:0.0:1783951991.786510:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447708288 00000100:00100000:0.0:1783951991.786571:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1197 00000100:00100000:0.0:1783951991.786583:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447708288:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00080000:0.0:1783951991.786624:0:66238:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182407, current: 107374182407, replaying 00000100:00100000:0.0:1783951991.786635:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447708288:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 56us (245us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783951991.786642:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1197 00010000:00080000:1.0:1783951991.786719:0:89093:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1783951991.790433:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951991.791109:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447715328 00000100:00100000:3.0:1783951991.791123:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447715328 00000100:00100000:3.0:1783951991.791196:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 30 00000100:00100000:3.0:1783951991.791348:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+7:42446:x1870605447715328:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951991.791528:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447715328:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 321us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.791537:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 30 00000100:00100000:1.0:1783951991.795985:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951991.801706:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447715456 00000100:00100000:3.0:1783951991.801724:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447715456 00000100:00100000:3.0:1783951991.801796:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 31 00000100:00100000:3.0:1783951991.801816:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447715456:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951991.801970:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447715456:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 155us (5993us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.801978:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 31 00000100:00100000:2.0:1783951991.817024:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951991.817130:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447715584 00000100:00100000:0.0:1783951991.817140:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447715584 00000100:00100000:0.0:1783951991.817279:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 32 00000100:00100000:0.0:1783951991.817290:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447715584:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951991.817310:0:89064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951991.817328:0:89064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d22600/0x22c73c7857bb4b88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a220 expref: -99 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.817358:0:89064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d22600/0x22c73c7857bb4b88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a220 expref: 9 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.817368:0:89064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d22600/0x22c73c7857bb4b88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a220 expref: 9 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951991.817376:0:89064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22600, rc 0) 00000100:00100000:0.0:1783951991.817437:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447715584:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 150us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951991.817457:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 32 00000100:00100000:1.0:1783951991.820064:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951991.820473:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447715712 00000100:00100000:2.0:1783951991.820488:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447715712 00000100:00100000:2.0:1783951991.820797:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:2.0:1783951991.820911:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447715712:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951991.821370:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447715712:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 463us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.821379:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 33 00000100:00100000:2.0:1783951991.827297:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951991.827342:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447715840 00000100:00100000:3.0:1783951991.827351:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447715840 00000100:00100000:3.0:1783951991.827411:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00100000:3.0:1783951991.827420:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447715840:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951991.827603:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447715840:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 169us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951991.827612:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 34 00000100:00100000:3.0:1783951991.831825:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951991.831913:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447715968 00000100:00100000:2.0:1783951991.831923:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447715968 00000100:00100000:2.0:1783951991.831980:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:2.0:1783951991.831993:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447715968:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951991.832012:0:89065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951991.832035:0:89065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216a600/0x22c73c7857bb4b8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a227 expref: -99 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.832065:0:89065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216a600/0x22c73c7857bb4b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a227 expref: 10 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.832077:0:89065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216a600/0x22c73c7857bb4b8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a227 expref: 10 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951991.832109:0:89065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a600, rc 0) 00000100:00100000:2.0:1783951991.832178:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447715968:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 188us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951991.832185:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 35 00000100:00100000:2.0:1783951991.845258:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951991.845360:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447716096 00000100:00100000:3.0:1783951991.845380:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447716096 00000100:00100000:3.0:1783951991.845437:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 36 00000100:00100000:3.0:1783951991.845447:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447716096:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951991.845581:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447716096:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 134us (329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783951991.845619:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 36 10000000:01000000:0.0:1783951992.161673:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783951992.161682:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b174b31800 from 115 10000000:01000000:0.0:1783951992.161688:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783951992.161737:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.161749:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.161760:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.161787:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.161872:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.161916:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141323c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951992.161968:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465448064 00000100:00100000:2.0:1783951992.161977:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465448064 00000100:00100000:2.0:1783951992.162038:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783951992.162048:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:6514:x1870605465448064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951992.162062:0:89065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951992.162076:0:89065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216a400/0x22c73c7857bb4b9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4b96 expref: -99 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.162111:0:89065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216a400/0x22c73c7857bb4b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4b96 expref: 11 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.162121:0:89065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216a400/0x22c73c7857bb4b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4b96 expref: 11 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.162130:0:89065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a400, rc 0) 00000100:00100000:2.0:1783951992.162176:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465448064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951992.162182:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783951992.165021:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.165048:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.165060:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.165139:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.165216:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.165255:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141323c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783951992.165285:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465448192 00000100:00100000:3.0:1783951992.165293:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465448192 00000100:00100000:3.0:1783951992.165360:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783951992.165369:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15307e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465448192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783951992.165392:0:89064:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783951992.165410:0:89064:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783951992.165413:0:89064:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 115 00000100:00100000:3.0:1783951992.165519:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15307e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465448192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951992.165527:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783951992.166768:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783951992.166841:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783951992.166850:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.166864:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951992.166874:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783951992.166876:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b151231000 from 52 10000000:01000000:2.0:1783951992.166878:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783951992.166908:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb4ba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.166915:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb4ba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.166924:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb4ba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951992.166942:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.166990:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951992.167029:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1783951992.167057:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465448320 00000100:00100000:3.0:1783951992.167063:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465448320 00000100:00100000:3.0:1783951992.167118:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783951992.167127:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465448320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951992.167142:0:89065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951992.167155:0:89065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71800/0x22c73c7857bb4bab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4ba4 expref: -99 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.167175:0:89065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71800/0x22c73c7857bb4bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4ba4 expref: 12 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.167185:0:89065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71800/0x22c73c7857bb4bab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4ba4 expref: 12 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.167200:0:89065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71800, rc 0) 00000100:00100000:3.0:1783951992.167239:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465448320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951992.167258:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783951992.167309:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951992.167396:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb4ba4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.167404:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb4ba4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4bab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951992.167469:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.167567:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951992.167618:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fbef00 going to sleep for 11 seconds 00000100:00100000:2.0:1783951992.167977:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465448448 00000100:00100000:2.0:1783951992.167984:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465448448 00000100:00100000:2.0:1783951992.168030:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783951992.168037:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465448448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.168163:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465448448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951992.168170:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783951992.168682:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.168721:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.168764:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951992.168796:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fbef00 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.168886:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465448576 00000100:00100000:0.0:1783951992.168892:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465448576 00000100:00100000:0.0:1783951992.168941:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783951992.168949:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465448576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.169036:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465448576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.169043:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783951992.169136:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951992.170157:0:89146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783951992.170733:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783951992.170762:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783951992.170773:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb4ba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.170785:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb4ba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951992.170806:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783951992.170809:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b151231000 from 112 10000000:01000000:0.0:1783951992.170812:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783951992.170850:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23a00/0x22c73c7857bb4bb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.170858:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b176d23a00/0x22c73c7857bb4bb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.170868:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b176d23a00/0x22c73c7857bb4bb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.170894:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.170948:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.170986:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147dee240 going to sleep for 11 seconds 00000100:00100000:3.0:1783951992.176969:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465448704 00000100:00100000:3.0:1783951992.176985:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465448704 00000100:00100000:3.0:1783951992.177044:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783951992.177055:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465448704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951992.177085:0:89064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951992.177111:0:89064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71600/0x22c73c7857bb4bb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4bb2 expref: -99 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.177140:0:89064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71600/0x22c73c7857bb4bb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4bb2 expref: 13 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.177151:0:89064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71600/0x22c73c7857bb4bb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4bb2 expref: 13 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.177160:0:89064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71600, rc 0) 00000100:00100000:3.0:1783951992.177255:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465448704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (6293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951992.177262:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783951992.177974:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951992.177996:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b176d23a00/0x22c73c7857bb4bb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bb9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.178007:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b176d23a00/0x22c73c7857bb4bb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4bb9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951992.183169:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.183262:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951992.184163:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522c2600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.187700:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465448832 00000100:00100000:0.0:1783951992.187724:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465448832 00000100:00100000:0.0:1783951992.187785:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783951992.187796:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465448832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783951992.187825:0:89065:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783951992.187842:0:89065:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783951992.187846:0:89065:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783951992.187850:0:89065:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783951992.187853:0:89065:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783951992.187856:0:89065:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:0.0:1783951992.187999:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465448832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 205us (4735us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.188006:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783951992.188058:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783951992.188152:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783951992.188162:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23a00/0x22c73c7857bb4bb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bb9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.188173:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b176d23a00/0x22c73c7857bb4bb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bb9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951992.188182:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783951992.188185:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1783951992.188188:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783951992.188219:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23200/0x22c73c7857bb4bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.188226:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b176d23200/0x22c73c7857bb4bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.188235:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b176d23200/0x22c73c7857bb4bc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.188747:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.188785:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.188826:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147deea80 going to sleep for 11 seconds 00000100:00100000:2.0:1783951992.188884:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465448960 00000100:00100000:2.0:1783951992.188891:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465448960 00000100:00100000:2.0:1783951992.188930:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783951992.188938:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465448960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951992.188950:0:89064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783951992.188972:0:89064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216b600/0x22c73c7857bb4bc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4bc0 expref: -99 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.188996:0:89064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216b600/0x22c73c7857bb4bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4bc0 expref: 14 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.189007:0:89064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216b600/0x22c73c7857bb4bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4bc0 expref: 14 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.189016:0:89064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b600, rc 0) 00000100:00100000:2.0:1783951992.189049:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465448960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951992.189055:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783951992.189717:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465448960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.189734:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b176d23200/0x22c73c7857bb4bc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bc7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.189744:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b176d23200/0x22c73c7857bb4bc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4bc7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951992.189866:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.189898:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951992.189934:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1518a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.189990:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465449088 00000100:00100000:0.0:1783951992.189996:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465449088 00000100:00100000:0.0:1783951992.190033:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783951992.190041:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465449088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.190540:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465449088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 499us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.190548:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783951992.193989:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951992.194110:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951992.194183:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951992.194229:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b59600 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.194633:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465449216 00000100:00100000:0.0:1783951992.194640:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465449216 00000100:00100000:0.0:1783951992.194688:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783951992.194696:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465449216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.195533:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465449216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 835us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.195541:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783951992.195865:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783951992.197204:0:89147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1783951992.198866:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1783951992.198914:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783951992.198926:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23200/0x22c73c7857bb4bc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bc7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.198938:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b176d23200/0x22c73c7857bb4bc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bc7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951992.198948:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1783951992.198951:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b151231000 from 1 10000000:01000000:0.0:1783951992.198953:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783951992.199003:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23400/0x22c73c7857bb4bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.199011:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b176d23400/0x22c73c7857bb4bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.199020:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b176d23400/0x22c73c7857bb4bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.199045:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.199121:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.199164:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465449344 00000100:00100000:0.0:1783951992.199171:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465449344 00000100:00100000:0.0:1783951992.199214:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783951992.199223:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465449344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.199236:0:89064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951992.199624:0:89064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d23800/0x22c73c7857bb4bd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4bce expref: -99 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.199651:0:89064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d23800/0x22c73c7857bb4bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4bce expref: 15 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.199669:0:89064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d23800/0x22c73c7857bb4bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4bce expref: 15 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.199678:0:89064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23800, rc 0) 00000100:00100000:0.0:1783951992.199718:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465449344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 496us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.199725:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783951992.199771:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147dee480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.199793:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.199808:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b176d23400/0x22c73c7857bb4bce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.199816:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b176d23400/0x22c73c7857bb4bce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4bd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951992.199833:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783951992.199837:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23400/0x22c73c7857bb4bce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.199843:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b176d23400/0x22c73c7857bb4bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951992.199850:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783951992.199852:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b151231000 from 7 10000000:01000000:0.0:1783951992.199855:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783951992.199870:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22400/0x22c73c7857bb4bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.199887:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b176d22400/0x22c73c7857bb4bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.199895:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b176d22400/0x22c73c7857bb4bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.199911:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.199937:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.199957:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147dee480 going to sleep for 11 seconds 00000100:00100000:1.0:1783951992.200188:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465449472 00000100:00100000:1.0:1783951992.200194:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465449472 00000100:00100000:1.0:1783951992.200231:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783951992.200238:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465449472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951992.200258:0:89070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951992.200570:0:89070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb4be3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4bdc expref: -99 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.200609:0:89070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb4be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4bdc expref: 16 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.200619:0:89070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb4be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4bdc expref: 16 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.200626:0:89070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762aee00, rc 0) 00000100:00100000:1.0:1783951992.200665:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465449472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 427us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951992.200671:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783951992.203216:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.203246:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b176d22400/0x22c73c7857bb4bdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4be3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.203259:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b176d22400/0x22c73c7857bb4bdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4be3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.203346:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.203404:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.203442:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465449600 00000100:00100000:0.0:1783951992.203449:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465449600 00000100:00100000:0.0:1783951992.203490:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783951992.203499:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465449600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.203642:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465449600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.203650:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783951992.203696:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147dee480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.203716:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.203745:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.203781:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.203807:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147dee480 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.205054:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465449728 00000100:00100000:0.0:1783951992.205064:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465449728 00000100:00100000:0.0:1783951992.205116:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783951992.205123:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465449728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.205269:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465449728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.205277:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783951992.205352:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951992.206544:0:89149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783951992.206628:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783951992.206649:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783951992.206660:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22400/0x22c73c7857bb4bdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4be3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.206671:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b176d22400/0x22c73c7857bb4bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4be3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951992.206680:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783951992.206682:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b046482800 from 52 10000000:01000000:0.0:1783951992.206685:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783951992.206722:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22000/0x22c73c7857bb4bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.206730:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b176d22000/0x22c73c7857bb4bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.206749:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b176d22000/0x22c73c7857bb4bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.206771:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.206823:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.206846:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147dee780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.206868:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465449856 00000100:00100000:0.0:1783951992.206874:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465449856 00000100:00100000:0.0:1783951992.206908:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783951992.206915:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465449856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.206928:0:89064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951992.206939:0:89064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d22c00/0x22c73c7857bb4bf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4bea expref: -99 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.207160:0:89064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d22c00/0x22c73c7857bb4bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4bea expref: 17 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.207174:0:89064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d22c00/0x22c73c7857bb4bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4bea expref: 17 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.207182:0:89064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22c00, rc 0) 00000100:00100000:0.0:1783951992.207219:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465449856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 304us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.207226:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783951992.208130:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.208149:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b176d22000/0x22c73c7857bb4bea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bf1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.208165:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b176d22000/0x22c73c7857bb4bea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4bf1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.208234:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.209118:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.209151:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147dee780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.209169:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465449984 00000100:00100000:0.0:1783951992.209175:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465449984 00000100:00100000:0.0:1783951992.209210:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783951992.209218:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465449984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.211901:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465449984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2675us (2776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.211916:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783951992.213567:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465449984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951992.213647:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951992.213711:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951992.213748:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147dee780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.214080:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465450112 00000100:00100000:0.0:1783951992.214087:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465450112 00000100:00100000:0.0:1783951992.214274:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783951992.214284:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465450112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.214701:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465450112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 418us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.214710:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783951992.214929:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951992.223338:0:89150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783951992.223623:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783951992.223651:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783951992.223663:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22000/0x22c73c7857bb4bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bf1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.223676:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b176d22000/0x22c73c7857bb4bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bf1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951992.223700:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783951992.223703:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783951992.223706:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783951992.223743:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb4bf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.223750:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb4bf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.223761:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb4bf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951992.223787:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.223855:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951992.223895:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1518a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.224123:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465450240 00000100:00100000:0.0:1783951992.224131:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465450240 00000100:00100000:0.0:1783951992.224173:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783951992.224182:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16500a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465450240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.224205:0:89070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951992.224217:0:89070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d23c00/0x22c73c7857bb4bff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4bf8 expref: -99 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.224253:0:89070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d23c00/0x22c73c7857bb4bff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4bf8 expref: 18 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.224264:0:89070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d23c00/0x22c73c7857bb4bff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4bf8 expref: 18 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.224272:0:89070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23c00, rc 0) 00000100:00100000:0.0:1783951992.224325:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16500a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465450240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.224332:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783951992.224634:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783951992.224649:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb4bf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.224657:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb4bf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4bff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951992.224717:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.224745:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951992.224766:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1518a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.224927:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465450368 00000100:00100000:0.0:1783951992.224932:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465450368 00000100:00100000:0.0:1783951992.224968:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783951992.224976:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16500b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465450368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.225107:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16500b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465450368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.225115:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783951992.225189:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.225250:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.225323:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951992.225350:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1518a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.225758:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465450496 00000100:00100000:0.0:1783951992.225763:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465450496 00000100:00100000:0.0:1783951992.225789:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783951992.225795:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465450496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.239086:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465450496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 13282us (13754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951992.239114:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783951992.239160:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951992.240467:0:89153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783951992.240769:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783951992.240868:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783951992.240880:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb4bf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.240906:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb4bf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4bff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783951992.240916:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783951992.240918:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b046482800 from 7 10000000:01000000:3.0:1783951992.240921:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783951992.240956:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb4c06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.240964:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb4c06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.240973:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb4c06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951992.240997:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.241049:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951992.241091:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b146091300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951992.241677:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465450624 00000100:00100000:1.0:1783951992.241691:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465450624 00000100:00100000:1.0:1783951992.241770:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783951992.241780:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465450624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951992.241793:0:89065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951992.241806:0:89065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762afc00/0x22c73c7857bb4c0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4c06 expref: -99 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.241831:0:89065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762afc00/0x22c73c7857bb4c0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4c06 expref: 19 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.241841:0:89065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762afc00/0x22c73c7857bb4c0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4c06 expref: 19 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.241849:0:89065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762afc00, rc 0) 00000100:00100000:1.0:1783951992.241899:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465450624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951992.241906:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783951992.241970:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951992.241986:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb4c06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c0d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.241995:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb4c06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4c0d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951992.242052:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.242078:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951992.242124:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465450752 00000100:00100000:3.0:1783951992.242125:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b146091300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951992.242129:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465450752 00000100:00100000:2.0:1783951992.242159:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783951992.242166:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465450752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.242677:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465450752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 509us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951992.242685:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783951992.242915:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.242951:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.242987:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951992.243017:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b146091300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951992.243130:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465450880 00000100:00100000:2.0:1783951992.243136:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465450880 00000100:00100000:2.0:1783951992.243178:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783951992.243186:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16500bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465450880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.243307:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16500bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465450880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951992.243320:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783951992.244391:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465450880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951992.246446:0:89154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783951992.246563:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783951992.246611:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783951992.246625:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb4c06 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c0d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.246637:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb4c06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c0d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951992.246648:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783951992.246650:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174849000 from 52 10000000:01000000:1.0:1783951992.246654:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783951992.246690:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762ae200/0x22c73c7857bb4c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.246709:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762ae200/0x22c73c7857bb4c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.246720:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762ae200/0x22c73c7857bb4c14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951992.246746:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951992.246814:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951992.246852:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b59600 going to sleep for 11 seconds 00000100:00100000:3.0:1783951992.247113:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465451008 00000100:00100000:3.0:1783951992.247120:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465451008 00000100:00100000:3.0:1783951992.247170:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783951992.247179:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e18f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465451008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951992.247203:0:89070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951992.247217:0:89070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71400/0x22c73c7857bb4c1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4c14 expref: -99 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.247239:0:89070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71400/0x22c73c7857bb4c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4c14 expref: 20 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.247250:0:89070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71400/0x22c73c7857bb4c1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4c14 expref: 20 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.247259:0:89070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71400, rc 0) 00000100:00100000:3.0:1783951992.247302:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e18f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465451008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951992.247310:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783951992.247910:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951992.247927:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762ae200/0x22c73c7857bb4c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c1b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.247942:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762ae200/0x22c73c7857bb4c14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4c1b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951992.248006:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.248036:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951992.248070:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b146091780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951992.248128:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465451136 00000100:00100000:2.0:1783951992.248134:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465451136 00000100:00100000:2.0:1783951992.248171:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783951992.248178:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e18d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465451136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.248303:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e18d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465451136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951992.248310:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783951992.250498:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.250555:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.250649:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951992.250696:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b146091780 going to sleep for 11 seconds 00000100:00100000:2.0:1783951992.251135:0:89070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465451264 00000100:00100000:2.0:1783951992.251149:0:89070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465451264 00000100:00100000:2.0:1783951992.251203:0:89070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783951992.251213:0:89070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e18fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465451264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.251375:0:89070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e18fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465451264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951992.251382:0:89070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783951992.252403:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783951992.254028:0:89156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783951992.254396:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783951992.254418:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783951992.254430:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762ae200/0x22c73c7857bb4c14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c1b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.254440:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762ae200/0x22c73c7857bb4c14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c1b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951992.254449:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783951992.254451:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1783951992.254454:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783951992.254499:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb4c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.254506:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb4c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.254517:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb4c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951992.254550:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951992.254626:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951992.254667:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b59600 going to sleep for 11 seconds 00000100:00100000:3.0:1783951992.255632:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465451392 00000100:00100000:3.0:1783951992.255641:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465451392 00000100:00100000:3.0:1783951992.255688:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783951992.255697:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e18d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465451392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951992.255711:0:89064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783951992.255725:0:89064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71200/0x22c73c7857bb4c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4c22 expref: -99 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.255748:0:89064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71200/0x22c73c7857bb4c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4c22 expref: 21 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.255758:0:89064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71200/0x22c73c7857bb4c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4c22 expref: 21 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.255776:0:89064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71200, rc 0) 00000100:00100000:3.0:1783951992.255841:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e18d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465451392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951992.255848:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783951992.255895:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783951992.255909:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb4c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c29 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951992.255917:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb4c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4c29 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783951992.255974:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.256000:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951992.256024:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b146091d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951992.256199:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465451520 00000100:00100000:1.0:1783951992.256204:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465451520 00000100:00100000:1.0:1783951992.256230:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783951992.256245:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465451520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951992.256603:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465451520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 352us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951992.256610:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783951992.256642:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.256672:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783951992.256713:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951992.256743:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b146091d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783951992.256788:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465451648 00000100:00100000:1.0:1783951992.256792:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465451648 00000100:00100000:1.0:1783951992.256823:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783951992.256830:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465451648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783951992.258642:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465451648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1805us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951992.258654:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783951992.258719:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783951992.261846:0:89157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1783951992.262123:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1783951992.262151:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783951992.262163:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb4c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c29 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.262176:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb4c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c29 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783951992.262186:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783951992.262193:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b174849000 from 7 10000000:01000000:1.0:1783951992.262196:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783951992.262233:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb4c30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.262253:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb4c30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.262274:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb4c30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951992.262505:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783951992.262571:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951992.262680:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fb4300 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.262877:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465451776 00000100:00100000:0.0:1783951992.262884:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465451776 00000100:00100000:0.0:1783951992.262972:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783951992.262987:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465451776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.263002:0:89065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951992.263014:0:89065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d23e00/0x22c73c7857bb4c37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4c30 expref: -99 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.263039:0:89065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d23e00/0x22c73c7857bb4c37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4c30 expref: 22 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.263050:0:89065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d23e00/0x22c73c7857bb4c37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4c30 expref: 22 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.263059:0:89065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23e00, rc 0) 00000100:00100000:0.0:1783951992.263117:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465451776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.263124:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783951992.263195:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783951992.263210:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb4c30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c37 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951992.263219:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb4c30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4c37 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951992.263296:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783951992.263338:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951992.263772:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fb4300 going to sleep for 11 seconds 00000100:00100000:2.0:1783951992.263816:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465451904 00000100:00100000:2.0:1783951992.263822:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465451904 00000100:00100000:2.0:1783951992.263854:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783951992.263861:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465451904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.264003:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465451904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951992.264011:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783951992.264053:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465451904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.264081:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465452032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.264127:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951992.264140:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783951992.264150:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465452032 00000100:00100000:2.0:1783951992.264153:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465452032 00000100:00100000:2.0:1783951992.264172:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783951992.264177:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465452032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.264552:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465452032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 374us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951992.264560:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783951992.264622:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465452032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783951992.265705:0:89159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783951992.265930:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783951992.265969:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783951992.265980:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb4c30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c37 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.265991:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb4c30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c37 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783951992.265999:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1783951992.266002:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97b167c90000 from 1 10000000:01000000:2.0:1783951992.266005:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783951992.266039:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b000/0x22c73c7857bb4c3e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.266047:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216b000/0x22c73c7857bb4c3e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.266056:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216b000/0x22c73c7857bb4c3e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783951992.266077:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465452160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.266139:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951992.266179:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42780 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.266494:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465452160 00000100:00100000:0.0:1783951992.266500:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465452160 00000100:00100000:0.0:1783951992.266543:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783951992.266551:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465452160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.266563:0:89066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951992.266575:0:89066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d22e00/0x22c73c7857bb4c45 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4c3e expref: -99 pid: 89066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.266614:0:89066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d22e00/0x22c73c7857bb4c45 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4c3e expref: 23 pid: 89066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.266625:0:89066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d22e00/0x22c73c7857bb4c45 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4c3e expref: 23 pid: 89066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.266646:0:89066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22e00, rc 0) 00000100:00100000:0.0:1783951992.266686:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465452160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.266693:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783951992.266738:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465452160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.266753:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216b000/0x22c73c7857bb4c3e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c45 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.266763:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216b000/0x22c73c7857bb4c3e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4c45 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951992.266788:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783951992.266792:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b000/0x22c73c7857bb4c3e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c45 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.266799:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216b000/0x22c73c7857bb4c3e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c45 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783951992.266806:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783951992.266808:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97b167c90000 from 1 10000000:01000000:0.0:1783951992.266810:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783951992.266825:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22a00/0x22c73c7857bb4c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.266832:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b176d22a00/0x22c73c7857bb4c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.266838:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b176d22a00/0x22c73c7857bb4c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.266859:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465452288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.266886:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.266905:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048af1540 going to sleep for 11 seconds 00000100:00100000:0.0:1783951992.266917:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465452288 00000100:00100000:0.0:1783951992.266921:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465452288 00000100:00100000:0.0:1783951992.266943:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783951992.266949:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465452288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.266957:0:89065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783951992.267030:0:89065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb4c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb4c4c expref: -99 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.267045:0:89065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb4c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb4c4c expref: 24 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.267054:0:89065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb4c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb4c4c expref: 24 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.267061:0:89065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbde00, rc 0) 00000100:00100000:0.0:1783951992.267089:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465452288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951992.267107:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783951992.267136:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465452288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783951992.267144:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b176d22a00/0x22c73c7857bb4c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c53 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.267151:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b176d22a00/0x22c73c7857bb4c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4c53 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951992.267201:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465452416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783951992.267225:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951992.267238:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048af1540 going to sleep for 11 seconds 00000100:00100000:2.0:1783951992.267472:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465452416 00000100:00100000:2.0:1783951992.267477:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465452416 00000100:00100000:2.0:1783951992.267503:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783951992.267510:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465452416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783951992.267580:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465452416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (354us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783951992.267612:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783951992.267693:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465452416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783951992.267718:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783951992.267723:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22a00/0x22c73c7857bb4c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c53 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951992.267730:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b176d22a00/0x22c73c7857bb4c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4c53 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951992.353893:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951993.382783:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951994.401980:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783951994.464726:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783951994.464749:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465452544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951994.464810:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951994.464918:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465452544 00000100:00100000:3.0:1783951994.464927:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465452544 00000100:00100000:3.0:1783951994.464980:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1783951994.464992:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465452544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783951994.465022:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951994.465098:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465452544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951994.465105:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00080000:3.0:1783951994.465126:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783951994.465160:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465452544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783951994.465479:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783951994.465489:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465452672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951994.465515:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951994.465883:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465452672 00000100:00100000:3.0:1783951994.465888:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465452672 00000100:00100000:3.0:1783951994.465916:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:3.0:1783951994.465924:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465452672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783951994.465944:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951994.465981:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465452672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951994.465987:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:3.0:1783951994.467377:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465452672:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783951994.467409:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783951995.380480:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951995.380570:0:89064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447716224 00000100:00100000:2.0:1783951995.380580:0:89064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447716224 00000100:00100000:2.0:1783951995.380766:0:89064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 72 00000100:00100000:2.0:1783951995.380779:0:89064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447716224:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951995.380849:0:89064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447716224:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 74us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951995.380857:0:89064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 72 00000100:00100000:1.0:1783951995.386379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951995.386554:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447716352 00000100:00100000:0.0:1783951995.386563:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447716352 00000100:00100000:0.0:1783951995.386630:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1180 00000100:00100000:0.0:1783951995.386640:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447716352:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783951995.386707:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447716352:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 69us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951995.386714:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1180 00000100:00080000:0.0:1783951995.386734:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783951995.424798:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783951996.201095:0:89344:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783951996.454417:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783951996.532239:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951996.532245:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951996.532249:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951996.532262:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951996.532282:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e1f80 x1870605465453056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951996.532307:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951996.532310:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951996.532312:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951996.532332:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951996.532345:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e3480 x1870605465453312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951996.532364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951996.532367:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951996.532369:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951996.532374:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951996.532386:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b147740700 x1870605465453568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951996.532462:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783951996.532466:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951996.532468:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951996.532472:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951996.532484:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b17300ea00 x1870605465453952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783951996.532508:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783951996.532512:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783951996.532514:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b174b12800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783951996.532518:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b174b12800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783951996.532526:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ea9c00 x1870605465454464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783951996.532555:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465453184:0@lo:400:kworker.0 00000100:00100000:2.0:1783951996.532637:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.532672:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465454080:0@lo:400:kworker.0 00000100:00100000:2.0:1783951996.532708:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.532748:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783951996.532754:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465452928:0@lo:400:kworker.0 00000100:00100000:2.0:1783951996.532889:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.532919:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465453824:0@lo:400:kworker.0 00000100:00100000:2.0:1783951996.532942:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.532970:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465453056:0@lo:38:kworker.0 00000100:00100000:2.0:1783951996.532993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.533014:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465453312:0@lo:38:kworker.0 00000100:00100000:2.0:1783951996.533035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.533052:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465453568:0@lo:38:kworker.0 00000100:00100000:2.0:1783951996.533085:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.533101:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465453952:0@lo:38:kworker.0 00000100:00100000:2.0:1783951996.533119:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.533143:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465454464:0@lo:38:kworker.0 00000100:00100000:2.0:1783951996.533167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.533199:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465453184 00000100:00100000:2.0:1783951996.533206:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465453184 00000100:00100000:2.0:1783951996.533252:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465453056 00000100:00100000:2.0:1783951996.533256:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465453056 00000100:00100000:2.0:1783951996.533266:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465453312 00000100:00100000:2.0:1783951996.533268:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465453312 00000100:00100000:2.0:1783951996.533277:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1783951996.533286:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465453184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951996.533339:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465453184:12345-0@lo:400:kworker.0 Request processed in 54us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951996.533355:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1783951996.533371:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465453952 00000100:00100000:2.0:1783951996.533374:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465453952 00000100:00100000:2.0:1783951996.533383:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465454464 00000100:00100000:2.0:1783951996.533385:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465454464 00000100:00100000:2.0:1783951996.533397:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1783951996.533400:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465453056:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783951996.533425:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3711 last 0 00000020:00000080:2.0:1783951996.533459:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x22c73c7857bb4c5a 00000004:00100000:2.0:1783951996.533475:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951996.533610:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b144576000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951996.533650:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870605465453056:12345-0@lo:38:kworker.0 Request processed in 248us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951996.533656:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1783951996.533669:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1783951996.533673:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465453312:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783951996.533685:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3711 last 0 00000020:00000080:2.0:1783951996.534938:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x22c73c7857bb4c61 00000004:00100000:2.0:1783951996.534955:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951996.534988:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b144576800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951996.535043:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870605465453312:12345-0@lo:38:kworker.0 Request processed in 1366us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951996.535051:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1783951996.535089:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1783951996.535096:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465453952:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783951996.535131:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3711 last 0 00000020:00000080:2.0:1783951996.535157:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x22c73c7857bb4c68 00000004:00100000:2.0:1783951996.535164:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951996.535179:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b144573800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951996.535212:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870605465453952:12345-0@lo:38:kworker.0 Request processed in 115us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951996.535215:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1783951996.535227:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1783951996.535229:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465454464:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783951996.535247:0:68591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3711 last 0 00000100:00100000:2.0:1783951996.535254:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465454080 00000100:00100000:2.0:1783951996.535261:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465454080 00000020:00000080:1.0:1783951996.535285:0:68591:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x22c73c7857bb4c6f 00000004:00100000:1.0:1783951996.535295:0:68591:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783951996.535297:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465453568 00000100:00100000:2.0:1783951996.535302:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465453568 00000100:00080000:1.0:1783951996.535317:0:68591:0:(import.c:65:import_set_state_nolock()) ffff97b046486800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951996.535322:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:2.0:1783951996.535329:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465454080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783951996.535376:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465454464:12345-0@lo:38:kworker.0 Request processed in 150us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951996.535382:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465454080:12345-0@lo:400:kworker.0 Request processed in 52us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951996.535389:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1783951996.535395:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00100000:2.0:1783951996.535411:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:2.0:1783951996.535416:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465453568:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783951996.535430:0:8445:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff97b04d9f1800, cookie 0x22c73c7857bb4acb 00010000:00080000:2.0:1783951996.535862:0:8445:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378653 exp ffff97b04d9f1800 cur 3711 last 1783951991 00000004:00100000:2.0:1783951996.535876:0:8445:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783951996.535892:0:8445:0:(import.c:65:import_set_state_nolock()) ffff97b144577000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783951996.535934:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465453568:12345-0@lo:38:kworker.0 Request processed in 516us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951996.535941:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:2.0:1783951996.535969:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465453824 00000100:00100000:2.0:1783951996.535973:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465453824 00000100:00100000:2.0:1783951996.536004:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:2.0:1783951996.536011:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465453824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783951996.536044:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465453824:12345-0@lo:400:kworker.0 Request processed in 34us (3100us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951996.536051:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00080000:2.0:1783951996.536874:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783951996.536880:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783951996.536926:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465453824:0@lo:400:kworker.0 00000100:00100000:2.0:1783951996.536941:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465453184:0@lo:400:kworker.0 00000100:00100000:2.0:1783951996.536951:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465454080:0@lo:400:kworker.0 00010000:00080000:2.0:1783951996.536996:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b1518e1f80 x1870605465453056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951996.537010:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00100000:0.0:1783951996.541077:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465452928 00000100:00100000:0.0:1783951996.541090:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465452928 00000100:00100000:0.0:1783951996.541160:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783951996.541170:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465452928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783951996.541273:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465452928:12345-0@lo:400:kworker.0 Request processed in 105us (8383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951996.541281:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1783951996.542454:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff97b1518e1f80 x1870605465453056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952021 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951996.542467:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783951996.542473:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783951996.542479:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783951996.542485:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465453056:0@lo:38:kworker.0 00000100:00100000:2.0:1783951996.542531:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465452928:0@lo:400:kworker.0 00010000:00080000:2.0:1783951996.542581:0:89093:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783951996.542607:0:89093:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 107374182407 00000020:00080000:2.0:1783951996.542622:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951996.542625:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182407, next_transno: 107374182407 00010000:00080000:2.0:1783951996.542630:0:89093:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182407) 00000020:00080000:2.0:1783951996.542632:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951996.542642:0:89093:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447708288 t107374182407 from 192.168.202.48@tcp req@ffff97b1756e0a80 x1870605447708288/t0(107374182407) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:252/0 lens 528/0 e 0 to 0 dl 1783952002 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783951996.544030:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b1518e3480 x1870605465453312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951996.544050:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00100000:3.0:1783951996.544304:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465452800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783951996.544382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951996.544418:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465453696:0@lo:400:kworker.0 00000100:00100000:3.0:1783951996.544443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951996.544462:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465454336:0@lo:400:kworker.0 00000100:00100000:3.0:1783951996.544483:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951996.544508:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783951996.544516:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465453440:0@lo:400:kworker.0 00000100:00100000:3.0:1783951996.544541:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951996.544560:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465454208:0@lo:400:kworker.0 00000100:00100000:3.0:1783951996.544622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951996.544662:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465453696 00000100:00100000:3.0:1783951996.544669:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465453696 00000100:00100000:3.0:1783951996.544714:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465454336 00000100:00100000:3.0:1783951996.544717:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465454336 00000100:00100000:3.0:1783951996.544734:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465454208 00000100:00100000:3.0:1783951996.544737:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465454208 00000100:00100000:3.0:1783951996.544756:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:3.0:1783951996.544765:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465453696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951996.544816:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465453696:12345-0@lo:400:kworker.0 Request processed in 52us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951996.544822:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00100000:3.0:1783951996.544838:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:3.0:1783951996.544844:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465454336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951996.544868:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465454336:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951996.544873:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:3.0:1783951996.544883:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:3.0:1783951996.544888:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465454208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951996.544911:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465454208:12345-0@lo:400:kworker.0 Request processed in 24us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951996.544916:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:3.0:1783951996.544958:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465454208:0@lo:400:kworker.0 00000100:00100000:3.0:1783951996.544967:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465453696:0@lo:400:kworker.0 00000100:00100000:3.0:1783951996.544975:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465454336:0@lo:400:kworker.0 00000100:00080000:3.0:1783951996.545006:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783951996.545010:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783951996.545255:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465453440 00000100:00100000:3.0:1783951996.545261:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465453440 00000100:00100000:3.0:1783951996.545297:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1783951996.545302:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465453440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783951996.545336:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465453440:12345-0@lo:400:kworker.0 Request processed in 34us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951996.545341:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1783951996.545369:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465453440:0@lo:400:kworker.0 00000100:00080000:3.0:1783951996.545384:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783951996.545394:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465452800 00000100:00100000:3.0:1783951996.545397:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465452800 00000100:00100000:3.0:1783951996.545423:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1783951996.545429:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465452800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783951996.545453:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783951996.545486:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465452800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951996.545491:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1783951996.545519:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465452800:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1783951996.546261:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff97b1518e3480 x1870605465453312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952021 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951996.546274:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783951996.546280:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783951996.546284:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783951996.546290:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465453312:0@lo:38:kworker.0 00000004:00080000:2.0:1783951996.546306:0:89093:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3601us 00000100:00080000:2.0:1783951996.546338:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:2.0:1783951996.546348:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1783951996.546353:0:3641:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1783951996.546355:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:2.0:1783951996.546359:0:3641:0:(recover.c:53:ptlrpc_replay_next()) import ffff97b048caf800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:2.0:1783951996.546362:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1783951996.570885:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465453568:0@lo:38:kworker.0 00010000:00080000:2.0:1783951996.570934:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b17300ea00 x1870605465453952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951996.570964:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00010000:00080000:1.0:1783951996.571513:0:89360:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1783951996.571517:0:89360:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1783951996.571522:0:89360:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1783951996.571947:0:89360:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:2.0:1783951996.574381:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff97b17300ea00 x1870605465453952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952021 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951996.574395:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783951996.574401:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783951996.575363:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783951996.575371:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465453952:0@lo:38:kworker.0 00010000:00080000:2.0:1783951996.575419:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b049ea9c00 x1870605465454464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951996.575437:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:2.0:1783951996.575446:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783951996.575451:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783951996.575454:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b174b12800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783951996.575461:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465454464:0@lo:38:kworker.0 00000100:00100000:2.0:1783951996.575506:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465454592:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1783951996.575570:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.575660:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465454592 00000100:00100000:2.0:1783951996.575667:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465454592 00000100:00100000:2.0:1783951996.575706:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:2.0:1783951996.575714:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465454592:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783951996.575733:0:23862:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b049ded500 x1870605465454592/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:257/0 lens 224/0 e 0 to 0 dl 1783952007 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951996.575745:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465454592:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 32us (176us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783951996.575759:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00010000:00010000:2.0:1783951996.594925:0:89093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4c76 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.594948:0:89093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4c76 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.594963:0:89093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4c76 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.594975:0:89093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.594981:0:89093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.594986:0:89093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.597720:0:89093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4c76 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.597736:0:89093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4c76 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.597743:0:89093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4c76 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.597749:0:89093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216be00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951996.597753:0:89093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4c76 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.597779:0:89093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4c76 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.597795:0:89093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0600) 00010000:00010000:2.0:1783951996.597798:0:89093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783951996.597803:0:89093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4c76 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.597809:0:89093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4c76 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783951996.597830:0:89093:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000052844fd reply state 00000000141cfda5 transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.597843:0:89093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.597851:0:89093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b176ee0800) 00010000:00010000:2.0:1783951996.597853:0:89093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783951996.597856:0:89093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1783951996.597983:0:89093:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1783951996.598006:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951996.598010:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000020:00080000:2.0:1783951996.598014:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783951996.598016:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000001:00080000:3.0:1783951996.600958:0:89060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:1.0:1783951996.602477:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.602494:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.602501:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.602507:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216bc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951996.602512:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.602520:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.602541:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b176ee0800) 00010000:00010000:1.0:1783951996.602544:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951996.602561:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.602568:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4c7d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783951996.603710:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951996.603802:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447708800 00000100:00100000:3.0:1783951996.603812:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447708800 00000100:00100000:3.0:1783951996.603876:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1202 00000100:00100000:3.0:1783951996.603887:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447708800:12345-192.168.202.48@tcp:36:rm.0 00010000:00080000:3.0:1783951996.603912:0:66236:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:3.0:1783951996.603945:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447708800:12345-192.168.202.48@tcp:36:rm.0 Request processed in 61us (241us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783951996.603953:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1202 00000020:00080000:1.0:1783951996.604091:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951996.604096:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:1.0:1783951996.604100:0:89093:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:1.0:1783951996.604103:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951996.604111:0:89093:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447708800 t107374182408 from 192.168.202.48@tcp req@ffff97b14de96a00 x1870605447708800/t0(107374182408) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:257/0 lens 512/0 e 0 to 0 dl 1783952007 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783951996.604189:0:89093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4c84 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604204:0:89093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4c84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604215:0:89093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4c84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604227:0:89093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604233:0:89093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604239:0:89093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604332:0:89093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb4c92 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604358:0:89093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb4c92 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604366:0:89093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb4c92 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604614:0:89093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb4c92 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604622:0:89093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb4c92 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604628:0:89093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb4c92 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604635:0:89093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951996.604638:0:89093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb4c92 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604645:0:89093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb4c92 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604656:0:89093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff97b151a72000) 00010000:00010000:1.0:1783951996.604659:0:89093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783951996.604663:0:89093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb4c92 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604668:0:89093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb4c92 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604686:0:89093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4c84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604698:0:89093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4c84 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604704:0:89093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4c84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604709:0:89093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783951996.604711:0:89093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4c84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604717:0:89093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4c84 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604726:0:89093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b151a72f00) 00010000:00010000:1.0:1783951996.604728:0:89093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783951996.604730:0:89093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4c84 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604735:0:89093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4c84 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783951996.604746:0:89093:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036cd7b64 reply state 00000000aa86283d transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604756:0:89093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.604761:0:89093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b151a72600) 00010000:00010000:1.0:1783951996.604764:0:89093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783951996.604766:0:89093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1783951996.604840:0:89093:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783951996.604861:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951996.604864:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:1.0:1783951996.604868:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951996.604870:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:1.0:1783951996.609674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783951996.610054:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447710208 00000100:00100000:3.0:1783951996.610073:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447710208 00000100:00100000:3.0:1783951996.610138:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1203 00000100:00100000:3.0:1783951996.610150:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447710208:12345-192.168.202.48@tcp:36:dd.0 00010000:00080000:3.0:1783951996.610172:0:66237:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182410, replaying 00000100:00100000:3.0:1783951996.610191:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447710208:12345-192.168.202.48@tcp:36:dd.0 Request processed in 43us (525us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783951996.610199:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1203 00000020:00080000:3.0:1783951996.610224:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951996.610228:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182410, next_transno: 107374182409 00010000:00080000:3.0:1783951996.610233:0:89093:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182409, ql: 1, comp: 1, conn: 2, next: 107374182410, next_update 0 last_committed: 107374182407) 00000020:00080000:3.0:1783951996.610239:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951996.610249:0:89093:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447710208 t107374182410 from 192.168.202.48@tcp req@ffff97b1756e0000 x1870605447710208/t0(107374182410) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:257/0 lens 488/0 e 0 to 0 dl 1783952007 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783951996.610482:0:89093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.610498:0:89093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.610513:0:89093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783951996.610657:0:89093:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047b77710 reply state 00000000a7897b60 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.610677:0:89093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.610687:0:89093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b146f44600) 00010000:00010000:3.0:1783951996.610690:0:89093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783951996.610694:0:89093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783951996.611029:0:89093:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783951996.611048:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951996.611051:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000020:00080000:3.0:1783951996.611066:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783951996.611069:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000100:00100000:0.0:1783951996.617430:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951996.617935:0:66265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447710464 00000100:00100000:1.0:1783951996.617947:0:66265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447710464 00000100:00100000:3.0:1783951996.618074:0:66265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2 00000100:00100000:3.0:1783951996.618087:0:66265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:458183b2-4c6d-478c-9fed-a955779e6611+10:2397:x1870605447710464:12345-192.168.202.48@tcp:10:dd.0 00010000:00080000:3.0:1783951996.618108:0:66265:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182411, current: 107374182411, replaying 00000100:00100000:3.0:1783951996.618130:0:66265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:458183b2-4c6d-478c-9fed-a955779e6611+10:2397:x1870605447710464:12345-192.168.202.48@tcp:10:dd.0 Request processed in 47us (710us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783951996.618137:0:66265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2 00000020:00080000:1.0:1783951996.618376:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951996.618381:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182411, next_transno: 107374182411 00010000:00080000:1.0:1783951996.618385:0:89093:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182411) 00000020:00080000:1.0:1783951996.618388:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951996.618397:0:89093:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447710464 t107374182411 from 192.168.202.48@tcp req@ffff97b14de95880 x1870605447710464/t0(107374182411) o10->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:257/0 lens 440/0 e 0 to 0 dl 1783952007 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783951996.618681:0:89093:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783951996.618697:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951996.618700:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000020:00080000:1.0:1783951996.618704:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951996.618706:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000100:00100000:3.0:1783951996.626320:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951996.626410:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447716480 00000100:00100000:0.0:1783951996.626421:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447716480 00000100:00100000:0.0:1783951996.626483:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1204 00000100:00100000:0.0:1783951996.626493:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+11:2397:x1870605447716480:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1783951996.626516:0:83761:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049ea9c00 x1870605447716480/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:257/0 lens 328/0 e 0 to 0 dl 1783952007 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951996.626539:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+11:2397:x1870605447716480:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 48us (236us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783951996.626546:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1204 00000020:00080000:1.0:1783951996.626612:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951996.626616:0:89093:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182412 00010000:00080000:1.0:1783951996.626619:0:89093:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1783951996.626622:0:89093:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783951996.626627:0:89093:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783951996.626630:0:89093:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783951996.626636:0:89093:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049ea9c00 x1870605447716480/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:257/0 lens 328/0 e 0 to 0 dl 1783952007 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783951996.626653:0:89093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783951996.626683:0:89093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 2/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a204 expref: -99 pid: 89093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.626709:0:89093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 12 pid: 89093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.626722:0:89093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 12 pid: 89093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.626733:0:89093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af800, rc 0) 00010000:00080000:1.0:1783951996.626788:0:89093:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1783951996.626811:0:89093:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1783951996.629992:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951996.635788:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447716608 00000100:00100000:0.0:1783951996.635804:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447716608 00000100:00100000:0.0:1783951996.635872:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1183 00000100:00100000:0.0:1783951996.635884:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:2397:x1870605447716608:12345-192.168.202.48@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1783951996.635906:0:66236:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b049ea8380 x1870605447716608/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:257/0 lens 224/0 e 0 to 0 dl 1783952007 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783951996.635922:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:2397:x1870605447716608:12345-192.168.202.48@tcp:400:ptlrpcd_rcv.0 Request processed in 41us (5940us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783951996.635928:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1183 00010000:00080000:1.0:1783951996.636005:0:89093:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1783951996.636124:0:89093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:0.0:1783951996.649424:0:89060:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00100000:0.0:1783951996.649435:0:89060:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1783951996.649459:0:89060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182411 is committed 00010000:00010000:2.0:1783951996.649501:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649514:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649543:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649549:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951996.649554:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649563:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649581:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649620:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb4c8b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649650:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649657:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649663:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649668:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783951996.649672:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649678:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649698:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.649703:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4c99 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89093 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783951996.649801:0:89093:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783951996.649854:0:89093:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783951996.649872:0:89093:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff97b049ded500 x1870605465454592/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:257/0 lens 224/0 e 0 to 0 dl 1783952007 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783951996.649999:0:89093:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.48@tcp: req@ffff97b049ea8380 x1870605447716608/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:257/0 lens 224/0 e 0 to 0 dl 1783952007 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783951996.650114:0:89093:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1783951996.653368:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1783951996.653385:0:3641:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff97b1756e3b80 x1870605465454592/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952012 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951996.653397:0:3641:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff97b1756e3b80 x1870605465454592/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952012 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783951996.653404:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783951996.653422:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1783951996.653429:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000064f9d171): req@ffff97b16dd4d500 x1870605465432832/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783951980 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783951996.653444:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465454592:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1783951996.653581:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.653636:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783951996.653645:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465454720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951996.653671:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951996.653714:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465432832 00000100:00100000:2.0:1783951996.653721:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465432832 00000100:00100000:2.0:1783951996.653766:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465454720 00000100:00100000:2.0:1783951996.653769:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465454720 00000100:00100000:2.0:1783951996.653794:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1783951996.653804:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465432832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951996.653851:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1783951996.653899:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465432832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951996.653906:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1783951996.653924:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:2.0:1783951996.653929:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465454720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783951996.653939:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1783951996.653961:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465454720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951996.653966:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00100000:2.0:1783951996.654001:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465454720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783951996.654010:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465432832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783951996.667324:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783951996.667381:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783951996.668725:0:66264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447712128 00000100:00100000:1.0:1783951996.668737:0:66264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447712128 00002000:00100000:1.0:1783951996.668786:0:66264:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff97b047acc700 x1870605447712128/t0(0) o4->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:257/0 lens 496/0 e 0 to 0 dl 1783952007 ref 1 fl New:/602/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783951996.668797:0:66264:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff97b047acc700 with x1870605447712128 00002000:00010000:1.0:1783951996.668809:0:66264:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 7 pid: 89093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783951996.668850:0:66264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3 00000100:00100000:1.0:1783951996.668860:0:66264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447712128:12345-192.168.202.48@tcp:4:dd.0 00000100:00100000:0.0:1783951996.669700:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447712256 00000100:00100000:0.0:1783951996.669707:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447712256 00000100:00100000:0.0:1783951996.669751:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1205 00000100:00100000:0.0:1783951996.669759:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:2400:x1870605447712256:12345-192.168.202.48@tcp:16:kworker.0 00000100:00100000:0.0:1783951996.670518:0:66264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:2400:x1870605447712128:12345-192.168.202.48@tcp:4:dd.0 Request processed in 1658us (3134us total) trans 111669149697 rc 0/0 00000100:00100000:0.0:1783951996.670527:0:66264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3 00002000:00100000:0.0:1783951996.670535:0:66264:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff97b047acc700 x1870605447712128/t111669149697(0) o4->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:257/0 lens 496/448 e 0 to 0 dl 1783952007 ref 1 fl Complete:/602/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783951996.670543:0:66264:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff97b047acc700 with x1870605447712128 00002000:00010000:0.0:1783951996.670550:0:66264:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 10 pid: 89093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783951996.671163:0:89060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149697 is committed 00000100:00100000:0.0:1783951996.671579:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447712256:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 1818us (4262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783951996.671612:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1205 00000004:00000080:1.0:1783951996.704654:0:89093:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa80a47b2fe10 00100000:10000000:1.0:1783951996.704668:0:89093:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1783951996.705746:0:89079:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6a2:0x0] 00000100:00100000:0.0:1783951996.705796:0:89079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89079:1870605465454848:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783951996.705867:0:89079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783951996.705906:0:89079:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1460ac300 going to sleep for 11 seconds 00000100:00100000:1.0:1783951996.706253:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465454848 00000100:00100000:1.0:1783951996.706267:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465454848 00000100:00100000:1.0:1783951996.706324:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4915 00000100:00100000:1.0:1783951996.706339:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:89079:x1870605465454848:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783951996.706367:0:26208:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -127 00002000:02000040:1.0:1783951996.706371:0:26208:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1699 to 0x280000401:1825) 00000004:00080000:3.0:1783951996.707837:0:89081:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x47c:0x0] 00000100:00100000:3.0:1783951996.707881:0:89081:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049eab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89081:1870605465454976:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783951996.707937:0:89081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951996.707968:0:89081:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f3969c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783951996.708331:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465454976 00000100:00100000:0.0:1783951996.708347:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465454976 00000100:00100000:0.0:1783951996.708398:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4916 00000100:00100000:0.0:1783951996.708421:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:89081:x1870605465454976:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783951996.708448:0:26203:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -677 00002000:02000040:0.0:1783951996.708452:0:26203:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1149 to 0x2c0000401:1825) 00002000:00010000:1.0:1783951996.718233:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.718247:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007965df6e/0x22c73c7857bb4ca7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718264:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.718268:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.718274:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007965df6e/0x22c73c7857bb4ca7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718292:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007965df6e/0x22c73c7857bb4ca7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718301:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007965df6e/0x22c73c7857bb4ca7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718308:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007965df6e/0x22c73c7857bb4ca7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718337:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.718354:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.718359:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007965df6e/0x22c73c7857bb4ca7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718385:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.718389:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007965df6e/0x22c73c7857bb4ca7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718398:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007965df6e/0x22c73c7857bb4ca7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718412:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007965df6e/0x22c73c7857bb4ca7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718419:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007965df6e/0x22c73c7857bb4ca7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718436:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.718438:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.718439:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.718536:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.718541:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c980d021/0x22c73c7857bb4cae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718549:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.718551:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.718554:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c980d021/0x22c73c7857bb4cae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718562:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c980d021/0x22c73c7857bb4cae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718575:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c980d021/0x22c73c7857bb4cae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718581:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c980d021/0x22c73c7857bb4cae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718837:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.718844:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.718848:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c980d021/0x22c73c7857bb4cae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718855:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aea00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.718858:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c980d021/0x22c73c7857bb4cae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718865:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c980d021/0x22c73c7857bb4cae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718875:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c980d021/0x22c73c7857bb4cae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718881:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c980d021/0x22c73c7857bb4cae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718893:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.718900:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.718901:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.718945:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.718950:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d619b6/0x22c73c7857bb4cb5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718958:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.718961:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.718965:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d619b6/0x22c73c7857bb4cb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718973:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d619b6/0x22c73c7857bb4cb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718979:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d619b6/0x22c73c7857bb4cb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.718986:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d619b6/0x22c73c7857bb4cb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.719000:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.719006:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.719010:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d619b6/0x22c73c7857bb4cb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.719016:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aec00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.719020:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d619b6/0x22c73c7857bb4cb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.719036:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d619b6/0x22c73c7857bb4cb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.719046:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d619b6/0x22c73c7857bb4cb5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.719052:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d619b6/0x22c73c7857bb4cb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.720134:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.720136:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.720138:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.720209:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.720215:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0278cf8/0x22c73c7857bb4cbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.720226:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.720229:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.720235:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0278cf8/0x22c73c7857bb4cbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.720246:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0278cf8/0x22c73c7857bb4cbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.720254:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0278cf8/0x22c73c7857bb4cbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.720268:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0278cf8/0x22c73c7857bb4cbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.720335:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.720385:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.720390:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000380d2e5c/0x22c73c7857bb4cc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.720397:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.720400:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.720404:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000380d2e5c/0x22c73c7857bb4cc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.720412:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000380d2e5c/0x22c73c7857bb4cc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.720420:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000380d2e5c/0x22c73c7857bb4cc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.720427:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000380d2e5c/0x22c73c7857bb4cc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.720842:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951996.720848:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0278cf8/0x22c73c7857bb4cbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.720857:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951996.720861:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0278cf8/0x22c73c7857bb4cbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.720869:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0278cf8/0x22c73c7857bb4cbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.720883:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0278cf8/0x22c73c7857bb4cbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.720891:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0278cf8/0x22c73c7857bb4cbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.720907:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951996.720910:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000380d2e5c/0x22c73c7857bb4cc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.720928:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951996.720930:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000380d2e5c/0x22c73c7857bb4cc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.720937:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000380d2e5c/0x22c73c7857bb4cc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.720946:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000380d2e5c/0x22c73c7857bb4cc3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.720954:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.720955:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.720957:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783951996.721874:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1783951996.721937:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783951996.721944:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000380d2e5c/0x22c73c7857bb4cc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951996.722047:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.722052:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000976bd568/0x22c73c7857bb4cca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722077:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.722080:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.722085:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000976bd568/0x22c73c7857bb4cca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722094:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000976bd568/0x22c73c7857bb4cca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722102:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000976bd568/0x22c73c7857bb4cca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722108:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000976bd568/0x22c73c7857bb4cca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722122:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.722132:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.722136:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000976bd568/0x22c73c7857bb4cca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722142:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.722145:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000976bd568/0x22c73c7857bb4cca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722161:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000976bd568/0x22c73c7857bb4cca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722173:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000976bd568/0x22c73c7857bb4cca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722179:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000976bd568/0x22c73c7857bb4cca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722194:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.722196:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.722197:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.722240:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.722245:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046cf3c2e/0x22c73c7857bb4cd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722252:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.722255:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.722259:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046cf3c2e/0x22c73c7857bb4cd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722266:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046cf3c2e/0x22c73c7857bb4cd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722273:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046cf3c2e/0x22c73c7857bb4cd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722287:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046cf3c2e/0x22c73c7857bb4cd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722300:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.722307:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.722310:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046cf3c2e/0x22c73c7857bb4cd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722316:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.722319:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046cf3c2e/0x22c73c7857bb4cd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722326:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046cf3c2e/0x22c73c7857bb4cd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.722337:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046cf3c2e/0x22c73c7857bb4cd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.722444:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.723134:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046cf3c2e/0x22c73c7857bb4cd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.723152:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.723154:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.723156:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.723217:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.723228:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fce6b19/0x22c73c7857bb4cd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.723236:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.723239:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.723243:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fce6b19/0x22c73c7857bb4cd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.723253:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fce6b19/0x22c73c7857bb4cd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.723260:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fce6b19/0x22c73c7857bb4cd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.723266:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fce6b19/0x22c73c7857bb4cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.723323:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.723422:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.723427:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f28434/0x22c73c7857bb4cdf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.723434:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.723437:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.723440:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f28434/0x22c73c7857bb4cdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.723448:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f28434/0x22c73c7857bb4cdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.723461:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f28434/0x22c73c7857bb4cdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.723467:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f28434/0x22c73c7857bb4cdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.726222:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951996.726236:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fce6b19/0x22c73c7857bb4cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.726249:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951996.726253:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fce6b19/0x22c73c7857bb4cd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.726263:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fce6b19/0x22c73c7857bb4cd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.726302:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fce6b19/0x22c73c7857bb4cd8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.726309:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fce6b19/0x22c73c7857bb4cd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.734200:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951996.734217:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4f28434/0x22c73c7857bb4cdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.734231:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951996.734239:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f28434/0x22c73c7857bb4cdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.734249:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f28434/0x22c73c7857bb4cdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.734270:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4f28434/0x22c73c7857bb4cdf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.734283:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.734285:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.734289:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.734518:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783951996.734526:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f28434/0x22c73c7857bb4cdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951996.734687:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.734694:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb4ce6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734707:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.734711:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.734717:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb4ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734729:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb4ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734737:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb4ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734763:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb4ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734776:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.734816:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.734821:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb4ced lrc: 3/0,1 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734829:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.734832:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.734836:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb4ced lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734844:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb4ced lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734852:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb4ced lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734859:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb4ced lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734874:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951996.734882:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951996.734886:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb4ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734899:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.734902:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb4ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734910:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb4ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734921:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb4ce6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734929:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb4ce6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734942:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.734945:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb4ced lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734950:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644cc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.734954:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb4ced lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734961:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb4ced lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734970:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb4ced lrc: 1/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734982:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb4ced lrc: 0/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.734995:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.734996:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.734998:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.735041:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.735046:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb4cf4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735054:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.735069:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.735073:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb4cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735081:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb4cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735088:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb4cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735094:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb4cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735106:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.735148:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.735153:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4cfb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735161:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.735163:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.735167:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4cfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735176:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4cfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735184:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4cfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735191:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4cfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735203:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951996.735209:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951996.735212:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb4cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735219:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ce00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.735222:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb4cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735241:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb4cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735251:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb4cf4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735258:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb4cf4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735271:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.735274:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4cfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735281:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.735284:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4cfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735292:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4cfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735301:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4cfb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735308:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb4cfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735330:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.735331:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.735333:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.735369:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.735374:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb4d02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735381:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.735384:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.735388:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb4d02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735396:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb4d02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735403:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb4d02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735411:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb4d02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735423:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.735430:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.735433:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb4d02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735448:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.735450:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb4d02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735457:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb4d02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735468:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb4d02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735474:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb4d02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735487:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.735489:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.735490:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.735530:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.735535:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb4d09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735542:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.735545:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.735548:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb4d09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735556:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb4d09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735569:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb4d09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735575:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb4d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735605:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.735612:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.735615:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb4d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735621:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644da00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.735624:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb4d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735630:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb4d09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735640:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb4d09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735646:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb4d09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735657:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.735663:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.735665:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.735705:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.735710:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb4d10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735717:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.735720:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.735724:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb4d10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735731:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb4d10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735738:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb4d10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735745:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb4d10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735757:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.735763:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.735766:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb4d10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735772:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.735774:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb4d10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735790:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb4d10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735799:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb4d10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735805:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb4d10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735817:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.735819:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.735820:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.735861:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.735865:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb4d17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735872:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.735875:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.735879:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb4d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735887:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb4d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735894:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb4d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735906:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb4d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735918:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.735925:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.735928:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb4d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735934:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.735937:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb4d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735945:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb4d17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735955:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb4d17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735963:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb4d17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.735975:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.735977:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.735978:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.736014:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.736024:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb4d1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736032:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.736034:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.736038:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb4d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736047:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb4d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736066:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb4d1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736073:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb4d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736084:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.736091:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.736094:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb4d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736100:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.736103:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb4d1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736109:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb4d1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736127:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb4d1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736133:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb4d1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736146:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736148:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736149:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.736191:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.736196:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb4d25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736204:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.736208:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.736212:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb4d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736220:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb4d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736227:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb4d25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736233:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb4d25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736255:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.736262:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.736265:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb4d25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736272:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.736275:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb4d25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736283:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb4d25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736294:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb4d25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736301:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb4d25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736312:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736314:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736316:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.736354:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.736359:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb4d2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736366:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.736377:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.736380:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb4d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736388:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb4d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736396:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb4d2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736402:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb4d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736414:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.736421:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.736424:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb4d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736431:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.736434:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb4d2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736440:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb4d2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736449:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb4d2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736466:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb4d2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736477:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736479:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736480:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.736520:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.736526:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb4d33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736532:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.736535:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.736539:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb4d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736547:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb4d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736554:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb4d33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736561:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb4d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736573:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.736605:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.736609:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb4d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736616:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644dc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.736618:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb4d33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736625:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb4d33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736635:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb4d33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736641:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb4d33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736652:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736654:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736655:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.736693:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.736698:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb4d3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736705:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.736708:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.736711:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb4d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736730:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb4d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736738:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb4d3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736745:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb4d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736757:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.736764:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.736767:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb4d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736772:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644de00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.736775:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb4d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736783:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb4d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736793:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb4d3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736800:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb4d3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736819:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736821:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736823:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.736866:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.736871:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb4d41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736879:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.736882:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.736885:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb4d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736892:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb4d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736899:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb4d41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736905:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb4d41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736916:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.736922:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.736925:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb4d41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736940:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.736943:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb4d41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736950:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb4d41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736959:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb4d41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736965:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb4d41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.736976:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736977:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.736979:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.737016:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.737021:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb4d48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737027:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.737030:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.737033:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb4d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737040:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb4d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737052:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb4d48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737071:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb4d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737082:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.737088:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.737091:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb4d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737097:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.737099:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb4d48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737107:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb4d48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737116:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb4d48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737121:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb4d48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737133:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737139:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737141:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.737178:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.737183:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb4d4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737191:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.737194:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.737198:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb4d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737206:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb4d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737212:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb4d4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737218:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb4d4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737229:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.737234:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.737238:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb4d4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737243:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.737246:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb4d4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737262:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb4d4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737270:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb4d4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737277:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb4d4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737289:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737290:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737292:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.737329:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.737334:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b28307/0x22c73c7857bb4d56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737340:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.737343:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.737347:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b28307/0x22c73c7857bb4d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737354:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b28307/0x22c73c7857bb4d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737360:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b28307/0x22c73c7857bb4d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737372:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b28307/0x22c73c7857bb4d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737382:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.737389:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.737391:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b28307/0x22c73c7857bb4d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737397:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585a200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.737400:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b28307/0x22c73c7857bb4d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737407:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b28307/0x22c73c7857bb4d56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737416:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b28307/0x22c73c7857bb4d56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737422:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b28307/0x22c73c7857bb4d56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737434:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737435:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737437:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.737473:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.737483:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c1ce31/0x22c73c7857bb4d5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737490:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.737492:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.737496:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c1ce31/0x22c73c7857bb4d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737503:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0c1ce31/0x22c73c7857bb4d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737511:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0c1ce31/0x22c73c7857bb4d5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737517:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0c1ce31/0x22c73c7857bb4d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737528:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.737533:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.737536:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0c1ce31/0x22c73c7857bb4d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737542:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585a800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.737545:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c1ce31/0x22c73c7857bb4d5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737551:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0c1ce31/0x22c73c7857bb4d5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737567:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0c1ce31/0x22c73c7857bb4d5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737574:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0c1ce31/0x22c73c7857bb4d5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737605:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737608:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737609:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.737646:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.737650:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001f300a/0x22c73c7857bb4d64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737657:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.737660:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.737664:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000001f300a/0x22c73c7857bb4d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737671:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000001f300a/0x22c73c7857bb4d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737677:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001f300a/0x22c73c7857bb4d64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737684:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000001f300a/0x22c73c7857bb4d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737705:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.737712:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.737716:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000001f300a/0x22c73c7857bb4d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737721:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585be00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.737725:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000001f300a/0x22c73c7857bb4d64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737732:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000001f300a/0x22c73c7857bb4d64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737742:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000001f300a/0x22c73c7857bb4d64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737749:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000001f300a/0x22c73c7857bb4d64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737761:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737762:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737764:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.737802:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.737807:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011c58bd/0x22c73c7857bb4d6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737814:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.737822:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.737826:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011c58bd/0x22c73c7857bb4d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737835:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011c58bd/0x22c73c7857bb4d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737842:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011c58bd/0x22c73c7857bb4d6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737848:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011c58bd/0x22c73c7857bb4d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737860:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.737866:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.737870:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011c58bd/0x22c73c7857bb4d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737876:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585ba00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.737879:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011c58bd/0x22c73c7857bb4d6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737885:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011c58bd/0x22c73c7857bb4d6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737895:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011c58bd/0x22c73c7857bb4d6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737912:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011c58bd/0x22c73c7857bb4d6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.737924:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737926:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.737927:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.737964:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951996.738536:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.738545:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.738550:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.741903:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047cf8f2e/0x22c73c7857bb4d72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.741936:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.741941:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.741948:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047cf8f2e/0x22c73c7857bb4d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.741964:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047cf8f2e/0x22c73c7857bb4d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.741976:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047cf8f2e/0x22c73c7857bb4d72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.741982:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047cf8f2e/0x22c73c7857bb4d72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.742068:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.742201:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.742207:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb7022d/0x22c73c7857bb4d79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.742215:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.742218:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.742222:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb7022d/0x22c73c7857bb4d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.742229:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbb7022d/0x22c73c7857bb4d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.742237:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb7022d/0x22c73c7857bb4d79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.742244:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb7022d/0x22c73c7857bb4d79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.742279:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783951996.742287:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047cf8f2e/0x22c73c7857bb4d72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.742295:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585a000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951996.742300:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047cf8f2e/0x22c73c7857bb4d72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.742308:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047cf8f2e/0x22c73c7857bb4d72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.742323:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047cf8f2e/0x22c73c7857bb4d72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.742331:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047cf8f2e/0x22c73c7857bb4d72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.742370:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951996.742373:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbb7022d/0x22c73c7857bb4d79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.742379:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585ae00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951996.742382:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb7022d/0x22c73c7857bb4d79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.742388:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb7022d/0x22c73c7857bb4d79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.742410:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbb7022d/0x22c73c7857bb4d79 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.742417:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.742419:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.742421:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.745770:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783951996.745786:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbb7022d/0x22c73c7857bb4d79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951996.745923:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.745929:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000542040d1/0x22c73c7857bb4d80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.745941:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.745956:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.745962:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000542040d1/0x22c73c7857bb4d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.745975:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000542040d1/0x22c73c7857bb4d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.745984:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000542040d1/0x22c73c7857bb4d80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.745991:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000542040d1/0x22c73c7857bb4d80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.752889:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951996.752903:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000542040d1/0x22c73c7857bb4d80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.752917:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585b000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951996.752922:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000542040d1/0x22c73c7857bb4d80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.752932:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000542040d1/0x22c73c7857bb4d80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.752953:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000542040d1/0x22c73c7857bb4d80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753023:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.753026:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.753028:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951996.753072:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951996.753078:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb4d87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753100:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:3.0:1783951996.753105:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951996.753111:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb4d87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753125:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb4d87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753135:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb4d87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753142:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb4d87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753161:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783951996.753174:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783951996.753181:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb4d87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.753191:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783951996.753195:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb4d87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.753204:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb4d87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.753217:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb4d87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.753237:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb4d87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.753257:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951996.753260:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783951996.753262:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783951996.753617:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783951996.753623:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb4d8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753631:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:3.0:1783951996.753634:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783951996.753638:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb4d8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753647:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb4d8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753665:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb4d8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753672:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb4d8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.753688:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.753818:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.753826:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000542040d1/0x22c73c7857bb4d80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.754410:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783951996.754416:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb4d8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.754423:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783951996.754427:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb4d8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.754435:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb4d8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.754446:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb4d8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.754454:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb4d8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.754468:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.754477:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.754478:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783951996.755131:0:26208:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1698 00000100:00100000:1.0:1783951996.755227:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:89079:x1870605465454848:12345-0@lo:5:osp-pre-0-0.0 Request processed in 48887us (49355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951996.755236:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4915 00000100:00100000:3.0:1783951996.756612:0:89079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89079:1870605465454848:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783951996.756631:0:89079:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x721:0x0] from OST, last_created [0x280000401:0x721:0x0]last_used is [0x280000401:0x6a2:0x0] 00000100:00100000:3.0:1783951996.756716:0:89079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89079:1870605465455232:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783951996.756773:0:89079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951996.756797:0:89079:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951996.756904:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465455104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783951996.756931:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951996.756973:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465455232 00000100:00100000:3.0:1783951996.756979:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465455232 00000100:00100000:3.0:1783951996.757021:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4917 00000100:00100000:3.0:1783951996.757030:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:89079:x1870605465455232:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783951996.757079:0:26200:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1826 00000100:00100000:3.0:1783951996.758510:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:89079:x1870605465455232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1478us (1734us total) trans 4294968952 rc 0/0 00000100:00100000:3.0:1783951996.758520:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4917 00000100:00100000:3.0:1783951996.758556:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465455104 00000100:00100000:3.0:1783951996.758562:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465455104 00000100:00100000:3.0:1783951996.758613:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:3.0:1783951996.758621:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465455104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783951996.758640:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951996.758673:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465455104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951996.758679:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:3.0:1783951996.758715:0:89079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd42a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89079:1870605465455232:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783951996.758737:0:89079:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x721:0x0]-[0x280000401:0x741:0x0] 00000100:00100000:3.0:1783951996.758769:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465455104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783951996.759150:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.760537:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.760548:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040f422f7/0x22c73c7857bb4d95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760564:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.760569:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.760583:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040f422f7/0x22c73c7857bb4d95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760614:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040f422f7/0x22c73c7857bb4d95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760624:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040f422f7/0x22c73c7857bb4d95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760631:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040f422f7/0x22c73c7857bb4d95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760651:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.760707:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.760713:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdd1727c/0x22c73c7857bb4d9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760720:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.760723:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.760727:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdd1727c/0x22c73c7857bb4d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760735:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdd1727c/0x22c73c7857bb4d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760743:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdd1727c/0x22c73c7857bb4d9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760773:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdd1727c/0x22c73c7857bb4d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760790:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951996.760799:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951996.760805:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040f422f7/0x22c73c7857bb4d95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760812:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585b600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.760815:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040f422f7/0x22c73c7857bb4d95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760823:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040f422f7/0x22c73c7857bb4d95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760840:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040f422f7/0x22c73c7857bb4d95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760847:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040f422f7/0x22c73c7857bb4d95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760864:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.760868:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdd1727c/0x22c73c7857bb4d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760883:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585bc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.760887:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdd1727c/0x22c73c7857bb4d9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760894:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdd1727c/0x22c73c7857bb4d9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760904:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdd1727c/0x22c73c7857bb4d9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760911:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdd1727c/0x22c73c7857bb4d9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760923:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.760925:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.760927:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.760969:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.760974:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053ed2a6b/0x22c73c7857bb4da3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760982:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.760984:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.760988:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053ed2a6b/0x22c73c7857bb4da3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.760995:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053ed2a6b/0x22c73c7857bb4da3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761009:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053ed2a6b/0x22c73c7857bb4da3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761016:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053ed2a6b/0x22c73c7857bb4da3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761029:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.761079:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.761084:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abce8103/0x22c73c7857bb4daa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761091:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.761094:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.761097:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abce8103/0x22c73c7857bb4daa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761106:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abce8103/0x22c73c7857bb4daa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761113:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abce8103/0x22c73c7857bb4daa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761121:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abce8103/0x22c73c7857bb4daa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761144:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951996.761152:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951996.761156:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053ed2a6b/0x22c73c7857bb4da3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761163:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585a600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.761166:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053ed2a6b/0x22c73c7857bb4da3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761174:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053ed2a6b/0x22c73c7857bb4da3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761185:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053ed2a6b/0x22c73c7857bb4da3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761192:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053ed2a6b/0x22c73c7857bb4da3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761204:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.761208:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abce8103/0x22c73c7857bb4daa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761214:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585aa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.761217:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abce8103/0x22c73c7857bb4daa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761235:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abce8103/0x22c73c7857bb4daa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761245:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abce8103/0x22c73c7857bb4daa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761252:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abce8103/0x22c73c7857bb4daa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761264:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.761266:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.761268:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.761309:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.761314:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5f3dfe8/0x22c73c7857bb4db1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761322:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.761325:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.761328:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f3dfe8/0x22c73c7857bb4db1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761348:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5f3dfe8/0x22c73c7857bb4db1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761357:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5f3dfe8/0x22c73c7857bb4db1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761370:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f3dfe8/0x22c73c7857bb4db1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761384:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.761391:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.761394:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5f3dfe8/0x22c73c7857bb4db1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761400:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585ac00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.761403:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5f3dfe8/0x22c73c7857bb4db1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761411:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5f3dfe8/0x22c73c7857bb4db1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761421:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5f3dfe8/0x22c73c7857bb4db1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761428:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5f3dfe8/0x22c73c7857bb4db1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761440:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.761442:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.761444:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.761483:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.761495:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7dada0d/0x22c73c7857bb4db8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761503:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.761506:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.761510:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7dada0d/0x22c73c7857bb4db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761519:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7dada0d/0x22c73c7857bb4db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761527:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7dada0d/0x22c73c7857bb4db8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761534:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7dada0d/0x22c73c7857bb4db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761547:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.761554:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.761557:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7dada0d/0x22c73c7857bb4db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761563:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585b400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.761567:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7dada0d/0x22c73c7857bb4db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761574:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7dada0d/0x22c73c7857bb4db8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761609:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7dada0d/0x22c73c7857bb4db8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761618:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7dada0d/0x22c73c7857bb4db8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761632:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.761634:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.761636:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.761678:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.761684:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ecb189/0x22c73c7857bb4dbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761691:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.761694:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.761697:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ecb189/0x22c73c7857bb4dbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761705:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045ecb189/0x22c73c7857bb4dbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761711:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ecb189/0x22c73c7857bb4dbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761719:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045ecb189/0x22c73c7857bb4dbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761742:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.761748:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.761752:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045ecb189/0x22c73c7857bb4dbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761759:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585b200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.761762:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ecb189/0x22c73c7857bb4dbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761769:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ecb189/0x22c73c7857bb4dbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761778:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045ecb189/0x22c73c7857bb4dbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761784:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045ecb189/0x22c73c7857bb4dbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761797:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.761798:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.761800:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.761841:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.761846:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2db47b4/0x22c73c7857bb4dc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761853:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.761861:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.761865:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2db47b4/0x22c73c7857bb4dc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761874:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2db47b4/0x22c73c7857bb4dc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761881:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2db47b4/0x22c73c7857bb4dc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761888:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2db47b4/0x22c73c7857bb4dc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761900:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.761906:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.761910:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2db47b4/0x22c73c7857bb4dc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761917:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585a400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.761920:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2db47b4/0x22c73c7857bb4dc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761927:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2db47b4/0x22c73c7857bb4dc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761936:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2db47b4/0x22c73c7857bb4dc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761953:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2db47b4/0x22c73c7857bb4dc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.761966:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.761967:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.761969:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.762010:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.762015:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a484fdf/0x22c73c7857bb4dcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762023:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.762026:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.762030:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a484fdf/0x22c73c7857bb4dcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762039:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a484fdf/0x22c73c7857bb4dcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762045:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a484fdf/0x22c73c7857bb4dcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762051:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a484fdf/0x22c73c7857bb4dcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762073:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.762084:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.762087:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a484fdf/0x22c73c7857bb4dcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762093:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b16585b800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.762096:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a484fdf/0x22c73c7857bb4dcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762103:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a484fdf/0x22c73c7857bb4dcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762112:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a484fdf/0x22c73c7857bb4dcd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762118:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a484fdf/0x22c73c7857bb4dcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762129:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762131:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762133:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.762175:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.762180:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a3e279b/0x22c73c7857bb4dd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762188:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.762191:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.762194:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a3e279b/0x22c73c7857bb4dd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762212:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a3e279b/0x22c73c7857bb4dd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762219:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a3e279b/0x22c73c7857bb4dd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762225:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a3e279b/0x22c73c7857bb4dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762235:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.762242:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.762245:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a3e279b/0x22c73c7857bb4dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762251:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.762254:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a3e279b/0x22c73c7857bb4dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762261:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a3e279b/0x22c73c7857bb4dd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762270:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a3e279b/0x22c73c7857bb4dd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762276:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a3e279b/0x22c73c7857bb4dd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762293:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762295:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762297:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.762334:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.762339:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f580c46/0x22c73c7857bb4ddb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762346:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.762348:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.762352:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f580c46/0x22c73c7857bb4ddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762359:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f580c46/0x22c73c7857bb4ddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762366:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f580c46/0x22c73c7857bb4ddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762372:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f580c46/0x22c73c7857bb4ddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762384:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.762390:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.762393:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f580c46/0x22c73c7857bb4ddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762409:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499ca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.762412:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f580c46/0x22c73c7857bb4ddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762421:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f580c46/0x22c73c7857bb4ddb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762431:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f580c46/0x22c73c7857bb4ddb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762438:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f580c46/0x22c73c7857bb4ddb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762450:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762451:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762453:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.762490:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.762495:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1484712/0x22c73c7857bb4de2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762502:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.762505:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.762509:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1484712/0x22c73c7857bb4de2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762517:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1484712/0x22c73c7857bb4de2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762531:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1484712/0x22c73c7857bb4de2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762538:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1484712/0x22c73c7857bb4de2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762550:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.762556:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.762559:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1484712/0x22c73c7857bb4de2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762565:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.762568:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1484712/0x22c73c7857bb4de2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762575:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1484712/0x22c73c7857bb4de2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762584:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1484712/0x22c73c7857bb4de2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762611:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1484712/0x22c73c7857bb4de2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762623:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762630:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762632:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.762673:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.762677:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc62194c/0x22c73c7857bb4de9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762685:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.762688:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.762691:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc62194c/0x22c73c7857bb4de9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762702:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc62194c/0x22c73c7857bb4de9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762709:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc62194c/0x22c73c7857bb4de9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762716:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc62194c/0x22c73c7857bb4de9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762728:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.762734:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.762737:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc62194c/0x22c73c7857bb4de9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762744:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.762747:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc62194c/0x22c73c7857bb4de9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762764:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc62194c/0x22c73c7857bb4de9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762774:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc62194c/0x22c73c7857bb4de9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762781:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc62194c/0x22c73c7857bb4de9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762793:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762795:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762797:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.762836:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.762840:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b8cec9/0x22c73c7857bb4df0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762847:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.762850:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.762854:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074b8cec9/0x22c73c7857bb4df0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762862:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074b8cec9/0x22c73c7857bb4df0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762869:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b8cec9/0x22c73c7857bb4df0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762882:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074b8cec9/0x22c73c7857bb4df0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762895:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.762901:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.762905:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074b8cec9/0x22c73c7857bb4df0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762911:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499da00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.762914:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b8cec9/0x22c73c7857bb4df0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762921:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b8cec9/0x22c73c7857bb4df0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762931:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074b8cec9/0x22c73c7857bb4df0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762938:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074b8cec9/0x22c73c7857bb4df0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.762950:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762951:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.762953:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.762993:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.763004:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000379f1d31/0x22c73c7857bb4df7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763011:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.763013:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.763017:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000379f1d31/0x22c73c7857bb4df7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763025:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000379f1d31/0x22c73c7857bb4df7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763033:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000379f1d31/0x22c73c7857bb4df7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763039:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000379f1d31/0x22c73c7857bb4df7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763052:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.763070:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.763073:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000379f1d31/0x22c73c7857bb4df7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763079:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.763082:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000379f1d31/0x22c73c7857bb4df7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763088:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000379f1d31/0x22c73c7857bb4df7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763104:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000379f1d31/0x22c73c7857bb4df7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763110:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000379f1d31/0x22c73c7857bb4df7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763121:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763123:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763124:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.763162:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.763166:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcf9d369/0x22c73c7857bb4dfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763174:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.763177:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.763181:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcf9d369/0x22c73c7857bb4dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763189:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcf9d369/0x22c73c7857bb4dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763196:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcf9d369/0x22c73c7857bb4dfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763203:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcf9d369/0x22c73c7857bb4dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763224:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.763231:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.763234:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcf9d369/0x22c73c7857bb4dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763240:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.763243:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcf9d369/0x22c73c7857bb4dfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763250:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcf9d369/0x22c73c7857bb4dfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763259:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcf9d369/0x22c73c7857bb4dfe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763265:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcf9d369/0x22c73c7857bb4dfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763276:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763278:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763279:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.763319:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.763324:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a944d7bb/0x22c73c7857bb4e05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763331:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.763339:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.763343:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a944d7bb/0x22c73c7857bb4e05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763352:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a944d7bb/0x22c73c7857bb4e05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763360:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a944d7bb/0x22c73c7857bb4e05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763367:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a944d7bb/0x22c73c7857bb4e05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763379:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.763386:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.763389:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a944d7bb/0x22c73c7857bb4e05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763395:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.763399:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a944d7bb/0x22c73c7857bb4e05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763407:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a944d7bb/0x22c73c7857bb4e05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763417:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a944d7bb/0x22c73c7857bb4e05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763444:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a944d7bb/0x22c73c7857bb4e05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763457:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763458:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763460:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.763499:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.763504:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baa43b5f/0x22c73c7857bb4e0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763511:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.763514:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.763518:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baa43b5f/0x22c73c7857bb4e0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763525:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baa43b5f/0x22c73c7857bb4e0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763533:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baa43b5f/0x22c73c7857bb4e0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763540:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baa43b5f/0x22c73c7857bb4e0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763552:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.763563:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.763567:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baa43b5f/0x22c73c7857bb4e0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763573:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.763576:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baa43b5f/0x22c73c7857bb4e0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763582:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baa43b5f/0x22c73c7857bb4e0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763616:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baa43b5f/0x22c73c7857bb4e0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763622:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baa43b5f/0x22c73c7857bb4e0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763634:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763635:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763637:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.763685:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.763690:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054172b4c/0x22c73c7857bb4e13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763698:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.763701:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.763705:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054172b4c/0x22c73c7857bb4e13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763723:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054172b4c/0x22c73c7857bb4e13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763731:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054172b4c/0x22c73c7857bb4e13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763737:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054172b4c/0x22c73c7857bb4e13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763749:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.763755:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.763758:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054172b4c/0x22c73c7857bb4e13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763763:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499cc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.763766:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054172b4c/0x22c73c7857bb4e13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763773:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054172b4c/0x22c73c7857bb4e13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763782:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054172b4c/0x22c73c7857bb4e13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763789:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054172b4c/0x22c73c7857bb4e13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763807:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763808:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763810:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.763853:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.763858:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ab6a4ca/0x22c73c7857bb4e1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763865:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.763868:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.763872:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ab6a4ca/0x22c73c7857bb4e1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763880:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ab6a4ca/0x22c73c7857bb4e1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763886:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ab6a4ca/0x22c73c7857bb4e1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763892:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ab6a4ca/0x22c73c7857bb4e1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763904:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783951996.763909:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.763912:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ab6a4ca/0x22c73c7857bb4e1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763927:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499de00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.763930:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ab6a4ca/0x22c73c7857bb4e1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763937:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ab6a4ca/0x22c73c7857bb4e1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763946:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ab6a4ca/0x22c73c7857bb4e1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763953:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ab6a4ca/0x22c73c7857bb4e1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.763967:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763968:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.763970:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.764012:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.764018:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026aafc91/0x22c73c7857bb4e21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.764025:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.764027:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.764031:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026aafc91/0x22c73c7857bb4e21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.764039:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026aafc91/0x22c73c7857bb4e21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.764052:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026aafc91/0x22c73c7857bb4e21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.768696:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783951996.768707:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783951996.773849:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1783951996.773957:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026aafc91/0x22c73c7857bb4e21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.773999:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.774119:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.774125:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f0d608f/0x22c73c7857bb4e28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774137:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.774142:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.774148:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f0d608f/0x22c73c7857bb4e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774172:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f0d608f/0x22c73c7857bb4e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774182:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f0d608f/0x22c73c7857bb4e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774189:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f0d608f/0x22c73c7857bb4e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774219:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951996.774229:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951996.774236:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026aafc91/0x22c73c7857bb4e21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774243:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499ce00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.774247:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026aafc91/0x22c73c7857bb4e21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774256:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026aafc91/0x22c73c7857bb4e21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774271:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026aafc91/0x22c73c7857bb4e21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774278:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026aafc91/0x22c73c7857bb4e21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774297:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.774300:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f0d608f/0x22c73c7857bb4e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774307:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.774309:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f0d608f/0x22c73c7857bb4e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774329:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f0d608f/0x22c73c7857bb4e28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.774386:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.774649:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f0d608f/0x22c73c7857bb4e28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774659:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f0d608f/0x22c73c7857bb4e28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774674:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.774676:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.774678:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.774729:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.774734:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e9fd24e/0x22c73c7857bb4e2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774742:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.774745:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.774749:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e9fd24e/0x22c73c7857bb4e2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774832:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e9fd24e/0x22c73c7857bb4e2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774841:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e9fd24e/0x22c73c7857bb4e2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774854:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e9fd24e/0x22c73c7857bb4e2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774870:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.774911:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.774916:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babc0710/0x22c73c7857bb4e36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774924:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.774928:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.774932:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000babc0710/0x22c73c7857bb4e36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774939:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000babc0710/0x22c73c7857bb4e36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774947:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000babc0710/0x22c73c7857bb4e36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774954:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000babc0710/0x22c73c7857bb4e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.774965:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783951996.775000:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.775005:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebfaa46d/0x22c73c7857bb4e3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775017:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.775020:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.775024:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebfaa46d/0x22c73c7857bb4e3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775031:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebfaa46d/0x22c73c7857bb4e3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775038:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebfaa46d/0x22c73c7857bb4e3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775044:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebfaa46d/0x22c73c7857bb4e3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775068:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783951996.775076:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783951996.775083:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e9fd24e/0x22c73c7857bb4e2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775093:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951996.775097:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e9fd24e/0x22c73c7857bb4e2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775107:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e9fd24e/0x22c73c7857bb4e2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783951996.775109:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.775121:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb4e44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775125:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e9fd24e/0x22c73c7857bb4e2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775132:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.775139:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783951996.775139:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e9fd24e/0x22c73c7857bb4e2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775148:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb4e44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775161:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783951996.775165:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000babc0710/0x22c73c7857bb4e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775172:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499dc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951996.775182:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000babc0710/0x22c73c7857bb4e36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775190:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000babc0710/0x22c73c7857bb4e36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775200:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000babc0710/0x22c73c7857bb4e36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775206:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000babc0710/0x22c73c7857bb4e36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775219:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951996.775224:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebfaa46d/0x22c73c7857bb4e3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775227:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb4e44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775246:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951996.775251:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebfaa46d/0x22c73c7857bb4e3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775256:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb4e44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775266:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebfaa46d/0x22c73c7857bb4e3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775269:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb4e44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775284:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebfaa46d/0x22c73c7857bb4e3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775292:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783951996.775293:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebfaa46d/0x22c73c7857bb4e3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775301:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.775306:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb4e44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775313:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.775318:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb4e44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775328:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb4e44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.775333:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951996.775336:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951996.775339:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.775401:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb4e44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775409:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb4e44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775422:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.775429:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.775431:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.775474:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.775479:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb4e4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775485:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.775488:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.775491:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb4e4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775499:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb4e4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775506:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb4e4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775512:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb4e4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775530:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.775565:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.775569:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb4e52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775576:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.775578:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.775581:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb4e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775618:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb4e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775625:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb4e52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775631:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb4e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775642:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951996.775649:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951996.775652:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb4e4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775657:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.775660:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb4e4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775668:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb4e4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775678:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb4e4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775684:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb4e4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775705:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783951996.775708:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb4e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775715:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.775718:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb4e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775724:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb4e52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775734:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb4e52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775742:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb4e52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783951996.775851:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.775877:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.775880:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.775881:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951996.775909:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783951996.775924:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.775930:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb4e59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775937:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.775946:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.775950:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb4e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775959:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb4e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775967:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb4e59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775974:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb4e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.775995:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783951996.776033:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783951996.776038:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb4e60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.776046:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=3711s v=(0 0) 00010000:00010000:1.0:1783951996.776048:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783951996.776052:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb4e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.776071:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb4e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.776079:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb4e60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.776092:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb4e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.776103:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783951996.776111:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783951996.776114:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb4e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.776121:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783951996.776124:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb4e59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.776131:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb4e59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.776141:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb4e59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783951996.776148:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb4e59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.776266:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783951996.776272:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb4e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.776280:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783951996.776284:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb4e60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.776293:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb4e60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.776316:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb4e60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783951996.776325:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb4e60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783951996.777299:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951996.786274:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951996.786279:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783951996.786282:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.787446:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.787451:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783951996.787453:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783951996.788314:0:26203:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1148 00000100:00100000:3.0:1783951996.788789:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:89081:x1870605465454976:12345-0@lo:5:osp-pre-1-0.0 Request processed in 80379us (80847us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951996.788801:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4916 00000100:00100000:1.0:1783951996.792081:0:89081:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049eab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89081:1870605465454976:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783951996.792114:0:89081:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x721:0x0] from OST, last_created [0x2c0000401:0x721:0x0]last_used is [0x2c0000401:0x47c:0x0] 00000100:00100000:3.0:1783951996.792298:0:89081:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89081:1870605465455488:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783951996.792373:0:89081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951996.792399:0:89081:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783951996.792418:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465455360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783951996.792442:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783951996.792480:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465455360 00000100:00100000:3.0:1783951996.792486:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465455360 00000100:00100000:3.0:1783951996.792531:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:3.0:1783951996.792539:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465455360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783951996.792568:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783951996.792627:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465455360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951996.792635:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:3.0:1783951996.792671:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465455360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783951996.793655:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465455488 00000100:00100000:1.0:1783951996.793663:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465455488 00000100:00100000:1.0:1783951996.793700:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4918 00000100:00100000:1.0:1783951996.793708:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:89081:x1870605465455488:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783951996.793742:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1826 00000100:00100000:1.0:1783951996.796189:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:89081:x1870605465455488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2477us (3812us total) trans 4294968952 rc 0/0 00000100:00100000:1.0:1783951996.796202:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4918 00000100:00100000:3.0:1783951996.797032:0:89081:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89081:1870605465455488:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783951996.797049:0:89081:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x721:0x0]-[0x2c0000401:0x741:0x0] 00000001:00100000:3.0:1783951997.026397:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783951997.428491:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951997.428544:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783951997.428575:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447716992 00000100:00100000:2.0:1783951997.428609:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447716992 00000100:00100000:2.0:1783951997.428656:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00100000:2.0:1783951997.428666:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447716992:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783951997.428754:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447716992:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783951997.428763:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00100000:3.0:1783951997.429556:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447717120 00000100:00100000:3.0:1783951997.429564:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447717120 00000100:00100000:3.0:1783951997.429649:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1184 00000100:00100000:3.0:1783951997.429657:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447717120:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783951997.429705:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447717120:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 49us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783951997.429711:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1184 00000100:00080000:2.0:1783951997.437526:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783951997.477179:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783951997.517498:0:89399:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951997.517717:0:89399:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783951998.496748:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783951998.643074:0:89449:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783951998.643479:0:89449:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783951999.520821:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783951999.585086:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465455616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783951999.585158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783951999.585299:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465455744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783951999.585604:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783951999.598388:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465455616 00000100:00100000:1.0:1783951999.598405:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465455616 00000100:00100000:1.0:1783951999.598505:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465455744 00000100:00100000:1.0:1783951999.598517:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465455744 00000100:00100000:1.0:1783951999.598539:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1783951999.598551:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465455616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783951999.598601:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951999.598692:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465455616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (13533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951999.598700:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1783951999.598716:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1783951999.598723:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465455744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783951999.598742:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783951999.598774:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465455744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (13170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783951999.598779:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1783951999.598832:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465455616:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783951999.599279:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783951999.599285:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783951999.599316:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465455744:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783952000.546276:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952000.828363:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952000.828502:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447717248 00000100:00100000:0.0:1783952000.828521:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447717248 00000100:00100000:0.0:1783952000.828646:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1206 00000100:00100000:0.0:1783952000.828656:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+7:68228:x1870605447717248:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1783952000.828682:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952000.828708:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4e67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a22e expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952000.828770:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4e6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952000.828785:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952000.828798:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952000.828850:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783952000.828855:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:3.0:1783952000.828898:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1783952000.828898:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952000.828932:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4e67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a22e expref: 9 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952000.828951:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a22e expref: 8 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952000.828979:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b164ef8000) 00010000:00010000:0.0:1783952000.828983:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783952000.828986:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd800, rc 0) 00000100:00100000:0.0:1783952000.829056:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+8:68228:x1870605447717248:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 402us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952000.829064:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1206 00000100:00100000:3.0:1783952000.845000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952000.845131:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447717376 00000100:00100000:1.0:1783952000.845146:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447717376 00000100:00100000:1.0:1783952000.845213:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1207 00000100:00100000:1.0:1783952000.845222:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+8:68228:x1870605447717376:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:1.0:1783952000.845259:0:67035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00000100:00100000:1.0:1783952000.845338:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+8:68228:x1870605447717376:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 117us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952000.845345:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1207 00000100:00100000:3.0:1783952000.852556:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952000.852913:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447717504 00000100:00100000:0.0:1783952000.852927:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447717504 00000100:00100000:0.0:1783952000.853039:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1208 00000100:00100000:0.0:1783952000.853054:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:68228:x1870605447717504:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:0.0:1783952000.853115:0:83761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783952000.853213:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:68228:x1870605447717504:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 164us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952000.853222:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1208 00000100:00080000:3.0:1783952000.853360:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952000.858336:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952000.858912:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447717632 00000100:00100000:0.0:1783952000.858930:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447717632 00000100:00100000:0.0:1783952000.858991:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4919 00000100:00100000:0.0:1783952000.859003:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2397:x1870605447717632:12345-192.168.202.48@tcp:8:lfs.0 00010000:00080000:0.0:1783952000.859059:0:26202:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp t0 exp 0000000000000000 cur 3715 last 0 00000020:00000080:0.0:1783952000.859097:0:26202:0:(genops.c:1406:class_connect()) connect: client 458183b2-4c6d-478c-9fed-a955779e6611, cookie 0x22c73c7857bb4e75 00002000:00100000:0.0:1783952000.859113:0:26202:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 458183b2-4c6d-478c-9fed-a955779e6611/ffff97b04965f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783952000.859127:0:26202:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783952000.859216:0:26202:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783952000.859258:0:26202:0:(import.c:65:import_set_state_nolock()) ffff97b04965f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783952000.859370:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447717632:12345-192.168.202.48@tcp:8:lfs.0 Request processed in 368us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952000.859379:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4919 00000100:00100000:1.0:1783952000.865617:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952000.865896:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447717760 00000100:00100000:3.0:1783952000.865906:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447717760 00000100:00100000:3.0:1783952000.865976:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2101 00000100:00100000:3.0:1783952000.865986:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:68228:x1870605447717760:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783952000.866012:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952000.866083:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:68228:x1870605447717760:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 99us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952000.866091:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2101 00000100:00080000:2.0:1783952000.866153:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952000.875937:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952000.883664:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447717888 00000100:00100000:0.0:1783952000.883682:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447717888 00000100:00100000:0.0:1783952000.883759:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4920 00000100:00100000:0.0:1783952000.883769:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2397:x1870605447717888:12345-192.168.202.48@tcp:8:lfs.0 00010000:00080000:0.0:1783952000.883806:0:26201:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp t0 exp 0000000000000000 cur 3715 last 0 00000020:00000080:0.0:1783952000.883840:0:26201:0:(genops.c:1406:class_connect()) connect: client 458183b2-4c6d-478c-9fed-a955779e6611, cookie 0x22c73c7857bb4e7c 00002000:00100000:0.0:1783952000.883855:0:26201:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 458183b2-4c6d-478c-9fed-a955779e6611/ffff97b142e2a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783952000.883869:0:26201:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783952000.883952:0:26201:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783952000.883988:0:26201:0:(import.c:65:import_set_state_nolock()) ffff97b150d63000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783952000.884084:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447717888:12345-192.168.202.48@tcp:8:lfs.0 Request processed in 315us (8157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952000.884093:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4920 00000100:00100000:1.0:1783952000.891060:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952000.891148:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447718016 00000100:00100000:3.0:1783952000.891159:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447718016 00000100:00100000:3.0:1783952000.891246:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2102 00000100:00100000:3.0:1783952000.891256:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:68228:x1870605447718016:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783952000.891285:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952000.891366:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:68228:x1870605447718016:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 111us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952000.891374:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2102 00000100:00080000:2.0:1783952000.891521:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783952001.568836:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952001.632834:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952001.632834:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465456000:0@lo:400:kworker.0 00000100:00100000:3.0:1783952001.632854:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465455872:0@lo:400:kworker.0 00000100:00100000:1.0:1783952001.632975:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465456128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952001.639272:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952001.639492:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465455872 00000100:00100000:2.0:1783952001.639501:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465455872 00000100:00100000:2.0:1783952001.639554:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783952001.639563:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465455872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952001.639657:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465455872:12345-0@lo:400:kworker.0 Request processed in 95us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952001.639665:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783952001.641346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952001.641385:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465455872:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.641394:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465456000 00000100:00100000:0.0:1783952001.641401:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465456000 00000100:00100000:2.0:1783952001.641431:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465456384:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.641452:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1783952001.641462:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465456000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952001.641483:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952001.641514:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465456896:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.641519:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465456000:12345-0@lo:400:kworker.0 Request processed in 58us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.641527:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1783952001.641543:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952001.641563:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465457408:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.641569:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465456384 00000100:00100000:0.0:1783952001.641574:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465456384 00000100:00100000:2.0:1783952001.641615:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952001.641621:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1783952001.641629:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465456384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952001.641658:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465456896 00000100:00100000:2.0:1783952001.641664:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465456896 00000100:00100000:0.0:1783952001.641670:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465456384:12345-0@lo:400:kworker.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.641677:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1783952001.641698:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465457408 00000100:00100000:2.0:1783952001.641702:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465457408 00000100:00100000:0.0:1783952001.641718:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465456000:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.641735:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465456512:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.641756:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952001.641775:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465456512 00000100:00100000:0.0:1783952001.641778:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465456512 00000100:00100000:0.0:1783952001.641800:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1783952001.641805:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465456512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.641834:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465456512:12345-0@lo:400:kworker.0 Request processed in 28us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.641840:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1783952001.641867:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465456512:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.641873:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465457024:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.641895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952001.641911:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465457024 00000100:00100000:0.0:1783952001.641914:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465457024 00000100:00100000:0.0:1783952001.641934:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1783952001.641939:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465457024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.641968:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465457024:12345-0@lo:400:kworker.0 Request processed in 29us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.641981:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1783952001.642027:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465457024:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.642033:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465457536:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.642059:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952001.642076:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465457536 00000100:00100000:0.0:1783952001.642079:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465457536 00000100:00100000:0.0:1783952001.642100:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1783952001.642107:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465457536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.642153:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465457536:12345-0@lo:400:kworker.0 Request processed in 47us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.642159:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1783952001.642538:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:2.0:1783952001.642548:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465456896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952001.642586:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465456896:12345-0@lo:400:kworker.0 Request processed in 40us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952001.642624:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:2.0:1783952001.642638:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:2.0:1783952001.642644:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465457408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952001.642674:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465457408:12345-0@lo:400:kworker.0 Request processed in 31us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952001.642679:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:0.0:1783952001.643101:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465457536:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.643135:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783952001.643143:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465456640:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.643186:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952001.643211:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465456640 00000100:00100000:0.0:1783952001.643215:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465456640 00000100:00100000:0.0:1783952001.643243:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:0.0:1783952001.643249:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465456640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.643281:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465456640:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.643288:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:0.0:1783952001.643316:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465456640:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.643324:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465457152:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.643356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783952001.643370:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952001.643377:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952001.643380:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952001.643393:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465456256:0@lo:400:kworker.0 00000100:00100000:3.0:1783952001.643429:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952001.643451:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465456768:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.643456:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465456256 00000100:00100000:0.0:1783952001.643460:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465456256 00000100:00100000:3.0:1783952001.643478:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783952001.643499:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952001.643499:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1783952001.643509:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465456256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952001.643515:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465456768 00000100:00100000:3.0:1783952001.643523:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465456768 00000100:00100000:0.0:1783952001.643542:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465456256:12345-0@lo:400:kworker.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.643549:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1783952001.643561:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:3.0:1783952001.643570:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465456768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.643611:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465457152 00000100:00100000:0.0:1783952001.643615:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465457152 00000100:00100000:0.0:1783952001.643640:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:3.0:1783952001.643645:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465456768:12345-0@lo:400:kworker.0 Request processed in 75us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.643650:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465457152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.643684:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465457152:12345-0@lo:400:kworker.0 Request processed in 37us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.643690:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00100000:2.0:1783952001.643698:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465456384:0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.643720:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465457152:0@lo:400:kworker.0 00000100:00100000:2.0:1783952001.643780:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465456896:0@lo:400:kworker.0 00000100:00100000:2.0:1783952001.643795:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465457408:0@lo:400:kworker.0 00000100:00100000:2.0:1783952001.643839:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465456768:0@lo:400:kworker.0 00000100:00100000:2.0:1783952001.643846:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465457280:0@lo:400:kworker.0 00000100:00100000:2.0:1783952001.643874:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952001.643916:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465456256:0@lo:400:kworker.0 00000100:00080000:2.0:1783952001.643936:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952001.644008:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465457280 00000100:00100000:0.0:1783952001.644021:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465457280 00000100:00100000:0.0:1783952001.644067:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:0.0:1783952001.644073:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465457280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952001.644109:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465457280:12345-0@lo:400:kworker.0 Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.644114:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00100000:1.0:1783952001.644375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952001.644437:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465456128 00000100:00100000:0.0:1783952001.644441:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465456128 00000100:00100000:0.0:1783952001.644464:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:0.0:1783952001.644470:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465456128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783952001.644501:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783952001.644534:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465456128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952001.644540:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:1.0:1783952001.644618:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465456128:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1783952001.644799:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952001.644820:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465457280:0@lo:400:kworker.0 00000100:00100000:3.0:1783952001.645649:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:0.0:1783952002.150527:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465457664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952002.150622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952002.150680:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465457664 00000100:00100000:0.0:1783952002.150688:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465457664 00000100:00100000:0.0:1783952002.150746:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:0.0:1783952002.150755:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465457664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783952002.150786:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952002.150830:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465457664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952002.150837:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:0.0:1783952002.150896:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465457664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952002.151195:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465457792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952002.151229:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952002.151265:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465457792 00000100:00100000:2.0:1783952002.151269:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465457792 00000100:00100000:2.0:1783952002.151299:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:2.0:1783952002.151305:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465457792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952002.151345:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1783952002.151380:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465457792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952002.151387:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:2.0:1783952002.151429:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465457792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952002.151867:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465457920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952002.151897:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952002.151942:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465457920 00000100:00100000:2.0:1783952002.151946:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465457920 00000100:00100000:2.0:1783952002.151970:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:2.0:1783952002.151976:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465457920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783952002.151995:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952002.152039:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465457920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952002.152045:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:2.0:1783952002.152073:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465457920:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1783952002.185071:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00080000:1.0:1783952002.185096:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968952 is committed 00000100:00100000:1.0:1783952002.540486:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952002.540529:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952002.540562:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952002.540578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952002.540635:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952002.540660:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447718528 00000100:00100000:1.0:1783952002.540668:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447718528 00000100:00100000:1.0:1783952002.540727:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447718656 00000100:00100000:1.0:1783952002.540730:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447718656 00000100:00100000:1.0:1783952002.540749:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2686 00000100:00100000:2.0:1783952002.540895:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447718272 00000100:00100000:2.0:1783952002.540899:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447718272 00000100:00100000:2.0:1783952002.540933:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447718400 00000100:00100000:2.0:1783952002.540936:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447718400 00000100:00100000:2.0:1783952002.540957:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1191 00000100:00100000:2.0:1783952002.540965:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:2398:x1870605447718272:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952002.541058:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:2398:x1870605447718272:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 85us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952002.541065:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1191 00000100:00100000:2.0:1783952002.541092:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1192 00000100:00100000:2.0:1783952002.541098:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447718400:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952002.541126:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447718400:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952002.541133:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1192 00000100:00100000:2.0:1783952002.541151:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447718144 00000100:00100000:2.0:1783952002.541154:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447718144 00000100:00100000:2.0:1783952002.541178:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00100000:2.0:1783952002.541184:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447718144:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952002.541207:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447718144:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952002.541212:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00080000:2.0:1783952002.541235:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952002.541238:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783952002.541240:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952002.541242:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952002.541583:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447718528:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952002.541657:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447718528:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 79us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952002.549410:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2687 00000100:00100000:3.0:1783952002.549432:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447718656:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952002.549720:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447718656:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 296us (9083us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952002.549728:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2687 00000100:00100000:1.0:1783952002.550533:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2686 00010000:00010000:2.0:1783952002.592947:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783952003.172964:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00080000:0.0:1783952003.172993:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968952 is committed 00010000:00010000:0.0:1783952003.618148:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952004.643783:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952004.705295:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952004.705320:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465458048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952004.705388:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952004.705434:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465458048 00000100:00100000:1.0:1783952004.705441:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465458048 00000100:00100000:1.0:1783952004.705492:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:1.0:1783952004.705500:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465458048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952004.705528:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952004.705604:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465458048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952004.705612:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00080000:1.0:1783952004.705632:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952004.705664:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465458048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952004.707578:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952004.707616:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465458176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952004.707671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952004.707709:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465458176 00000100:00100000:0.0:1783952004.707715:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465458176 00000100:00100000:0.0:1783952004.707762:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:0.0:1783952004.707770:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465458176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952004.707796:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952004.707855:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465458176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952004.707861:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00080000:0.0:1783952004.707881:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952004.707911:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465458176:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783952005.665814:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952006.689017:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952006.752910:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465458688:0@lo:400:kworker.0 00000100:00100000:1.0:1783952006.752987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952006.753019:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465459200:0@lo:400:kworker.0 00000100:00100000:1.0:1783952006.753043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952006.753055:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465459712:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753178:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465458304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783952006.753211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952006.753228:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b046acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465458816:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753249:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952006.753262:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465459328:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753279:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952006.753292:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465459840:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952006.753364:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1783952006.753370:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465458432:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753397:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952006.753421:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465458944:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753440:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952006.753455:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465459456:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753472:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952006.753487:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465459968:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753503:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952006.753534:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465458432 00000100:00100000:2.0:1783952006.753542:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465458432 00000100:00100000:2.0:1783952006.753584:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783952006.753622:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465458432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753671:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465458432:12345-0@lo:400:kworker.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952006.753677:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783952006.753706:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465458688 00000100:00100000:2.0:1783952006.753709:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465458688 00000100:00100000:2.0:1783952006.753735:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465458816 00000100:00100000:2.0:1783952006.753737:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465458816 00000100:00100000:2.0:1783952006.753745:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465458944 00000100:00100000:2.0:1783952006.753747:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465458944 00000100:00100000:2.0:1783952006.753755:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465459456 00000100:00100000:2.0:1783952006.753756:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465459456 00000100:00100000:2.0:1783952006.753763:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465459968 00000100:00100000:2.0:1783952006.753765:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465459968 00000100:00100000:2.0:1783952006.753773:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1783952006.753778:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465458688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753818:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465458688:12345-0@lo:400:kworker.0 Request processed in 39us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952006.753826:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1783952006.753839:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1783952006.753845:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465458816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753870:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465458816:12345-0@lo:400:kworker.0 Request processed in 26us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952006.753876:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1783952006.753886:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1783952006.753891:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465458944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753913:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465458944:12345-0@lo:400:kworker.0 Request processed in 23us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952006.753918:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1783952006.753927:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1783952006.753931:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465459456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.753950:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465459456:12345-0@lo:400:kworker.0 Request processed in 18us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952006.753955:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1783952006.753975:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1783952006.753982:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465459968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.754021:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465459968:12345-0@lo:400:kworker.0 Request processed in 40us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952006.754027:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1783952006.754181:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465458304 00000100:00100000:0.0:1783952006.754186:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465458304 00000100:00100000:0.0:1783952006.754215:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:0.0:1783952006.754222:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465458304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783952006.754250:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783952006.754283:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465458304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952006.754289:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00080000:0.0:1783952006.754309:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952006.754312:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952006.754322:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465458560:0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754344:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952006.754360:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465459072:0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952006.754387:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465459584:0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952006.754426:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465459072 00000100:00100000:0.0:1783952006.754429:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465459072 00000100:00100000:0.0:1783952006.754445:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465459584 00000100:00100000:0.0:1783952006.754447:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465459584 00000100:00100000:0.0:1783952006.754456:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:0.0:1783952006.754461:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465459072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754496:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465459072:12345-0@lo:400:kworker.0 Request processed in 35us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952006.754503:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00100000:0.0:1783952006.754513:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:0.0:1783952006.754518:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465459584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754537:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465459584:12345-0@lo:400:kworker.0 Request processed in 19us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952006.754542:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:0.0:1783952006.754573:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465459072:0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754582:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465459584:0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754629:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465458560 00000100:00100000:0.0:1783952006.754632:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465458560 00000100:00100000:0.0:1783952006.754658:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1783952006.754665:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465458560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754696:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465458560:12345-0@lo:400:kworker.0 Request processed in 31us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952006.754702:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00080000:0.0:1783952006.754713:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952006.754727:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465458560:0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754754:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465459200 00000100:00100000:0.0:1783952006.754758:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465459200 00000100:00100000:0.0:1783952006.754781:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465459328 00000100:00100000:0.0:1783952006.754783:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465459328 00000100:00100000:0.0:1783952006.754796:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465459840 00000100:00100000:0.0:1783952006.754798:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465459840 00000100:00100000:0.0:1783952006.754812:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:0.0:1783952006.754823:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465459200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754850:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465459200:12345-0@lo:400:kworker.0 Request processed in 28us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952006.754855:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:0.0:1783952006.754864:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1783952006.754869:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465459328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754890:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465459328:12345-0@lo:400:kworker.0 Request processed in 21us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952006.754894:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1783952006.754903:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690 00000100:00100000:0.0:1783952006.754908:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465459840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952006.754931:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465459840:12345-0@lo:400:kworker.0 Request processed in 23us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952006.754937:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690 00000100:00080000:0.0:1783952006.754957:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952006.754960:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952006.755220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952006.755261:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465458688:0@lo:400:kworker.0 00000100:00100000:1.0:1783952006.755270:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465459200:0@lo:400:kworker.0 00000100:00100000:3.0:1783952006.755377:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465459712 00000100:00100000:3.0:1783952006.755381:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465459712 00000100:00100000:3.0:1783952006.755422:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:3.0:1783952006.755429:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465459712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952006.755466:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465459712:12345-0@lo:400:kworker.0 Request processed in 38us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952006.755472:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00100000:2.0:1783952006.755526:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465458432:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.755550:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465458944:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.755561:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465459456:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.755570:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465459968:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.755584:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465458304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783952006.755609:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b046acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465458816:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.755619:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465459328:0@lo:400:kworker.0 00000100:00100000:2.0:1783952006.755627:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968952 gen 2 00000100:00100000:2.0:1783952006.755648:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465459840:0@lo:400:kworker.0 00000100:00080000:0.0:1783952006.755712:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952006.755832:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968952 gen 2 00000100:00100000:1.0:1783952006.755842:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465459712:0@lo:400:kworker.0 00000100:00100000:2.0:1783952007.264982:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783952007.265004:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465460352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952007.265080:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952007.265229:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465460224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783952007.265261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952007.265290:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952007.265296:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465460096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952007.265316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952007.265344:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465460352 00000100:00100000:1.0:1783952007.265351:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465460352 00000100:00100000:1.0:1783952007.265389:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465460096 00000100:00100000:1.0:1783952007.265392:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465460096 00000100:00100000:1.0:1783952007.265405:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:1.0:1783952007.265411:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465460352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952007.265439:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952007.265480:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465460352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952007.265487:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:1.0:1783952007.265504:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:1.0:1783952007.265510:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465460096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783952007.265524:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952007.265551:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465460096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952007.265557:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:1.0:1783952007.265628:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465460096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952007.265756:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465460224 00000100:00100000:0.0:1783952007.265760:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465460224 00000100:00100000:0.0:1783952007.265790:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:0.0:1783952007.265796:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465460224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783952007.265817:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00000100:00100000:0.0:1783952007.265855:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465460224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952007.265861:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:0.0:1783952007.266796:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465460224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783952007.266942:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465460352:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1783952007.455374:0:89642:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:2.0:1783952007.678190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952007.678241:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952007.678273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952007.678305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952007.678333:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952007.678373:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447719296 00000100:00100000:2.0:1783952007.678383:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447719296 00000100:00100000:2.0:1783952007.678446:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447719168 00000100:00100000:2.0:1783952007.678449:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447719168 00000100:00100000:2.0:1783952007.678471:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2692 00000100:00100000:2.0:1783952007.678480:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447719296:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952007.678567:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447719296:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952007.678623:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2692 00000100:00100000:2.0:1783952007.678640:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2693 00000100:00100000:2.0:1783952007.678646:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447719168:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952007.678764:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447718784 00000100:00100000:0.0:1783952007.678768:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447718784 00000100:00100000:0.0:1783952007.678799:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:0.0:1783952007.678805:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447718784:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952007.678831:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447718784:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952007.678837:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:0.0:1783952007.678867:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447719040 00000100:00100000:0.0:1783952007.678870:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447719040 00000100:00100000:0.0:1783952007.678896:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447718912 00000100:00100000:0.0:1783952007.678899:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447718912 00000100:00100000:0.0:1783952007.678917:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1199 00000100:00100000:0.0:1783952007.678923:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447719040:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952007.678948:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447719040:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952007.678953:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1199 00000100:00100000:0.0:1783952007.678980:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1200 00000100:00100000:0.0:1783952007.678987:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:2398:x1870605447718912:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952007.679010:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:2398:x1870605447718912:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952007.679016:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1200 00000100:00080000:0.0:1783952007.679032:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952007.679037:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952007.679039:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952007.679041:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952007.679818:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+5:2398:x1870605447719168:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 1168us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952007.679837:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2693 00010000:00010000:0.0:1783952007.712933:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952008.749076:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783952009.485371:0:89691:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1783952009.763373:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952009.824913:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465460480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952009.824996:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952009.825049:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465460480 00000100:00100000:1.0:1783952009.825058:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465460480 00000100:00100000:1.0:1783952009.825118:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:1.0:1783952009.825128:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465460480:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952009.825174:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465460608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952009.825203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952009.825275:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465460608 00000100:00100000:0.0:1783952009.825279:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465460608 00000100:00100000:0.0:1783952009.825300:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:0.0:1783952009.825306:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465460608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952009.825327:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952009.825366:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465460608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952009.825372:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:0.0:1783952009.825413:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465460608:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952009.825481:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783952009.825608:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952009.825612:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952009.827039:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465460480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1905us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952009.827050:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:3.0:1783952009.827381:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465460480:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783952010.789447:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952011.726911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952011.727312:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447719424 00000100:00100000:0.0:1783952011.727321:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447719424 00000100:00100000:0.0:1783952011.727383:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1209 00000100:00100000:0.0:1783952011.727391:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:68696:x1870605447719424:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:0.0:1783952011.727423:0:68591:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00000100:00100000:0.0:1783952011.727497:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:68696:x1870605447719424:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 105us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952011.727504:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1209 00000100:00080000:2.0:1783952011.727715:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952011.730013:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952011.730099:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447719552 00000100:00100000:0.0:1783952011.730106:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447719552 00000100:00100000:0.0:1783952011.730173:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1210 00000100:00100000:0.0:1783952011.730180:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b046acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:68696:x1870605447719552:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:0.0:1783952011.730230:0:66237:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783952011.730296:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b046acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:68696:x1870605447719552:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 116us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952011.730301:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1210 00000100:00080000:2.0:1783952011.730384:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952011.733039:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952011.733128:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447719680 00000100:00100000:0.0:1783952011.733136:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447719680 00000100:00100000:0.0:1783952011.733249:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2111 00000100:00100000:0.0:1783952011.733261:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:68696:x1870605447719680:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783952011.733297:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952011.733362:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:68696:x1870605447719680:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952011.733367:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2111 00000100:00080000:2.0:1783952011.733538:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952011.735670:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952011.735752:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447719808 00000100:00100000:1.0:1783952011.735761:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447719808 00000100:00100000:1.0:1783952011.735814:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2112 00000100:00100000:1.0:1783952011.735821:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:68696:x1870605447719808:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:1.0:1783952011.735849:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952011.735910:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:68696:x1870605447719808:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952011.735916:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2112 00000100:00080000:2.0:1783952011.735987:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952011.787462:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952011.790479:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447720064 00000100:00100000:0.0:1783952011.790495:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447720064 00000100:00100000:0.0:1783952011.790572:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1211 00000100:00100000:0.0:1783952011.790582:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:68713:x1870605447720064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1783952011.790642:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952011.790666:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4e83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a235 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.790783:0:83761:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 9 pid: 89093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.790801:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4e8a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.790815:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4e8a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.790842:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4e8a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.790977:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4e8a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.790984:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4e8a lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.790991:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4e8a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.790998:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbca00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952011.791002:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4e8a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.791009:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4e8a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.791021:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b146f44600) 00010000:00010000:0.0:1783952011.791023:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952011.791028:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4e8a lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.791034:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4e8a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.791087:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4e83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a235 expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.791097:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b164ef8000) 00010000:00010000:0.0:1783952011.791105:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783952011.791109:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4e83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a235 expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.791118:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbcc00, rc 0) 00000100:00100000:0.0:1783952011.791207:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:68713:x1870605447720064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 626us (3754us total) trans 111669149698 rc 301/301 00000100:00100000:0.0:1783952011.791216:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1211 00000100:00100000:0.0:1783952011.798913:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952011.799079:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447720192 00000100:00100000:2.0:1783952011.799089:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447720192 00000100:00100000:2.0:1783952011.799165:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1212 00000100:00100000:2.0:1783952011.799176:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+9:68713:x1870605447720192:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1783952011.799204:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952011.799226:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4e98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a23c expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952011.799294:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952011.799310:0:68591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 10 pid: 89093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952011.799318:0:68591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 4/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952011.799372:0:68591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 10 pid: 89093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952011.799385:0:68591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 10 pid: 89093 timeout: 3826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952011.799399:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68591:1870605465460736:192.168.202.48@tcp:104: 00000100:00100000:2.0:1783952011.799534:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522af900 going to sleep for 11 seconds 00000100:00100000:2.0:1783952011.808463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952011.808781:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447720320 00000100:00100000:3.0:1783952011.808791:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447720320 00010000:00010000:3.0:1783952011.808830:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 11 pid: 89093 timeout: 3826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952011.808863:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2547 00000100:00100000:3.0:1783952011.808874:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:458183b2-4c6d-478c-9fed-a955779e6611+11:2401:x1870605447720320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783952011.808891:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:3.0:1783952011.808912:0:26211:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:3.0:1783952011.808937:0:26211:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1783951960 00000004:00010000:3.0:1783952011.808939:0:26211:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1783951951 00000004:00010000:3.0:1783952011.808941:0:26211:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1783951960 00010000:00010000:3.0:1783952011.808948:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 11 pid: 89093 timeout: 3826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952011.808962:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 11 pid: 89093 timeout: 3826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952011.808985:0:26211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b146f44600) 00010000:00010000:3.0:1783952011.808990:0:26211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952011.809000:0:26211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952011.809008:0:26211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 4/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952011.809041:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952011.809101:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:458183b2-4c6d-478c-9fed-a955779e6611+11:2401:x1870605447720320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 229us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.809109:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2547 00010000:00010000:3.0:1783952011.809175:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952011.810362:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb4ca0 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a204 expref: 10 pid: 89093 timeout: 3826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952011.810383:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68591:1870605465460736:192.168.202.48@tcp:104: 00010000:00010000:0.0:1783952011.810405:0:68591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.810416:0:68591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.810421:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952011.810478:0:68591:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783952011.810499:0:68591:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.810536:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4e98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a23c expref: 10 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.810573:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a23c expref: 9 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.810582:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b146f44600) 00010000:00010000:0.0:1783952011.810585:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783952011.810998:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216bc00, rc 0) 00000100:00100000:0.0:1783952011.811302:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+9:68713:x1870605447720192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 12126us (12407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952011.811311:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1212 00000100:00100000:2.0:1783952011.822477:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952011.822557:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447720448 00000100:00100000:0.0:1783952011.822568:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447720448 00000100:00100000:0.0:1783952011.822658:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1213 00000100:00100000:0.0:1783952011.822668:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+9:68713:x1870605447720448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1783952011.822689:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952011.822710:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4ea6 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a243 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.822767:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4ea6 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a243 expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.822782:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4ea6 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a243 expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952011.822800:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b146f44600) 00010000:00010000:0.0:1783952011.822803:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783952011.822818:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbcc00, rc 0) 00000100:00100000:0.0:1783952011.822886:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:68713:x1870605447720448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 219us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952011.822893:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1213 00000100:00100000:1.0:1783952011.826228:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952011.826517:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447720576 00000100:00100000:3.0:1783952011.826527:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447720576 00000100:00100000:3.0:1783952011.826630:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1214 00000100:00100000:3.0:1783952011.826642:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:2399:x1870605447720576:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1783952011.826666:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952011.826700:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb4ead lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a24a expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952011.826732:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb4ead lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a24a expref: 11 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952011.826756:0:66236:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:3.0:1783952011.826759:0:66236:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1783951960 -> 1783951960 00000004:00010000:3.0:1783952011.826762:0:66236:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1783951951 -> 1783951951 00000004:00010000:3.0:1783952011.826764:0:66236:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1783951960 -> 1783951960 00000004:00010000:3.0:1783952011.826767:0:66236:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:3.0:1783952011.826771:0:66236:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:3.0:1783952011.826779:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb4ead lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a24a expref: 11 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952011.826791:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff97b146f44600) 00010000:00010000:3.0:1783952011.826795:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783952011.826798:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70800, rc 0) 00000100:00100000:3.0:1783952011.826861:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:2399:x1870605447720576:12345-192.168.202.48@tcp:101:cat.0 Request processed in 220us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.826869:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1214 00000100:00100000:3.0:1783952011.847928:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952011.848205:0:66263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447720704 00000100:00100000:0.0:1783952011.848216:0:66263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447720704 00002000:00100000:0.0:1783952011.848270:0:66263:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff97b049ee1c00 x1870605447720704/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:272/0 lens 488/0 e 0 to 0 dl 1783952022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952011.848282:0:66263:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff97b049ee1c00 with x1870605447720704 00000100:00100000:0.0:1783952011.848326:0:66263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4 00000100:00100000:0.0:1783952011.848337:0:66263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:2400:x1870605447720704:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1783952011.848519:0:66263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:2400:x1870605447720704:12345-192.168.202.48@tcp:3:cat.0 Request processed in 183us (607us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783952011.848527:0:66263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4 00002000:00100000:0.0:1783952011.848534:0:66263:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff97b049ee1c00 x1870605447720704/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:272/0 lens 488/4536 e 0 to 0 dl 1783952022 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952011.848542:0:66263:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff97b049ee1c00 with x1870605447720704 00000100:00100000:2.0:1783952011.862527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952011.862893:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447720960 00000100:00100000:0.0:1783952011.862905:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447720960 00000100:00100000:0.0:1783952011.862971:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 225 00000100:00100000:0.0:1783952011.862983:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:68713:x1870605447720960:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1783952011.863288:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:68713:x1870605447720960:12345-192.168.202.48@tcp:35:cat.0 Request processed in 307us (769us total) trans 111669149699 rc 0/0 00000100:00100000:0.0:1783952011.863296:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 225 00000100:00100000:3.0:1783952011.873162:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465461248:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.873238:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.873280:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465461760:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.873308:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.873331:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465462272:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.873366:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.873388:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1783952011.873394:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465460864:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.873421:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.873447:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04697e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465461376:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.873468:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.873482:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465461888:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.873503:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.873517:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465462400:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.873537:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.873567:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465461760 00000100:00100000:3.0:1783952011.873574:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465461760 00000100:00100000:3.0:1783952011.873661:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465462272 00000100:00100000:3.0:1783952011.873664:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465462272 00000100:00100000:3.0:1783952011.873682:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:3.0:1783952011.873690:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465461760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.873737:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465461760:12345-0@lo:400:kworker.0 Request processed in 48us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.873744:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:3.0:1783952011.873759:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:3.0:1783952011.873765:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465462272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.873785:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465462272:12345-0@lo:400:kworker.0 Request processed in 21us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.873790:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:3.0:1783952011.873809:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465460864 00000100:00100000:3.0:1783952011.873811:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465460864 00000100:00100000:3.0:1783952011.873839:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783952011.873844:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465460864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.873869:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465460864:12345-0@lo:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.873874:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783952011.873905:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465461248 00000100:00100000:3.0:1783952011.873908:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465461248 00000100:00100000:3.0:1783952011.873940:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465461376 00000100:00100000:3.0:1783952011.873943:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465461376 00000100:00100000:3.0:1783952011.873956:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465461888 00000100:00100000:3.0:1783952011.873958:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465461888 00000100:00100000:3.0:1783952011.873966:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465462400 00000100:00100000:3.0:1783952011.873968:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465462400 00000100:00100000:3.0:1783952011.873978:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1783952011.873983:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465461248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874009:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465461248:12345-0@lo:400:kworker.0 Request processed in 26us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.874014:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1783952011.874035:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1783952011.874041:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465461376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874062:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465461376:12345-0@lo:400:kworker.0 Request processed in 22us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.874067:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1783952011.874076:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1783952011.874080:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465461888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874099:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465461888:12345-0@lo:400:kworker.0 Request processed in 19us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.874113:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1783952011.874123:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:3.0:1783952011.874127:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465462400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874149:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465462400:12345-0@lo:400:kworker.0 Request processed in 22us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.874154:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00080000:3.0:1783952011.874170:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952011.874174:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783952011.874176:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952011.874186:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465461120:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.874224:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465461632:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874242:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.874255:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465462144:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874270:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.874284:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783952011.874288:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465460992:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874304:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.874314:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465461504:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874332:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.874350:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465462016:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874368:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952011.874389:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465461632 00000100:00100000:3.0:1783952011.874392:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465461632 00000100:00100000:3.0:1783952011.874419:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465462144 00000100:00100000:3.0:1783952011.874427:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465462144 00000100:00100000:3.0:1783952011.874447:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:3.0:1783952011.874453:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465461632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874488:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465461632:12345-0@lo:400:kworker.0 Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.874494:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:3.0:1783952011.874505:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:3.0:1783952011.874510:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465462144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874552:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465462144:12345-0@lo:400:kworker.0 Request processed in 41us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.874558:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000100:00100000:3.0:1783952011.874577:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465461120 00000100:00100000:3.0:1783952011.874580:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465461120 00000100:00100000:3.0:1783952011.874624:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465460992 00000100:00100000:3.0:1783952011.874627:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465460992 00000100:00100000:3.0:1783952011.874640:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1783952011.874645:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465461120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874675:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465461120:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.874680:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1783952011.874691:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1783952011.874696:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465460992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874718:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465460992:12345-0@lo:400:kworker.0 Request processed in 22us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952011.874723:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00080000:3.0:1783952011.874734:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783952011.874736:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952011.874743:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952011.874770:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465460992:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874779:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465461120:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874786:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465461632:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874794:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465462144:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874822:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465460864:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874830:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04697e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465461376:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874838:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465461888:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874846:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465462400:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874854:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465461248:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874862:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465461760:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.874870:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465462272:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.875529:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952011.875542:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465462528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952011.875578:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952011.876396:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465461504 00000100:00100000:2.0:1783952011.876404:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465461504 00000100:00100000:2.0:1783952011.876488:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465462016 00000100:00100000:2.0:1783952011.876492:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465462016 00000100:00100000:2.0:1783952011.876507:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465462528 00000100:00100000:2.0:1783952011.876509:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465462528 00000100:00100000:2.0:1783952011.876522:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:2.0:1783952011.876530:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465461504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952011.880771:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465461504:12345-0@lo:400:kworker.0 Request processed in 4231us (6427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952011.880787:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00100000:2.0:1783952011.880826:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:2.0:1783952011.880840:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465462016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952011.880924:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465462016:12345-0@lo:400:kworker.0 Request processed in 84us (6547us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952011.880948:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:2.0:1783952011.880961:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:2.0:1783952011.880968:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465462528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783952011.880990:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783952011.881106:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465462528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (5527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952011.881113:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1783952011.881480:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465462528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952011.881496:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465461504:0@lo:400:kworker.0 00000100:00100000:3.0:1783952011.881505:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465462016:0@lo:400:kworker.0 00000100:00100000:3.0:1783952012.384896:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465462656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952012.384982:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952012.385119:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465462656 00000100:00100000:2.0:1783952012.385129:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465462656 00000100:00100000:2.0:1783952012.385186:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:2.0:1783952012.385201:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465462656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952012.385238:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1783952012.385295:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465462656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952012.385301:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:0.0:1783952012.385429:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783952012.385447:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465462784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952012.385480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952012.385509:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465462784 00000100:00100000:0.0:1783952012.385513:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465462784 00000100:00100000:0.0:1783952012.385540:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:0.0:1783952012.385547:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465462784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783952012.385562:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952012.385615:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465462784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952012.385622:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00100000:0.0:1783952012.385664:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465462784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952012.385747:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465462656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952012.386298:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465462912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952012.386331:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952012.386525:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465462912 00000100:00100000:3.0:1783952012.386530:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465462912 00000100:00100000:3.0:1783952012.386566:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:3.0:1783952012.386574:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465462912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783952012.386615:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952012.386667:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465462912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952012.386673:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1783952012.387115:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465462912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952012.783342:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952012.783399:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952012.783438:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952012.783469:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952012.783472:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447721344 00000100:00100000:1.0:1783952012.783483:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447721344 00000100:00100000:3.0:1783952012.783497:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952012.783521:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447721600 00000100:00100000:3.0:1783952012.783525:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447721600 00000100:00100000:1.0:1783952012.783557:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447721216 00000100:00100000:1.0:1783952012.783562:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447721216 00000100:00100000:3.0:1783952012.783564:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447721472 00000100:00100000:3.0:1783952012.783569:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447721472 00000100:00100000:3.0:1783952012.783629:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2698 00000100:00100000:1.0:1783952012.783637:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1207 00000100:00100000:3.0:1783952012.783641:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447721600:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952012.783662:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447721344:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952012.783730:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447721344:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 83us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952012.783742:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1207 00000100:00100000:1.0:1783952012.783761:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1208 00000100:00100000:1.0:1783952012.783768:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:2401:x1870605447721216:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952012.783802:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:2401:x1870605447721216:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 35us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952012.783812:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1208 00000100:00100000:3.0:1783952012.783846:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447721600:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 208us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952012.783854:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2698 00000100:00100000:3.0:1783952012.783871:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2699 00000100:00100000:3.0:1783952012.783881:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447721472:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952012.783921:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447721472:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 32us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952012.783936:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2699 00000100:00100000:0.0:1783952012.784622:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447721088 00000100:00100000:0.0:1783952012.784629:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447721088 00000100:00100000:0.0:1783952012.784668:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:0.0:1783952012.784688:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447721088:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952012.784731:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447721088:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 45us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952012.784738:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 80 00010000:00010000:0.0:1783952012.832799:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952013.861108:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952014.885218:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952014.946612:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465463040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952014.946690:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952014.947308:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465463040 00000100:00100000:1.0:1783952014.947316:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465463040 00000100:00100000:1.0:1783952014.947399:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:1.0:1783952014.947419:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465463040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952014.947454:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952014.947513:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465463040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952014.947520:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:1.0:1783952014.947571:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465463040:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783952014.947811:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952014.953613:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465463168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952014.953695:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952014.953791:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465463168 00000100:00100000:1.0:1783952014.953800:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465463168 00000100:00100000:1.0:1783952014.953858:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:1.0:1783952014.953868:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04697e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465463168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952014.953910:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783952014.954046:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952014.960958:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04697e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465463168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7079us (7251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952014.960999:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:3.0:1783952014.961883:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465463168:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783952015.904785:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952016.930982:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952016.992973:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465463296:0@lo:400:kworker.0 00000100:00100000:3.0:1783952016.993121:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952016.994742:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465463296 00000100:00100000:2.0:1783952016.994757:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465463296 00000100:00100000:2.0:1783952016.994832:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783952016.994846:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465463296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952016.999001:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465463424:0@lo:400:kworker.0 00000100:00100000:0.0:1783952016.999145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952016.999191:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465463936:0@lo:400:kworker.0 00000100:00100000:0.0:1783952016.999246:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952016.999277:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465464448:0@lo:400:kworker.0 00000100:00100000:0.0:1783952016.999310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952016.999344:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783952016.999350:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465463808:0@lo:400:kworker.0 00000100:00100000:0.0:1783952016.999373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952016.999634:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465464320:0@lo:400:kworker.0 00000100:00100000:0.0:1783952016.999666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952016.999690:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465464832:0@lo:400:kworker.0 00000100:00100000:0.0:1783952016.999717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952016.999769:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465463552:0@lo:400:kworker.0 00000100:00100000:0.0:1783952016.999799:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952016.999852:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465464064:0@lo:400:kworker.0 00000100:00100000:0.0:1783952016.999891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952016.999917:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465464576:0@lo:400:kworker.0 00000100:00100000:0.0:1783952016.999944:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952016.999971:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783952016.999978:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465463680:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.000008:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952017.000027:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465464192:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.000062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952017.000081:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465464704:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.000214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952017.000414:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465463424 00000100:00100000:0.0:1783952017.000441:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465463424 00000100:00100000:0.0:1783952017.000521:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465463808 00000100:00100000:0.0:1783952017.000634:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465463808 00000100:00100000:0.0:1783952017.000657:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465464320 00000100:00100000:0.0:1783952017.000660:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465464320 00000100:00100000:0.0:1783952017.000674:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465464832 00000100:00100000:0.0:1783952017.000676:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465464832 00000100:00100000:0.0:1783952017.000687:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465463552 00000100:00100000:0.0:1783952017.000689:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465463552 00000100:00100000:0.0:1783952017.000701:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465463680 00000100:00100000:0.0:1783952017.000703:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465463680 00000100:00100000:0.0:1783952017.000728:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1783952017.000741:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465463424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.000832:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465463424:12345-0@lo:400:kworker.0 Request processed in 92us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.000843:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1783952017.000868:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:0.0:1783952017.000882:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465463808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952017.000967:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465463296:12345-0@lo:400:kworker.0 Request processed in 6122us (7844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952017.000992:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783952017.001391:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465463808:12345-0@lo:400:kworker.0 Request processed in 507us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.001401:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:0.0:1783952017.001421:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:0.0:1783952017.001432:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465464320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.005907:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465464320:12345-0@lo:400:kworker.0 Request processed in 48us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.005946:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:0.0:1783952017.006242:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:0.0:1783952017.006268:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465464832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.006419:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465464832:12345-0@lo:400:kworker.0 Request processed in 166us (6700us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.006426:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:0.0:1783952017.006442:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:0.0:1783952017.006450:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465463552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.006491:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465463552:12345-0@lo:400:kworker.0 Request processed in 43us (6691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.006497:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:0.0:1783952017.006507:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:0.0:1783952017.006514:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465463680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.006552:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465463680:12345-0@lo:400:kworker.0 Request processed in 39us (6543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.006558:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:0.0:1783952017.006627:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465463936 00000100:00100000:0.0:1783952017.006637:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465463936 00000100:00100000:0.0:1783952017.006687:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465464448 00000100:00100000:0.0:1783952017.006691:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465464448 00000100:00100000:0.0:1783952017.006712:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:0.0:1783952017.009174:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465463936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.009296:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465463936:12345-0@lo:400:kworker.0 Request processed in 2577us (10047us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.009308:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:0.0:1783952017.009349:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:0.0:1783952017.009360:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465464448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.009395:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465464448:12345-0@lo:400:kworker.0 Request processed in 38us (10084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.009411:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:0.0:1783952017.009466:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465464064 00000100:00100000:0.0:1783952017.009474:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465464064 00000100:00100000:0.0:1783952017.009541:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465464576 00000100:00100000:0.0:1783952017.009545:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465464576 00000100:00100000:0.0:1783952017.009578:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465464192 00000100:00100000:2.0:1783952017.009581:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465464704 00000100:00100000:0.0:1783952017.009582:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465464192 00000100:00100000:2.0:1783952017.009609:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465464704 00000100:00100000:0.0:1783952017.009642:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:0.0:1783952017.009651:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465464064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952017.009662:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:2.0:1783952017.009674:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465464576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.009694:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465464064:12345-0@lo:400:kworker.0 Request processed in 45us (9801us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.009707:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:2.0:1783952017.009728:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465464576:12345-0@lo:400:kworker.0 Request processed in 56us (9780us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.009730:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00100000:2.0:1783952017.009745:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:0.0:1783952017.009746:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465464192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952017.009779:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465463296:0@lo:400:kworker.0 00000100:00100000:2.0:1783952017.009781:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00100000:0.0:1783952017.009783:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465464192:12345-0@lo:400:kworker.0 Request processed in 43us (9720us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.009791:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00100000:2.0:1783952017.009796:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465464704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952017.009809:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952017.009839:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465464704:12345-0@lo:400:kworker.0 Request processed in 47us (9623us total) trans 0 rc 0/0 00000100:00080000:0.0:1783952017.009844:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952017.009849:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000100:00080000:0.0:1783952017.009852:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952017.009858:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952017.009862:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952017.009958:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465464960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952017.010021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952017.010398:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465464960 00000100:00100000:2.0:1783952017.010404:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465464960 00000100:00100000:2.0:1783952017.010447:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:2.0:1783952017.010456:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465464960:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952017.010884:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465463680:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.010902:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465464192:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.010916:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465464704:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.010932:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465463552:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.010961:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465464064:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.010984:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465464576:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.011169:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465463808:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.011186:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465464320:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.011199:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465464832:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.011213:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465463424:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.011226:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465463936:0@lo:400:kworker.0 00000100:00100000:0.0:1783952017.011237:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465464448:0@lo:400:kworker.0 00000004:00000024:2.0:1783952017.011397:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783952017.011813:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465464960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783952017.012266:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465464960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1808us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952017.012278:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:0.0:1783952017.505021:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465465216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952017.505115:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952017.505164:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783952017.505173:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465465088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952017.505195:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952017.505230:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465465216 00000100:00100000:0.0:1783952017.505238:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465465216 00000100:00100000:0.0:1783952017.505291:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:0.0:1783952017.505299:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465465216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783952017.505342:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00000100:00100000:0.0:1783952017.505386:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465465216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.505393:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:0.0:1783952017.505417:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465465088 00000100:00100000:0.0:1783952017.505437:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465465088 00000100:00100000:0.0:1783952017.505466:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:0.0:1783952017.505471:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465465088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783952017.505493:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952017.505527:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465465088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.505533:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:0.0:1783952017.505609:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465465088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952017.505621:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465465216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952017.506658:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783952017.506676:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465465344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952017.506746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952017.510899:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465465344 00000100:00100000:0.0:1783952017.510920:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465465344 00000100:00100000:0.0:1783952017.511006:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:0.0:1783952017.511019:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465465344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783952017.511065:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952017.511177:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465465344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.511185:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:2.0:1783952017.511465:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465465344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952017.902317:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952017.902505:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952017.902730:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952017.902757:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952017.910841:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447721728 00000100:00100000:0.0:1783952017.910879:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447721728 00000100:00100000:0.0:1783952017.911070:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:0.0:1783952017.911084:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447721728:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952017.911262:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447721728:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 181us (8954us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952017.911272:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:2.0:1783952017.914892:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447722240 00000100:00100000:2.0:1783952017.914912:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447722240 00000100:00100000:2.0:1783952017.915031:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2704 00000100:00100000:2.0:1783952017.915044:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447722240:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952017.915175:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447722240:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 133us (12586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952017.915186:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2704 00000100:00100000:3.0:1783952017.917114:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952017.917153:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447722112 00000100:00100000:3.0:1783952017.917163:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447722112 00000100:00100000:3.0:1783952017.917216:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2705 00000100:00100000:3.0:1783952017.917226:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447722112:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952017.917301:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447722112:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952017.917325:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2705 00000100:00100000:1.0:1783952017.917426:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447721984 00000100:00100000:1.0:1783952017.917431:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447721984 00000100:00100000:1.0:1783952017.917472:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447721856 00000100:00100000:1.0:1783952017.917475:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447721856 00000100:00100000:1.0:1783952017.917499:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1215 00000100:00100000:1.0:1783952017.917506:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447721984:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952017.917539:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447721984:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 34us (15035us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952017.917546:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1215 00000100:00100000:1.0:1783952017.917560:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1216 00000100:00100000:1.0:1783952017.917565:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+12:2400:x1870605447721856:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952017.917609:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+12:2400:x1870605447721856:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 44us (14852us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952017.917615:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1216 00000100:00080000:1.0:1783952017.917761:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783952017.917766:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952017.917769:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952017.917771:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783952017.952776:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783952018.020079:0:89060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00010000:00010000:2.0:1783952018.977011:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783952019.984347:0:89886:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00010000:00010000:3.0:1783952020.000971:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952020.067713:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465465472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952020.067795:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952020.068123:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465465472 00000100:00100000:0.0:1783952020.068133:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465465472 00000100:00100000:0.0:1783952020.068191:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:0.0:1783952020.068199:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465465472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952020.068233:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952020.068299:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465465472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952020.068306:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:0.0:1783952020.068354:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465465472:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783952020.068471:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952020.069311:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465465600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952020.069356:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952020.069470:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465465600 00000100:00100000:0.0:1783952020.069475:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465465600 00000100:00100000:0.0:1783952020.069515:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1783952020.069522:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465465600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952020.069547:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952020.069821:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465465600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 298us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952020.069828:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00080000:0.0:1783952020.069864:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952020.070101:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465465600:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783952021.025959:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783952021.797090:0:89934:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 10:13:41 (1783952021) 00000100:00100000:3.0:1783952021.911091:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952021.911133:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447722368 00000100:00100000:3.0:1783952021.911143:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447722368 00000100:00100000:3.0:1783952021.911206:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1215 00000100:00100000:3.0:1783952021.911215:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:69444:x1870605447722368:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952021.911235:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952021.911253:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4eb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a251 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911315:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911329:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911340:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911355:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ec2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911379:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911386:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911432:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911439:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911446:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911453:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911459:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952021.911463:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911471:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911483:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b164ef8000) 00010000:00010000:3.0:1783952021.911486:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952021.911491:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911498:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4ebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911520:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911526:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911532:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911537:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952021.911540:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911546:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911553:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b150d9e900) 00010000:00010000:3.0:1783952021.911556:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952021.911559:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ec2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911563:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ec2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911611:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4eb4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a251 expref: 11 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911623:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b164ef8000) 00010000:00010000:3.0:1783952021.911625:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952021.911635:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4eb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a251 expref: 11 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.911644:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70000, rc 0) 00000100:00100000:3.0:1783952021.911695:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:69444:x1870605447722368:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 482us (616us total) trans 0 rc 301/301 00000100:00100000:3.0:1783952021.911702:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1215 00000100:00080000:3.0:1783952021.911723:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952021.915421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952021.915501:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447722624 00000100:00100000:2.0:1783952021.915510:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447722624 00000100:00100000:2.0:1783952021.915570:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1216 00000100:00100000:2.0:1783952021.915581:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+10:69444:x1870605447722624:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783952021.915624:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952021.915628:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783952021.915655:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4e6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a22e expref: 10 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.915672:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b164ef8000) 00010000:00010000:2.0:1783952021.915684:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952021.915701:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb4ec9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a258 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.915813:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb4ed0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.915844:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb4ed0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.915852:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb4ed0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.915866:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.915872:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.915878:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916259:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916269:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916277:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952021.916285:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1783952021.916308:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb4ed0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916314:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb4ed0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916321:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb4ed0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916333:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cd200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952021.916337:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb4ed0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916344:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb4ed0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916353:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803700) 00010000:00010000:2.0:1783952021.916356:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952021.916360:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb4ed0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916366:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb4ed0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952021.916378:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000473e84f9 reply state 000000007732ee35 transno 111669149700 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916389:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916395:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b04d803d00) 00010000:00010000:2.0:1783952021.916398:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952021.916400:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783952021.916425:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb4ec9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a258 expref: 12 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916442:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a258 expref: 11 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952021.916461:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d803c00) 00010000:00010000:2.0:1783952021.916463:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952021.916465:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a000, rc 0) 00000100:00100000:2.0:1783952021.916527:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+12:69444:x1870605447722624:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 948us (1115us total) trans 111669149700 rc 0/0 00000100:00100000:2.0:1783952021.916535:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1216 00000100:00100000:0.0:1783952021.924932:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952021.924999:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447722880 00000100:00100000:3.0:1783952021.925009:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447722880 00000100:00100000:3.0:1783952021.925065:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1217 00000100:00100000:3.0:1783952021.925075:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:69444:x1870605447722880:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952021.925099:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952021.925119:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4eec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a25f expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.925224:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.925240:0:66236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a258 expref: 13 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.925248:0:66236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.925278:0:66236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a258 expref: 13 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.925305:0:66236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a258 expref: 13 pid: 83761 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952021.925319:0:66236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66236:1870605465465728:192.168.202.48@tcp:104: 00000100:00100000:3.0:1783952021.925402:0:66236:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1449a0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783952021.930427:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952021.930517:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447723008 00000100:00100000:3.0:1783952021.930527:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447723008 00010000:00010000:3.0:1783952021.930563:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a258 expref: 14 pid: 83761 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952021.930616:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2548 00000100:00100000:3.0:1783952021.930626:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458183b2-4c6d-478c-9fed-a955779e6611+14:2401:x1870605447723008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783952021.930642:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952021.930649:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a258 expref: 14 pid: 83761 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.930662:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a258 expref: 14 pid: 83761 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.930686:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d803c00) 00010000:00010000:3.0:1783952021.930692:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.930702:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.930725:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.930841:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952021.930896:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:458183b2-4c6d-478c-9fed-a955779e6611+14:2401:x1870605447723008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 271us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952021.930904:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2548 00010000:00010000:3.0:1783952021.931025:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4ede lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a258 expref: 13 pid: 83761 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952021.931046:0:66236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66236:1870605465465728:192.168.202.48@tcp:104: 00010000:00010000:3.0:1783952021.931066:0:66236:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931074:0:66236:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931080:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952021.931098:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00000004:00080000:3.0:1783952021.931240:0:66236:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6a3:0x0], count =127 00000004:00080000:3.0:1783952021.931248:0:66236:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6a3:0x0]+127 in llog 00000004:00080000:3.0:1783952021.931285:0:66236:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x722:0x0], index 0: 0 00010000:00010000:3.0:1783952021.931408:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931417:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931435:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931441:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952021.931494:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931503:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931513:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d803c00) 00010000:00010000:3.0:1783952021.931517:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783952021.931521:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931527:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4ef3 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931583:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4eec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a25f expref: 13 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931613:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9e900) 00010000:00010000:3.0:1783952021.931615:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783952021.931619:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4eec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a25f expref: 13 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952021.931632:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70000, rc 0) 00000100:00100000:3.0:1783952021.931673:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:69444:x1870605447722880:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6600us (6752us total) trans 111669149701 rc 301/301 00000100:00100000:3.0:1783952021.931690:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1217 00000100:00100000:0.0:1783952021.935637:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952021.936072:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447723264 00000100:00100000:3.0:1783952021.936081:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447723264 00000100:00100000:3.0:1783952021.936138:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 226 00000100:00100000:3.0:1783952021.936149:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:69444:x1870605447723264:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1783952021.936415:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+13:69444:x1870605447723264:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 267us (786us total) trans 111669149702 rc 0/0 00000100:00100000:3.0:1783952021.936424:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 226 00000100:00100000:2.0:1783952021.946964:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952021.954958:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447723520 00000100:00100000:0.0:1783952021.954972:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447723520 00000100:00100000:0.0:1783952021.955034:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 227 00000100:00100000:0.0:1783952021.955045:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+13:69444:x1870605447723520:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1783952021.955265:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+14:69444:x1870605447723520:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 221us (8309us total) trans 111669149703 rc 0/0 00000100:00100000:0.0:1783952021.955282:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 227 00010000:00010000:3.0:1783952022.048847:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952022.113049:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783952022.113073:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465465856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952022.113147:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952022.114170:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465466112:0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.114215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952022.114236:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465466624:0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.114260:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952022.114275:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465467136:0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.114296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952022.114315:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783952022.114320:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465465984:0@lo:400:kworker.0 00000100:00100000:2.0:1783952022.114729:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465465856 00000100:00100000:2.0:1783952022.114737:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465465856 00000100:00100000:2.0:1783952022.114909:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465466624 00000100:00100000:2.0:1783952022.114913:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465466624 00000100:00100000:2.0:1783952022.114934:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:2.0:1783952022.114942:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465465856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783952022.114978:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:2.0:1783952022.115028:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465465856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952022.115035:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:2.0:1783952022.115053:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:2.0:1783952022.115059:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465466624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952022.115088:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465466624:12345-0@lo:400:kworker.0 Request processed in 29us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952022.115094:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:3.0:1783952022.115183:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465466112 00000100:00100000:3.0:1783952022.115188:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465466112 00000100:00100000:3.0:1783952022.115234:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1783952022.115241:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465466112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.115275:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465466112:12345-0@lo:400:kworker.0 Request processed in 35us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952022.115281:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1783952022.115301:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465467136 00000100:00100000:3.0:1783952022.115304:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465467136 00000100:00100000:3.0:1783952022.115328:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:3.0:1783952022.115334:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465467136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.115380:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465467136:12345-0@lo:400:kworker.0 Request processed in 46us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952022.115397:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00100000:3.0:1783952022.115425:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465466240:0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.115452:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952022.115469:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465466752:0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.115487:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952022.115502:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465467264:0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.115519:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952022.115553:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465465856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952022.115571:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783952022.115578:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465466368:0@lo:400:kworker.0 00000100:00080000:2.0:1783952022.117701:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952022.117711:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952022.117729:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465466240 00000100:00100000:2.0:1783952022.117761:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465466240 00000100:00100000:2.0:1783952022.117816:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1783952022.117838:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465466240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.126999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952022.127065:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465466496:0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952022.127169:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465467008:0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952022.127232:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465466112:0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465466624:0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127256:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465467136:0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127307:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465466496 00000100:00100000:0.0:1783952022.127313:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465466496 00000100:00100000:0.0:1783952022.127363:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465467008 00000100:00100000:0.0:1783952022.127366:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465467008 00000100:00100000:0.0:1783952022.127388:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:0.0:1783952022.127395:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465466496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127450:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465466496:12345-0@lo:400:kworker.0 Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952022.127457:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:0.0:1783952022.127471:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1783952022.127477:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465467008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127500:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465467008:12345-0@lo:400:kworker.0 Request processed in 24us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952022.127506:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1783952022.127527:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465466496:0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127536:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465467008:0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127579:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465466752 00000100:00100000:0.0:1783952022.127582:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465466752 00000100:00100000:0.0:1783952022.127623:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465467264 00000100:00100000:0.0:1783952022.127626:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465467264 00000100:00100000:0.0:1783952022.127643:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1783952022.127648:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465466752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127688:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465466752:12345-0@lo:400:kworker.0 Request processed in 40us (12200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952022.127694:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1783952022.127705:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00100000:0.0:1783952022.127710:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465467264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127734:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465467264:12345-0@lo:400:kworker.0 Request processed in 24us (12214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952022.127740:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00100000:0.0:1783952022.127789:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465465984 00000100:00100000:0.0:1783952022.127798:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465465984 00000100:00100000:0.0:1783952022.127838:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783952022.127845:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465465984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952022.127880:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465465984:12345-0@lo:400:kworker.0 Request processed in 36us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952022.127886:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1783952022.127916:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952022.127920:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952022.127923:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952022.127937:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465465984:0@lo:400:kworker.0 00000100:00100000:2.0:1783952022.132278:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465466240:12345-0@lo:400:kworker.0 Request processed in 14446us (16817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952022.132293:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1783952022.134140:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952022.134188:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465466880:0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.134227:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952022.134254:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465467392:0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.134296:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952022.134326:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465466368 00000100:00100000:3.0:1783952022.134333:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465466368 00000100:00100000:3.0:1783952022.134397:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465467392 00000100:00100000:3.0:1783952022.134400:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465467392 00000100:00100000:3.0:1783952022.134422:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:3.0:1783952022.134430:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465466368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.134480:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465466368:12345-0@lo:400:kworker.0 Request processed in 51us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952022.134487:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:3.0:1783952022.134508:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1783952022.134513:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465467392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.134539:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465467392:12345-0@lo:400:kworker.0 Request processed in 26us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952022.134545:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00080000:3.0:1783952022.134564:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952022.134619:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465467392:0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.134634:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465466240:0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.134646:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465466752:0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.134656:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465467264:0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.134685:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465466368:0@lo:400:kworker.0 00000100:00100000:2.0:1783952022.135009:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465466880 00000100:00100000:2.0:1783952022.135014:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465466880 00000100:00100000:2.0:1783952022.135059:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:2.0:1783952022.135065:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465466880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952022.135105:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465466880:12345-0@lo:400:kworker.0 Request processed in 40us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952022.135111:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00080000:3.0:1783952022.143408:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952022.143463:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465466880:0@lo:400:kworker.0 00000100:00100000:3.0:1783952022.628940:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465467520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952022.629015:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952022.629109:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465467520 00000100:00100000:2.0:1783952022.629116:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465467520 00000100:00100000:2.0:1783952022.629166:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:2.0:1783952022.629174:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465467520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783952022.629202:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952022.629242:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465467520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952022.629248:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:3.0:1783952022.629371:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465467520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952022.632705:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952022.632730:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465467648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952022.632797:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952022.633095:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465467648 00000100:00100000:2.0:1783952022.633104:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465467648 00000100:00100000:2.0:1783952022.633161:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:2.0:1783952022.633170:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465467648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952022.633203:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1783952022.633250:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465467648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952022.633269:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00100000:3.0:1783952022.633348:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465467648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952022.642534:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783952022.642559:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465467776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952022.642731:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952022.642831:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465467776 00000100:00100000:0.0:1783952022.642839:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465467776 00000100:00100000:0.0:1783952022.642891:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:0.0:1783952022.642900:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465467776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783952022.642929:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952022.642975:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465467776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952022.642982:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:2.0:1783952022.644166:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465467776:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1783952022.989292:0:89060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149703 is committed 00010000:00010000:1.0:1783952022.989933:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952022.990191:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952022.990200:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952022.990226:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cd400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952022.990231:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952022.990238:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952022.990257:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b04d803d00) 00010000:00010000:1.0:1783952022.990260:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952022.990265:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952022.990271:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb4ed7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952023.027856:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952023.027905:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952023.027941:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952023.027995:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952023.028204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952023.028244:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447724160 00000100:00100000:3.0:1783952023.028257:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447724160 00000100:00100000:3.0:1783952023.028335:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447724032 00000100:00100000:3.0:1783952023.028339:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447724032 00000100:00100000:3.0:1783952023.028370:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2710 00000100:00100000:3.0:1783952023.028384:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447724160:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952023.028490:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447724160:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 109us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952023.028498:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2710 00000100:00100000:3.0:1783952023.028518:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2711 00000100:00100000:3.0:1783952023.028525:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447724032:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952023.028554:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:458183b2-4c6d-478c-9fed-a955779e6611+5:2400:x1870605447724032:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952023.028561:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2711 00000100:00080000:3.0:1783952023.028625:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952023.028631:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952023.029190:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447723904 00000100:00100000:1.0:1783952023.029199:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447723904 00000100:00100000:0.0:1783952023.029765:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447723648 00000100:00100000:0.0:1783952023.029772:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447723648 00000100:00100000:0.0:1783952023.029836:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 84 00000100:00100000:0.0:1783952023.029846:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447723648:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952023.029908:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447723648:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 65us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952023.029916:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 84 00000100:00100000:0.0:1783952023.030177:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447723776 00000100:00100000:0.0:1783952023.030192:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447723776 00000100:00100000:1.0:1783952023.031770:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1223 00000100:00100000:1.0:1783952023.031791:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447723904:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952023.031906:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447723904:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 123us (3999us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952023.031915:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1223 00000100:00100000:0.0:1783952023.032422:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1224 00000100:00100000:0.0:1783952023.032433:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:2400:x1870605447723776:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952023.032496:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:2400:x1870605447723776:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 65us (4501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952023.032503:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1224 00000100:00080000:3.0:1783952023.041851:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783952023.041871:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783952023.074775:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952023.082914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952023.082988:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447724288 00000100:00100000:3.0:1783952023.083002:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447724288 00000100:00100000:3.0:1783952023.083082:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1218 00000100:00100000:3.0:1783952023.083096:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+9:69453:x1870605447724288:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952023.083126:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952023.083159:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a266 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.083292:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4f08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.083312:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4f08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.083327:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4f08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952023.083397:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783952023.083402:0:66237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952023.083429:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4f08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.083474:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a266 expref: 11 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.083492:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4f08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a266 expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.083501:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9e900) 00010000:00010000:3.0:1783952023.083505:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783952023.083509:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71000, rc 0) 00000100:00100000:3.0:1783952023.083624:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:69453:x1870605447724288:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 531us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952023.083633:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1218 00000100:00100000:1.0:1783952023.101296:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952023.101369:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447724416 00000100:00100000:0.0:1783952023.101382:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447724416 00000100:00100000:0.0:1783952023.103873:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1219 00000100:00100000:0.0:1783952023.103901:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+10:69453:x1870605447724416:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:0.0:1783952023.103970:0:67035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00000100:00100000:0.0:1783952023.104073:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+10:69453:x1870605447724416:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 183us (2793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952023.104082:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1219 00000100:00100000:0.0:1783952023.119400:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952023.119775:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447724544 00000100:00100000:3.0:1783952023.119790:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447724544 00000100:00100000:3.0:1783952023.119881:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1220 00000100:00100000:3.0:1783952023.119893:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:69453:x1870605447724544:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:3.0:1783952023.119947:0:83761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783952023.120049:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:69453:x1870605447724544:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 158us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952023.120057:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1220 00000100:00100000:1.0:1783952023.128459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952023.128549:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447724672 00000100:00100000:3.0:1783952023.128563:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447724672 00000100:00100000:3.0:1783952023.128667:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2123 00000100:00100000:3.0:1783952023.128680:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:69453:x1870605447724672:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783952023.128718:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952023.129484:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:69453:x1870605447724672:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 804us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952023.129496:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2123 00000100:00100000:1.0:1783952023.132346:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952023.134694:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447724800 00000100:00100000:0.0:1783952023.134716:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447724800 00000100:00100000:0.0:1783952023.134812:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2124 00000100:00100000:0.0:1783952023.134835:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:69453:x1870605447724800:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783952023.134875:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952023.134987:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+5:69453:x1870605447724800:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 154us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952023.134995:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2124 00000100:00100000:1.0:1783952023.213262:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952023.214141:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447725056 00000100:00100000:2.0:1783952023.214158:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447725056 00000100:00100000:2.0:1783952023.214234:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1221 00000100:00100000:2.0:1783952023.214245:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+10:69460:x1870605447725056:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00010000:2.0:1783952023.214319:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952023.214351:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb4f08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a266 expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.214370:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9e900) 00010000:00010000:2.0:1783952023.214384:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952023.214458:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.214472:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.214484:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.214495:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.214501:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.214516:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.214991:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.215000:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.215007:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.215014:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.215020:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ba00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952023.215025:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.215045:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.215055:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803700) 00010000:00010000:2.0:1783952023.215058:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952023.215062:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.215069:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952023.215085:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000231fc7f reply state 0000000071c26100 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.215105:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.215111:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b04d803400) 00010000:00010000:2.0:1783952023.215114:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952023.215117:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952023.215225:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+11:69460:x1870605447725056:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 981us (1975us total) trans 111669149704 rc 0/0 00000100:00100000:2.0:1783952023.215233:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1221 00000100:00100000:3.0:1783952023.243350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952023.243422:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447725184 00000100:00100000:2.0:1783952023.243436:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447725184 00000100:00100000:2.0:1783952023.243512:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1222 00000100:00100000:2.0:1783952023.243524:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:69463:x1870605447725184:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:2.0:1783952023.243558:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952023.243611:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a26d expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.243698:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.243715:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.243730:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952023.243785:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783952023.243789:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783952023.243838:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.243870:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a26d expref: 13 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.243889:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a26d expref: 12 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952023.243899:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803700) 00010000:00010000:2.0:1783952023.243902:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783952023.243906:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216be00, rc 0) 00000100:00100000:2.0:1783952023.243992:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:69463:x1870605447725184:12345-192.168.202.48@tcp:101:rm.0 Request processed in 470us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952023.244001:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1222 00000100:00100000:3.0:1783952023.248139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952023.250963:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447725312 00000100:00100000:0.0:1783952023.250985:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447725312 00000100:00100000:0.0:1783952023.251080:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1223 00000100:00100000:0.0:1783952023.251093:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+12:69463:x1870605447725312:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:0.0:1783952023.251123:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952023.251151:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbda00/0x22c73c7857bb4f2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a274 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251241:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb4f32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251259:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb4f32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251273:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb4f32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251286:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4f39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251293:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251301:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251416:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb4f40 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251425:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb4f40 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251431:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb4f40 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952023.251498:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0xa:0x0]: returning size 0 00000004:00200000:0.0:1783952023.251502:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783952023.251531:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb4f40 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251545:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb4f40 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251555:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb4f32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251562:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb4f32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251569:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb4f32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251576:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952023.251581:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb4f32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251616:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb4f32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251630:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803700) 00010000:00010000:0.0:1783952023.251633:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952023.251639:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb4f32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251646:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb4f32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251665:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251672:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4f39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251677:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4f39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251683:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952023.251686:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4f39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251692:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4f39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251700:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b04d803400) 00010000:00010000:0.0:1783952023.251703:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952023.251706:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4f39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251712:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb4f39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251741:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbda00/0x22c73c7857bb4f2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a274 expref: 14 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251758:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb4f40 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a274 expref: 13 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.251778:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff97b143007f00) 00010000:00010000:0.0:1783952023.251781:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952023.251784:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbdc00, rc 0) 00000100:00100000:0.0:1783952023.251888:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+13:69463:x1870605447725312:12345-192.168.202.48@tcp:101:rm.0 Request processed in 797us (3762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952023.251897:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1223 00000100:00100000:3.0:1783952023.255228:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952023.255628:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447725568 00000100:00100000:0.0:1783952023.255641:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447725568 00000100:00100000:0.0:1783952023.255707:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1224 00000100:00100000:0.0:1783952023.255719:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+13:69463:x1870605447725568:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:0.0:1783952023.255792:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783952023.255841:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb4f40 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a274 expref: 13 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.255868:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff97b143007f00) 00010000:00010000:0.0:1783952023.255889:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a26d expref: 12 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.255901:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803700) 00010000:00010000:0.0:1783952023.255908:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952023.255939:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.255954:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.255964:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.255995:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256003:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256010:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256132:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb4f55 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256142:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb4f55 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256149:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb4f55 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256392:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256402:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256410:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256418:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256425:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256440:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256471:0:68591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952023.256496:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb4f55 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256503:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb4f55 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256510:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb4f55 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256517:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952023.256523:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb4f55 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256532:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb4f55 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256541:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff97b143007d00) 00010000:00010000:0.0:1783952023.256544:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783952023.256549:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb4f55 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256556:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb4f55 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256576:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256582:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256639:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256645:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256650:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952023.256654:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256661:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256669:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b143007a00) 00010000:00010000:0.0:1783952023.256672:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952023.256675:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256681:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb4f47 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952023.256695:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003adb5f92 reply state 00000000695e5caa transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256708:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952023.256715:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b04d803400) 00010000:00010000:0.0:1783952023.256717:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952023.256720:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952023.256832:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+13:69463:x1870605447725568:12345-192.168.202.48@tcp:36:rm.0 Request processed in 1112us (1617us total) trans 111669149705 rc 0/0 00000100:00100000:0.0:1783952023.256848:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1224 00010000:00010000:3.0:1783952023.257023:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952023.257033:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.257042:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952023.257046:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.257054:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.257077:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff97b143007d00) 00010000:00010000:3.0:1783952023.257079:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783952023.257083:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.257089:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f5c lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952023.257105:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952023.257107:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952023.257109:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952024.096894:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952025.120852:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952025.185520:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783952025.185572:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465467904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952025.185725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952025.185936:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465467904 00000100:00100000:2.0:1783952025.185948:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465467904 00000100:00100000:2.0:1783952025.186029:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:2.0:1783952025.186043:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465467904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952025.186090:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952025.186153:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465467904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952025.186160:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00080000:3.0:1783952025.186289:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952025.187046:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465467904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952025.189046:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783952025.189071:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465468032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952025.189151:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952025.189204:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465468032 00000100:00100000:2.0:1783952025.189212:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465468032 00000100:00100000:2.0:1783952025.189280:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:2.0:1783952025.189289:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465468032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783952025.189327:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952025.189369:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465468032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952025.189376:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00100000:2.0:1783952025.189436:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465468032:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783952025.189741:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783952026.146816:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952027.172155:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952027.233203:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465468160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952027.233302:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465468288:0@lo:400:kworker.0 00000100:00100000:0.0:1783952027.233311:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952027.233381:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465468160 00000100:00100000:2.0:1783952027.233394:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465468160 00000100:00100000:2.0:1783952027.233467:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:2.0:1783952027.233479:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465468160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783952027.233529:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783952027.233562:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465468416:0@lo:400:kworker.0 00000100:00100000:1.0:1783952027.233673:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952027.233725:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465468800:0@lo:400:kworker.0 00000100:00100000:1.0:1783952027.233757:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952027.233790:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465469312:0@lo:400:kworker.0 00000100:00100000:1.0:1783952027.233814:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952027.233832:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465469824:0@lo:400:kworker.0 00000100:00100000:1.0:1783952027.233860:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952027.233894:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465468288 00000100:00100000:1.0:1783952027.233899:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465468288 00000100:00100000:1.0:1783952027.233932:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783952027.233939:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465468288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952027.233979:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465468288:12345-0@lo:400:kworker.0 Request processed in 40us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952027.233987:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783952027.234028:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465468800 00000100:00100000:3.0:1783952027.234212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952027.234239:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465468928:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.234263:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952027.234281:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465469440:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.234303:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952027.234334:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465469312 00000100:00100000:3.0:1783952027.234338:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465469312 00000100:00100000:3.0:1783952027.234374:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465469824 00000100:00100000:3.0:1783952027.234377:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465469824 00000100:00100000:3.0:1783952027.234396:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465468416 00000100:00100000:3.0:1783952027.234398:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465468416 00000100:00100000:3.0:1783952027.234424:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1783952027.234430:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465469312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952027.235116:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465468160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1635us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952027.235128:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:2.0:1783952027.235151:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465468928 00000100:00100000:2.0:1783952027.235156:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465468928 00000100:00100000:2.0:1783952027.235174:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465469440 00000100:00100000:2.0:1783952027.235177:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465469440 00000100:00100000:2.0:1783952027.235191:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:2.0:1783952027.235198:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465468928:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783952027.235224:0:8444:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b048dfb100 x1870605465468928/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:288/0 lens 224/224 e 0 to 0 dl 1783952038 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952027.235272:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465468928:12345-0@lo:400:kworker.0 Request processed in 75us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952027.235279:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00100000:2.0:1783952027.235302:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:2.0:1783952027.235308:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465469440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952027.235341:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465469440:12345-0@lo:400:kworker.0 Request processed in 33us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952027.235346:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:2.0:1783952027.235377:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:2.0:1783952027.235385:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465469824:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783952027.235397:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04ab3d180 x1870605465469824/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:288/0 lens 224/224 e 0 to 0 dl 1783952038 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952027.235427:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465469824:12345-0@lo:400:kworker.0 Request processed in 43us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952027.235434:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:2.0:1783952027.235450:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:2.0:1783952027.235457:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465468416:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783952027.235466:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b048dfa300 x1870605465468416/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:288/0 lens 224/224 e 0 to 0 dl 1783952038 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952027.235489:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465468416:12345-0@lo:400:kworker.0 Request processed in 34us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952027.235495:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:2.0:1783952027.235561:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465468544:0@lo:400:kworker.0 00000100:00100000:2.0:1783952027.235619:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952027.235643:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465469056:0@lo:400:kworker.0 00000100:00100000:2.0:1783952027.235670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952027.235690:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465469568:0@lo:400:kworker.0 00000100:00100000:2.0:1783952027.235727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952027.235752:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783952027.235759:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465468672:0@lo:400:kworker.0 00000100:00100000:2.0:1783952027.235812:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952027.235834:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465469184:0@lo:400:kworker.0 00000100:00100000:2.0:1783952027.235858:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:3.0:1783952027.236815:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04ab3ea00 x1870605465469312/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:288/0 lens 224/224 e 0 to 0 dl 1783952038 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952027.236823:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465469696:0@lo:400:kworker.0 00000100:00100000:1.0:1783952027.236920:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465468800 00000100:00100000:1.0:1783952027.236981:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465468544 00000100:00100000:1.0:1783952027.236985:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465468544 00000100:00100000:1.0:1783952027.237001:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465468672 00000100:00100000:1.0:1783952027.237009:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465468672 00000100:00100000:1.0:1783952027.237029:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:1.0:1783952027.237038:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465468800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.238119:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465469312:12345-0@lo:400:kworker.0 Request processed in 3681us (4295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952027.238147:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1783952027.238185:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1783952027.238200:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465468544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.238262:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465468544:12345-0@lo:400:kworker.0 Request processed in 69us (2642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952027.238268:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1783952027.238284:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1783952027.238290:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465468672:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783952027.238305:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b05095b100 x1870605465468672/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:288/0 lens 224/224 e 0 to 0 dl 1783952038 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952027.238337:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465468672:12345-0@lo:400:kworker.0 Request processed in 47us (2524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952027.238343:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00080000:3.0:1783952027.238388:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952027.238395:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952027.238459:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465468416:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.238476:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465468928:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.238491:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465469440:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.238581:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465469056 00000100:00100000:3.0:1783952027.238608:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465469056 00000100:00100000:3.0:1783952027.238687:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1783952027.238696:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465469056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.238736:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465469056:12345-0@lo:400:kworker.0 Request processed in 43us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952027.238743:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1783952027.238755:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465469568 00000100:00100000:3.0:1783952027.238759:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465469568 00000100:00100000:3.0:1783952027.238793:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465469184 00000100:00100000:3.0:1783952027.238797:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465469184 00000100:00100000:3.0:1783952027.238821:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:3.0:1783952027.238826:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465469568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.238857:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465469568:12345-0@lo:400:kworker.0 Request processed in 31us (3129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952027.238864:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:3.0:1783952027.238875:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00100000:3.0:1783952027.238881:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465469184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.238911:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465469184:12345-0@lo:400:kworker.0 Request processed in 30us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952027.238917:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00080000:3.0:1783952027.238936:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952027.238939:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952027.239518:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465468160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952027.239617:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465469312:0@lo:400:kworker.0 00000100:00100000:0.0:1783952027.239634:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465469824:0@lo:400:kworker.0 00000100:00100000:0.0:1783952027.239646:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465468288:0@lo:400:kworker.0 00000100:00100000:2.0:1783952027.241553:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952027.241715:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465469696 00000100:00100000:3.0:1783952027.241730:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465469696 00000100:00100000:3.0:1783952027.241825:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:3.0:1783952027.241836:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17743b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465469696:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783952027.241927:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952027.255268:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465468800:12345-0@lo:400:kworker.0 Request processed in 18217us (21495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952027.255289:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:1.0:1783952027.255521:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465468800:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.256023:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17743b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465469696:12345-0@lo:400:kworker.0 Request processed in 14187us (14476us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952027.256069:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00100000:3.0:1783952027.260303:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465469696:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.260331:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465468544:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.260345:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465469056:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.260360:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465469568:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.260401:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465468672:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.260415:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465469184:0@lo:400:kworker.0 00000100:00100000:3.0:1783952027.746332:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465469952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952027.746431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952027.746505:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465469952 00000100:00100000:3.0:1783952027.746515:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465469952 00000100:00100000:3.0:1783952027.746577:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:3.0:1783952027.746607:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465469952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783952027.746655:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00010000:00000080:3.0:1783952027.746677:0:8444:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b048df9180 x1870605465469952/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:288/0 lens 224/368 e 0 to 0 dl 1783952038 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952027.746811:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465469952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 224us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952027.746820:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:3.0:1783952027.746880:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465469952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783952027.747427:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465470080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952027.747475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952027.750088:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465470208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952027.750185:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952027.754312:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465470080 00000100:00100000:2.0:1783952027.754330:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465470080 00000100:00100000:2.0:1783952027.754452:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465470208 00000100:00100000:2.0:1783952027.754457:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465470208 00000100:00100000:1.0:1783952027.754857:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:1.0:1783952027.754874:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465470080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952027.754923:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952027.755036:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465470080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (7559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952027.755044:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:1.0:1783952027.755077:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:1.0:1783952027.755085:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465470208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783952027.755106:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952027.755267:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465470208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (5082us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952027.755275:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:0.0:1783952027.755537:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465470080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952027.755616:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465470208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952028.154288:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952028.154999:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447725696 00000100:00100000:3.0:1783952028.155012:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447725696 00000100:00100000:3.0:1783952028.155076:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 86 00000100:00100000:3.0:1783952028.155086:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447725696:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952028.155158:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447725696:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 73us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952028.155166:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 86 00000100:00100000:0.0:1783952028.159946:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952028.159978:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952028.160003:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952028.160038:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952028.160067:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447726208 00000100:00100000:0.0:1783952028.160077:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447726208 00000100:00100000:0.0:1783952028.160130:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447726080 00000100:00100000:0.0:1783952028.160141:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447726080 00000100:00100000:0.0:1783952028.160164:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2716 00000100:00100000:0.0:1783952028.160174:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447726208:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952028.160239:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447726208:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 67us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952028.160246:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2716 00000100:00100000:0.0:1783952028.160264:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2717 00000100:00100000:0.0:1783952028.160270:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447726080:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952028.160296:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:458183b2-4c6d-478c-9fed-a955779e6611+5:2401:x1870605447726080:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952028.160302:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2717 00000100:00100000:0.0:1783952028.160321:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447725952 00000100:00100000:0.0:1783952028.160324:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447725952 00000100:00100000:0.0:1783952028.160351:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447725824 00000100:00100000:0.0:1783952028.160354:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447725824 00000100:00100000:0.0:1783952028.160373:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1231 00000100:00100000:0.0:1783952028.160380:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447725952:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952028.160406:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447725952:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952028.160412:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1231 00000100:00100000:0.0:1783952028.160424:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1232 00000100:00100000:0.0:1783952028.160430:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+13:2401:x1870605447725824:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000080:0.0:1783952028.160448:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b146b4df80 x1870605447725824/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:289/0 lens 224/224 e 0 to 0 dl 1783952039 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952028.160494:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+13:2401:x1870605447725824:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 64us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952028.160507:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1232 00000100:00080000:0.0:1783952028.160528:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952028.160532:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952028.160534:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952028.160537:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783952028.193735:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952029.216736:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783952029.671366:0:89060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149705 is committed 00010000:00010000:2.0:1783952029.671482:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671496:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671504:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671512:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952029.671517:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671525:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671561:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b04d803400) 00010000:00010000:2.0:1783952029.671570:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952029.671576:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671584:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a000/0x22c73c7857bb4f16 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671627:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671633:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671638:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671644:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbca00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952029.671647:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671654:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671662:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b04d803400) 00010000:00010000:2.0:1783952029.671665:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952029.671667:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952029.671674:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb4f4e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952030.241133:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952030.304954:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952030.304981:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465470336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952030.305065:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952030.305382:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465470336 00000100:00100000:2.0:1783952030.305399:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465470336 00000100:00100000:2.0:1783952030.305471:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:2.0:1783952030.305481:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465470336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783952030.305514:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952030.305574:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465470336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952030.305581:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00080000:0.0:1783952030.305698:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952030.305794:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465470336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952030.307640:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465470464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952030.307702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952030.308090:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465470464 00000100:00100000:2.0:1783952030.308097:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465470464 00000100:00100000:2.0:1783952030.308156:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:2.0:1783952030.308165:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465470464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952030.308197:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952030.308247:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465470464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952030.308255:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00100000:3.0:1783952030.308346:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465470464:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783952030.308397:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1783952030.917059:0:90330:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1783952031.038333:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952031.038412:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447726336 00000100:00100000:2.0:1783952031.038424:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447726336 00000100:00100000:2.0:1783952031.038509:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1225 00000100:00100000:2.0:1783952031.038520:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:69531:x1870605447726336:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952031.038540:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952031.038567:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a27b expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.038664:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.038680:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.038703:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952031.038757:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783952031.038761:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783952031.038784:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.038809:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb4f63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a27b expref: 11 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.038831:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a27b expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.038840:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803900) 00010000:00010000:2.0:1783952031.038843:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783952031.038847:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216be00, rc 0) 00010000:00000080:2.0:1783952031.038854:0:83761:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b048dfa680 x1870605447726336/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 576/688 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952031.038916:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+10:69531:x1870605447726336:12345-192.168.202.48@tcp:101:dd.0 Request processed in 398us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952031.038923:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1225 00000100:00080000:3.0:1783952031.039371:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783952031.048200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952031.048281:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447726592 00000100:00100000:3.0:1783952031.048294:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447726592 00000100:00100000:3.0:1783952031.048357:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1226 00000100:00100000:3.0:1783952031.048368:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:69531:x1870605447726592:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952031.048390:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952031.048394:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783952031.048422:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb4f6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a27b expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048453:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d803900) 00010000:00010000:3.0:1783952031.048475:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952031.048495:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4f71 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a282 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048654:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048667:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048678:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048690:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4f7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048696:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048703:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048776:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb4f86 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048783:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb4f86 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048790:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb4f86 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952031.048798:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:3.0:1783952031.048889:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048905:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048911:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048918:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048923:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952031.048927:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048935:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048944:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9ef00) 00010000:00010000:3.0:1783952031.048947:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952031.048950:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048956:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048967:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4f7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048972:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4f7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048977:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4f7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048988:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952031.048992:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4f7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.048998:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4f7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.049005:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b150d9e500) 00010000:00010000:3.0:1783952031.049007:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952031.049010:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4f7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.049015:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4f7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.049055:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4f71 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a282 expref: 12 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.049072:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb4f86 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a282 expref: 11 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.049079:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:3.0:1783952031.049082:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952031.049084:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70e00, rc 0) 00010000:00000080:3.0:1783952031.049092:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04ab3e300 x1870605447726592/t111669149706(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 776/848 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952031.049155:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+11:69531:x1870605447726592:12345-192.168.202.48@tcp:101:dd.0 Request processed in 789us (969us total) trans 111669149706 rc 0/0 00000100:00100000:3.0:1783952031.049171:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1226 00000100:00100000:3.0:1783952031.053204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952031.053291:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447726720 00000100:00100000:0.0:1783952031.053302:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447726720 00000100:00100000:0.0:1783952031.053362:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1227 00000100:00100000:0.0:1783952031.053373:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+11:69531:x1870605447726720:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952031.053400:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952031.053420:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f94 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a289 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.053546:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb4f9b lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.053559:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb4f9b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.053570:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb4f9b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.054282:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4f94 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a289 expref: 13 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.054301:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb4f9b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a289 expref: 12 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.054319:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:0.0:1783952031.054322:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783952031.054326:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbce00, rc 0) 00010000:00000080:0.0:1783952031.054335:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b048df8380 x1870605447726720/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 568/1344 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952031.054408:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:69531:x1870605447726720:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1037us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952031.054416:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1227 00000100:00100000:3.0:1783952031.060720:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952031.062019:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447726976 00000100:00100000:0.0:1783952031.062032:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447726976 00000100:00100000:0.0:1783952031.062105:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1228 00000100:00100000:0.0:1783952031.062116:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+12:69531:x1870605447726976:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:0.0:1783952031.062173:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952031.062202:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb4f86 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a282 expref: 12 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.062221:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:0.0:1783952031.062227:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952031.062425:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.063627:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.063646:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783952031.063725:0:83761:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149707 00000004:00010000:0.0:1783952031.063776:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0a3b0ff reply state 00000000562a9117 transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.063791:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.063798:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:0.0:1783952031.063800:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952031.063803:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1783952031.063851:0:83761:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b048df9c00 x1870605447726976/t111669149708(0) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 488/456 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952031.063930:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+14:69531:x1870605447726976:12345-192.168.202.48@tcp:36:dd.0 Request processed in 1816us (3218us total) trans 111669149708 rc 0/0 00000100:00100000:0.0:1783952031.063938:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1228 00000020:00080000:0.0:1783952031.063943:0:83761:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783952031.068309:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952031.068473:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447727104 00000100:00100000:0.0:1783952031.068483:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447727104 00000100:00100000:0.0:1783952031.068579:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1229 00000100:00100000:0.0:1783952031.068605:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+14:69531:x1870605447727104:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952031.068631:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952031.068653:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4fa9 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a290 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.068710:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4fa9 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a290 expref: 15 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.068762:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4fa9 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a290 expref: 15 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.068783:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:0.0:1783952031.068786:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783952031.068790:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd800, rc 0) 00010000:00000080:0.0:1783952031.068797:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b048df9f80 x1870605447727104/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 376/584 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952031.068860:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+15:69531:x1870605447727104:12345-192.168.202.48@tcp:101:dd.0 Request processed in 272us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952031.068867:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1229 00000100:00100000:1.0:1783952031.091939:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952031.091985:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447727360 00000100:00100000:1.0:1783952031.091994:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447727360 00000100:00100000:1.0:1783952031.092049:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1230 00000100:00100000:1.0:1783952031.092059:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+15:69531:x1870605447727360:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952031.092090:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952031.092094:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783952031.092124:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb4fa9 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a290 expref: 15 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.092141:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:1.0:1783952031.092147:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952031.092162:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031e00/0x22c73c7857bb4fb0 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a297 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.092214:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030e00/0x22c73c7857bb4fb7 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.092228:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030e00/0x22c73c7857bb4fb7 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.092239:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030e00/0x22c73c7857bb4fb7 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783952031.092352:0:66238:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x47d:0x0], count =677 00000004:00080000:1.0:1783952031.092359:0:66238:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x47d:0x0]+677 in llog 00000004:00080000:1.0:1783952031.092385:0:66238:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x722:0x0], index 1: 0 00000004:00080000:1.0:1783952031.092391:0:66238:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x723:0x0], index 0: 0 00010000:00010000:1.0:1783952031.092504:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030e00/0x22c73c7857bb4fb7 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a297 expref: 17 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.092513:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:1.0:1783952031.092516:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1783952031.092525:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031e00/0x22c73c7857bb4fb0 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a297 expref: 17 pid: 66238 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.092549:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030e00/0x22c73c7857bb4fb7 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a297 expref: 16 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.092605:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:1.0:1783952031.092608:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1783952031.092611:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030e00, rc 0) 00010000:00000080:1.0:1783952031.092620:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04ab3f100 x1870605447727360/t111669149709(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 376/608 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952031.092684:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+16:69531:x1870605447727360:12345-192.168.202.48@tcp:101:dd.0 Request processed in 626us (755us total) trans 111669149709 rc 0/0 00000100:00100000:1.0:1783952031.092691:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1230 00000100:00100000:3.0:1783952031.102767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952031.108342:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447727488 00000100:00100000:2.0:1783952031.108359:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447727488 00000100:00100000:2.0:1783952031.108431:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4921 00000100:00100000:2.0:1783952031.109338:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+5:69531:x1870605447727488:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952031.109359:0:26201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952031.109393:0:26201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000319e619f/0x22c73c7857bb4fbe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a29e expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952031.109420:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952031.109453:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=3746s v=(0 0) 00010000:00010000:2.0:1783952031.109458:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952031.109468:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000319e619f/0x22c73c7857bb4fbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a29e expref: 6 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.109484:0:26201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000319e619f/0x22c73c7857bb4fbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a29e expref: 6 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.109497:0:26201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216ba00, rc 0) 00000100:00100000:2.0:1783952031.109561:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+6:69531:x1870605447727488:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1121us (6804us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952031.109568:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4921 00000100:00080000:2.0:1783952031.109609:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952031.117227:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952031.117837:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447727616 00000100:00100000:2.0:1783952031.117847:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447727616 00000100:00100000:2.0:1783952031.117909:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4922 00000100:00100000:2.0:1783952031.117919:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:458183b2-4c6d-478c-9fed-a955779e6611+5:69531:x1870605447727616:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952031.117939:0:26199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952031.117963:0:26199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016714077/0x22c73c7857bb4fc5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2a5 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952031.117989:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952031.118014:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=3746s v=(0 0) 00010000:00010000:2.0:1783952031.118031:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952031.118040:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016714077/0x22c73c7857bb4fc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2a5 expref: 6 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.118058:0:26199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016714077/0x22c73c7857bb4fc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2a5 expref: 6 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.118074:0:26199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216be00, rc 0) 00000100:00100000:2.0:1783952031.118135:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:458183b2-4c6d-478c-9fed-a955779e6611+6:69531:x1870605447727616:12345-192.168.202.48@tcp:101:dd.0 Request processed in 217us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952031.118142:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4922 00000100:00080000:2.0:1783952031.118165:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952031.132347:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952031.134029:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447727744 00000100:00100000:1.0:1783952031.134044:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447727744 00000100:00100000:1.0:1783952031.134112:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4923 00000100:00100000:1.0:1783952031.134124:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:69531:x1870605447727744:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952031.134142:0:11961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952031.134162:0:11961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c1ee931/0x22c73c7857bb4fcc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2ac expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952031.134187:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952031.134211:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=3746s v=(0 0) 00010000:00010000:1.0:1783952031.134216:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952031.134225:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c1ee931/0x22c73c7857bb4fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2ac expref: 7 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.134261:0:11961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c1ee931/0x22c73c7857bb4fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2ac expref: 7 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.134274:0:11961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031e00, rc 0) 00000100:00100000:1.0:1783952031.134338:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:458183b2-4c6d-478c-9fed-a955779e6611+7:69531:x1870605447727744:12345-192.168.202.48@tcp:101:dd.0 Request processed in 217us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952031.134345:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4923 00000100:00100000:3.0:1783952031.136805:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952031.136848:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952031.136929:0:24877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447727872 00000100:00100000:1.0:1783952031.136938:0:24877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447727872 00002000:00010000:1.0:1783952031.136978:0:24877:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1826 (1048576->18446744073709551615) 00002000:00100000:1.0:1783952031.136984:0:24877:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b048df9880 with x1870605447727872 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1783952031.136995:0:24877:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97b048df9880. 00000100:00100000:1.0:1783952031.137029:0:24877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447728000 00000100:00100000:1.0:1783952031.137033:0:24877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447728000 00002000:00010000:1.0:1783952031.137048:0:24877:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1827 (0->18446744073709551615) 00002000:00100000:1.0:1783952031.137051:0:24877:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b048df9500 with x1870605447728000 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952031.137056:0:24877:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b048df9500. 00000100:00100000:1.0:1783952031.137076:0:24877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1000 00000100:00100000:1.0:1783952031.137086:0:24877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447727872:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:1.0:1783952031.137322:0:24877:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1783952031.137326:0:24877:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb mtime from disk: 0 -> 1783952032 00002000:00010000:1.0:1783952031.137328:0:24877:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783952031.137330:0:24877:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb ctime from disk: 0 -> 1783952032 00002000:00010000:1.0:1783952031.137333:0:24877:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783952031.137412:0:24877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447727872:12345-192.168.202.48@tcp:10:dd.0 Request processed in 327us (616us total) trans 4294968953 rc 0/0 00000100:00100000:1.0:1783952031.137420:0:24877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1000 00002000:00010000:1.0:1783952031.137424:0:24877:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1826 (1048576->18446744073709551615) 00002000:00100000:1.0:1783952031.137427:0:24877:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b048df9880 with x1870605447727872 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1783952031.137431:0:24877:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97b048df9880. 00000100:00100000:1.0:1783952031.137449:0:24877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1001 00000100:00100000:1.0:1783952031.137456:0:24877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447728000:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:1.0:1783952031.137560:0:24877:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783952031.137563:0:24877:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb mtime from disk: 0 -> 1783952032 00002000:00010000:1.0:1783952031.137565:0:24877:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783952031.137567:0:24877:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb ctime from disk: 0 -> 1783952032 00002000:00010000:1.0:1783952031.137569:0:24877:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x723:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783952031.137614:0:24877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:2400:x1870605447728000:12345-192.168.202.48@tcp:10:dd.0 Request processed in 158us (765us total) trans 4294968953 rc 0/0 00000100:00100000:1.0:1783952031.137621:0:24877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1001 00002000:00010000:1.0:1783952031.137624:0:24877:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1827 (0->18446744073709551615) 00002000:00100000:1.0:1783952031.137626:0:24877:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b048df9500 with x1870605447728000 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952031.137631:0:24877:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b048df9500. 00000100:00100000:1.0:1783952031.250156:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952031.250248:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447728256 00000100:00100000:0.0:1783952031.250258:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447728256 00000100:00100000:0.0:1783952031.250314:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 228 00000100:00100000:0.0:1783952031.250325:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+16:69531:x1870605447728256:12345-192.168.202.48@tcp:35:dd.0 00010000:00000080:2.0:1783952031.251050:0:66241:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04ab3ed80 x1870605447728256/t111669149710(0) o35->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 392/456 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952031.251164:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:458183b2-4c6d-478c-9fed-a955779e6611+17:69531:x1870605447728256:12345-192.168.202.48@tcp:35:dd.0 Request processed in 840us (1016us total) trans 111669149710 rc 0/0 00000100:00100000:2.0:1783952031.251173:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 228 00010000:00010000:3.0:1783952031.264944:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952031.306175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952031.306248:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447728384 00000100:00100000:3.0:1783952031.306270:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447728384 00000100:00100000:3.0:1783952031.306338:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1231 00000100:00100000:3.0:1783952031.306348:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+17:69532:x1870605447728384:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952031.306376:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952031.306400:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4fd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2b3 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.306480:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4fda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.306494:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4fda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.306506:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4fda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952031.306550:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783952031.306554:0:67035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952031.306574:0:67035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4fda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.306664:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4fd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2b3 expref: 19 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.306686:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4fda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2b3 expref: 18 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.306695:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9ef00) 00010000:00010000:3.0:1783952031.306699:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783952031.306704:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71a00, rc 0) 00010000:00000080:3.0:1783952031.306712:0:67035:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b05095b800 x1870605447728384/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 576/688 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952031.306785:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+18:69532:x1870605447728384:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 437us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952031.306792:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1231 00000100:00100000:3.0:1783952031.313789:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952031.314050:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447728640 00000100:00100000:1.0:1783952031.314061:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447728640 00000100:00100000:1.0:1783952031.314128:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1232 00000100:00100000:1.0:1783952031.314139:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+18:69532:x1870605447728640:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1783952031.314160:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952031.314195:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030000/0x22c73c7857bb4fe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2ba expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314271:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314285:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314295:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314309:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb4fef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314315:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb4fef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314320:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb4fef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314398:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314405:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314411:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314431:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314437:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952031.314447:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314455:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314466:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9ef00) 00010000:00010000:1.0:1783952031.314468:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952031.314472:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314478:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb4fe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.314503:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb4fef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.315851:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb4fef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.315858:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb4fef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.315863:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952031.315867:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb4fef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.315876:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb4fef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.317017:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b1584d4a00) 00010000:00010000:1.0:1783952031.317023:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952031.317048:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb4fef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.317056:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb4fef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.317121:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030000/0x22c73c7857bb4fe1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2ba expref: 19 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.317132:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9ef00) 00010000:00010000:1.0:1783952031.317134:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783952031.317138:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030000/0x22c73c7857bb4fe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2ba expref: 19 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952031.317147:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030000, rc 0) 00010000:00000080:1.0:1783952031.317155:0:68591:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b048df8700 x1870605447728640/t0(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 800/608 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952031.317296:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+18:69532:x1870605447728640:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3158us (3516us total) trans 0 rc 301/301 00000100:00100000:1.0:1783952031.317304:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1232 00000100:00100000:1.0:1783952031.333201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952031.336243:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447728768 00000100:00100000:3.0:1783952031.336259:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447728768 00000100:00100000:3.0:1783952031.336336:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1233 00000100:00100000:3.0:1783952031.336348:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+18:69532:x1870605447728768:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:3.0:1783952031.336440:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.336459:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.336472:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.336516:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4ffd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.336524:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.336531:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.336929:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.336940:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.336948:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952031.336991:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:3.0:1783952031.336996:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952031.337011:0:66238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337025:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337032:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337038:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337056:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337062:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952031.337066:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337074:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337085:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9ef00) 00010000:00010000:3.0:1783952031.337088:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952031.337092:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337099:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb4ff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337113:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337120:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4ffd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337126:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337131:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952031.337134:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337149:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4ffd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337157:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b150d9e500) 00010000:00010000:3.0:1783952031.337159:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952031.337161:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4ffd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337166:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb4ffd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337179:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337184:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337189:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337194:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952031.337197:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337203:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337209:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:3.0:1783952031.337212:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952031.337215:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.337229:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5004 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1783952031.337252:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04ab3e680 x1870605447728768/t0(0) o34->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 472/728 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952031.337335:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+18:69532:x1870605447728768:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 990us (4143us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952031.337343:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1233 00000100:00100000:2.0:1783952031.379493:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952031.379807:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447729024 00000100:00100000:3.0:1783952031.379818:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447729024 00000100:00100000:3.0:1783952031.379881:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1234 00000100:00100000:3.0:1783952031.379891:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+18:69534:x1870605447729024:12345-192.168.202.48@tcp:101:md5sum.0 00010000:00010000:3.0:1783952031.379913:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952031.379933:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb500b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2c1 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380013:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380041:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380054:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380070:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb5019 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380095:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb5019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380103:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb5019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380231:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb5020 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380242:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb5020 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380250:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb5020 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952031.380395:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00010000:00010000:3.0:1783952031.380557:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380565:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380572:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380579:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380837:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952031.380844:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380864:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380880:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9ef00) 00010000:00010000:3.0:1783952031.380882:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952031.380887:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380893:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70000/0x22c73c7857bb5012 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380906:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb5019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380911:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb5019 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380917:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb5019 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380922:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952031.380924:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb5019 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380929:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb5019 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380935:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b150d9e500) 00010000:00010000:3.0:1783952031.380938:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952031.380941:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb5019 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952031.380955:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70400/0x22c73c7857bb5019 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.381223:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb500b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2c1 expref: 21 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.381240:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb5020 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2c1 expref: 20 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952031.381273:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:2.0:1783952031.381275:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952031.381277:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71c00, rc 0) 00010000:00000080:2.0:1783952031.381287:0:67035:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050959880 x1870605447729024/t111669149711(0) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 800/872 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952031.381362:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+20:69534:x1870605447729024:12345-192.168.202.48@tcp:101:md5sum.0 Request processed in 1473us (1879us total) trans 111669149711 rc 0/0 00000100:00100000:2.0:1783952031.381372:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1234 00000100:00100000:2.0:1783952031.400409:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952031.401132:0:25554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447729152 00000100:00100000:3.0:1783952031.401144:0:25554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447729152 00002000:00100000:3.0:1783952031.401336:0:25554:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff97b050959500 x1870605447729152/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 488/0 e 0 to 0 dl 1783952042 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952031.401345:0:25554:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b050959500 with x1870605447729152 ext(0->32767) 00002000:00010000:3.0:1783952031.401350:0:25554:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b050959500 00000100:00100000:3.0:1783952031.401379:0:25554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1002 00000100:00100000:3.0:1783952031.401387:0:25554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:458183b2-4c6d-478c-9fed-a955779e6611+8:2400:x1870605447729152:12345-192.168.202.48@tcp:3:md5sum.0 00000100:00100000:3.0:1783952031.405474:0:25554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:458183b2-4c6d-478c-9fed-a955779e6611+8:2400:x1870605447729152:12345-192.168.202.48@tcp:3:md5sum.0 Request processed in 4077us (5064us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952031.405488:0:25554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1002 00002000:00100000:3.0:1783952031.405501:0:25554:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff97b050959500 x1870605447729152/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 488/440 e 0 to 0 dl 1783952042 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952031.405513:0:25554:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b050959500 with x1870605447729152 ext(0->32767) 00002000:00010000:3.0:1783952031.405519:0:25554:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b050959500 00000100:00100000:2.0:1783952031.415430:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952031.416961:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447729280 00000100:00100000:0.0:1783952031.416975:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447729280 00002000:00100000:0.0:1783952031.417038:0:24878:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff97b050958700 x1870605447729280/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 488/0 e 0 to 0 dl 1783952042 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952031.417050:0:24878:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b050958700 with x1870605447729280 ext(32768->1048575) 00002000:00010000:0.0:1783952031.417056:0:24878:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b050958700 00000100:00100000:0.0:1783952031.417097:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1003 00000100:00100000:0.0:1783952031.417107:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:2398:x1870605447729280:12345-192.168.202.48@tcp:3:md5sum.0 00000100:00100000:0.0:1783952031.439001:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:2398:x1870605447729280:12345-192.168.202.48@tcp:3:md5sum.0 Request processed in 21884us (23570us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952031.439016:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1003 00002000:00100000:0.0:1783952031.439040:0:24878:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff97b050958700 x1870605447729280/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 488/440 e 0 to 0 dl 1783952042 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952031.439051:0:24878:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b050958700 with x1870605447729280 ext(32768->1048575) 00002000:00010000:0.0:1783952031.439059:0:24878:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b050958700 00000100:00100000:2.0:1783952031.495230:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952031.495792:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447729536 00000100:00100000:0.0:1783952031.495803:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447729536 00000100:00100000:2.0:1783952031.499283:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 229 00000100:00100000:2.0:1783952031.499312:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177061450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:458183b2-4c6d-478c-9fed-a955779e6611+20:69534:x1870605447729536:12345-192.168.202.48@tcp:35:md5sum.0 00010000:00000080:2.0:1783952031.499540:0:81182:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b177061450 x1870605447729536/t111669149712(0) o35->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 392/456 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952031.499637:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177061450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:458183b2-4c6d-478c-9fed-a955779e6611+21:69534:x1870605447729536:12345-192.168.202.48@tcp:35:md5sum.0 Request processed in 339us (4415us total) trans 111669149712 rc 0/0 00000100:00100000:2.0:1783952031.505388:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 229 00000100:00100000:2.0:1783952031.550197:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952031.550370:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447729664 00000100:00100000:0.0:1783952031.550382:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447729664 00000100:00100000:0.0:1783952031.550460:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1235 00000100:00100000:0.0:1783952031.550471:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+21:69536:x1870605447729664:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:0.0:1783952031.550551:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550570:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550581:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550630:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb5035 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550637:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb5035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550643:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb5035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550758:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550767:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550774:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952031.550815:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1783952031.550820:0:66237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783952031.550833:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550860:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550867:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550873:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550880:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550885:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952031.550889:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550897:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550917:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b150d9ef00) 00010000:00010000:0.0:1783952031.550920:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952031.550924:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550931:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb502e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550947:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb5035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550952:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb5035 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550958:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb5035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550964:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952031.550967:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb5035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550973:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb5035 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550980:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b143007e00) 00010000:00010000:0.0:1783952031.550982:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952031.550985:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb5035 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.550991:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb5035 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.551017:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.551023:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.551029:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.551034:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952031.551037:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.551042:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.551050:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:0.0:1783952031.551052:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952031.551054:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952031.551059:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd000/0x22c73c7857bb503c lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1783952031.551080:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050958e00 x1870605447729664/t0(0) o34->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:292/0 lens 472/728 e 0 to 0 dl 1783952042 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952031.551362:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+21:69536:x1870605447729664:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 682us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952031.551371:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1235 00000100:00100000:3.0:1783952032.241952:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952032.242068:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952032.242848:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447729920 00000100:00100000:1.0:1783952032.242859:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447729920 00000100:00100000:1.0:1783952032.242915:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4924 00000100:00100000:1.0:1783952032.242925:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458183b2-4c6d-478c-9fed-a955779e6611+7:2399:x1870605447729920:12345-192.168.202.48@tcp:16:kworker.0 00000100:00100000:0.0:1783952032.245050:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447729792 00000100:00100000:0.0:1783952032.245073:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447729792 00002000:00100000:0.0:1783952032.245118:0:25538:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff97b048df8e00 x1870605447729792/t0(0) o4->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:293/0 lens 488/0 e 0 to 0 dl 1783952043 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952032.245131:0:25538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b048df8e00 with x1870605447729792 ext(1048576->2097151) 00002000:00010000:0.0:1783952032.245136:0:25538:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97b048df8e00 00000100:00100000:0.0:1783952032.245373:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1004 00000100:00100000:0.0:1783952032.245384:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:458183b2-4c6d-478c-9fed-a955779e6611+8:2399:x1870605447729792:12345-192.168.202.48@tcp:4:md5sum.0 00000001:00080000:2.0:1783952032.254029:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968953 is committed 00000100:00100000:0.0:1783952032.278283:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:458183b2-4c6d-478c-9fed-a955779e6611+8:2399:x1870605447729920:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 35346us (36201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.278299:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4924 00000100:00100000:3.0:1783952032.297984:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:458183b2-4c6d-478c-9fed-a955779e6611+8:2399:x1870605447729792:12345-192.168.202.48@tcp:4:md5sum.0 Request processed in 52591us (56032us total) trans 4294968954 rc 0/0 00000100:00100000:3.0:1783952032.297998:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1004 00002000:00100000:3.0:1783952032.298013:0:25538:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff97b048df8e00 x1870605447729792/t4294968954(0) o4->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:293/0 lens 488/448 e 0 to 0 dl 1783952043 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952032.298036:0:25538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b048df8e00 with x1870605447729792 ext(1048576->2097151) 00002000:00010000:3.0:1783952032.298043:0:25538:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97b048df8e00 00010000:00010000:1.0:1783952032.300743:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952032.357343:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465470592:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357416:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357468:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465471104:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357512:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465471616:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357533:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357551:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465472128:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357571:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357612:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783952032.357619:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465470720:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357641:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357657:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465471232:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357722:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357754:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465471744:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357788:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357820:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465470848:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357855:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357873:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465471360:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357895:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357910:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465471872:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357945:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783952032.357950:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465470976:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.357970:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.357985:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465471488:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.358006:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.358021:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465472000:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.358042:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.358070:0:89065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465470592 00000100:00100000:0.0:1783952032.358077:0:89065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465470592 00000100:00100000:0.0:1783952032.358122:0:89065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783952032.358130:0:89065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465470592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.358180:0:89065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465470592:12345-0@lo:400:kworker.0 Request processed in 51us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.358187:0:89065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783952032.358222:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465471104 00000100:00100000:0.0:1783952032.358226:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465471104 00000100:00100000:0.0:1783952032.358256:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465471616 00000100:00100000:0.0:1783952032.358259:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465471616 00000100:00100000:0.0:1783952032.358270:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465472128 00000100:00100000:0.0:1783952032.358279:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465472128 00000100:00100000:0.0:1783952032.358296:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465470720 00000100:00100000:0.0:1783952032.358298:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465470720 00000100:00100000:0.0:1783952032.358311:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1783952032.358317:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465471104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.358350:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465471104:12345-0@lo:400:kworker.0 Request processed in 34us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.358356:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1783952032.358367:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465470848 00000100:00100000:0.0:1783952032.358369:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465470848 00000100:00100000:0.0:1783952032.358382:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465470976 00000100:00100000:0.0:1783952032.358384:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465470976 00000100:00100000:0.0:1783952032.358396:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1783952032.358400:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465471616:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952032.358414:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1762f2680 x1870605465471616/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:293/0 lens 224/224 e 0 to 0 dl 1783952043 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952032.358441:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465471616:12345-0@lo:400:kworker.0 Request processed in 40us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.358447:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1783952032.358457:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1783952032.358463:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465472128:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952032.358472:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1762f3100 x1870605465472128/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:293/0 lens 224/224 e 0 to 0 dl 1783952043 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952032.358497:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465472128:12345-0@lo:400:kworker.0 Request processed in 34us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.358503:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1783952032.358515:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:0.0:1783952032.358528:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465470720:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952032.358539:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1762f3b80 x1870605465470720/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:293/0 lens 224/224 e 0 to 0 dl 1783952043 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952032.358566:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465470720:12345-0@lo:400:kworker.0 Request processed in 40us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.358571:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:0.0:1783952032.358583:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1783952032.358613:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465470848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.358646:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465470848:12345-0@lo:400:kworker.0 Request processed in 58us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.358653:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1783952032.358665:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1783952032.358671:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465470976:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952032.358683:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd42a00 x1870605465470976/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:293/0 lens 224/224 e 0 to 0 dl 1783952043 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952032.358707:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465470976:12345-0@lo:400:kworker.0 Request processed in 37us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.358713:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1783952032.358760:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465471232 00000100:00100000:0.0:1783952032.358764:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465471232 00000100:00100000:0.0:1783952032.358785:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465471744 00000100:00100000:0.0:1783952032.358788:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465471744 00000100:00100000:0.0:1783952032.358803:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1783952032.358808:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465471232:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952032.358821:0:26467:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd43480 x1870605465471232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:293/0 lens 224/224 e 0 to 0 dl 1783952043 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952032.358860:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465471232:12345-0@lo:400:kworker.0 Request processed in 52us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.358866:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1783952032.358878:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:0.0:1783952032.358884:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465471744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.358911:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465471744:12345-0@lo:400:kworker.0 Request processed in 27us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.358917:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00080000:0.0:1783952032.358949:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952032.358953:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952032.358983:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465470976:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.358996:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465470848:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.359028:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465470720:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.359038:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465471232:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.359047:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465471744:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.359054:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465470592:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.359063:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465471104:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.359072:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465471616:0@lo:400:kworker.0 00000100:00100000:0.0:1783952032.359080:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465472128:0@lo:400:kworker.0 00000100:00100000:3.0:1783952032.359391:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465471360 00000100:00100000:3.0:1783952032.359395:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465471360 00000100:00100000:3.0:1783952032.359442:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465471872 00000100:00100000:3.0:1783952032.359445:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465471872 00000100:00100000:3.0:1783952032.359465:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465471488 00000100:00100000:3.0:1783952032.359468:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465471488 00000100:00100000:3.0:1783952032.359486:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465472000 00000100:00100000:3.0:1783952032.359488:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465472000 00000100:00100000:3.0:1783952032.359508:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:3.0:1783952032.359515:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465471360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952032.359565:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465471360:12345-0@lo:400:kworker.0 Request processed in 50us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952032.359571:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:3.0:1783952032.359584:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:3.0:1783952032.359620:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465471872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952032.359650:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465471872:12345-0@lo:400:kworker.0 Request processed in 32us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952032.359656:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:3.0:1783952032.359669:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:3.0:1783952032.359675:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465471488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952032.359702:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465471488:12345-0@lo:400:kworker.0 Request processed in 28us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952032.359708:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:3.0:1783952032.359718:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:3.0:1783952032.359744:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465472000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952032.359773:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465472000:12345-0@lo:400:kworker.0 Request processed in 42us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952032.359778:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00080000:3.0:1783952032.359821:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952032.359825:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952032.359848:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465471488:0@lo:400:kworker.0 00000100:00100000:3.0:1783952032.359858:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465472000:0@lo:400:kworker.0 00000100:00100000:3.0:1783952032.359868:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465471360:0@lo:400:kworker.0 00000100:00100000:3.0:1783952032.359877:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465471872:0@lo:400:kworker.0 00000100:00100000:3.0:1783952032.359899:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952032.359909:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465472256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952032.359942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952032.359973:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465472256 00000100:00100000:3.0:1783952032.359977:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465472256 00000100:00100000:3.0:1783952032.360001:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:3.0:1783952032.360006:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465472256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952032.360030:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783952032.360064:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465472256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952032.360069:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:3.0:1783952032.360099:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465472256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952032.865270:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465472384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952032.865336:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952032.865401:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465472384 00000100:00100000:3.0:1783952032.865408:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465472384 00000100:00100000:3.0:1783952032.865467:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1783952032.865476:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465472384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783952032.865512:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00010000:00000080:3.0:1783952032.865527:0:8444:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049d71880 x1870605465472384/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:293/0 lens 224/368 e 0 to 0 dl 1783952043 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952032.865568:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465472384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952032.865576:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1783952032.865641:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465472384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952032.866545:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465472512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952032.866615:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952032.866681:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465472512 00000100:00100000:0.0:1783952032.866686:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465472512 00000100:00100000:0.0:1783952032.866719:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:0.0:1783952032.866738:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465472512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783952032.866764:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952032.866801:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465472512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952032.866808:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:0.0:1783952032.866841:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465472512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952032.871650:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465472640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952032.871717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952032.871784:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465472640 00000100:00100000:3.0:1783952032.871792:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465472640 00000100:00100000:3.0:1783952032.871832:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:3.0:1783952032.871841:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465472640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952032.871864:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952032.871908:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465472640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952032.871916:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:3.0:1783952032.871964:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465472640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952033.286236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952033.286283:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952033.286302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952033.286316:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952033.286335:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952033.286361:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447730304 00000100:00100000:0.0:1783952033.286370:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447730304 00000100:00100000:0.0:1783952033.286445:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447730176 00000100:00100000:0.0:1783952033.286449:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447730176 00000100:00100000:0.0:1783952033.286474:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1239 00000100:00100000:0.0:1783952033.286483:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447730304:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952033.286554:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447730304:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952033.286562:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1239 00000100:00100000:0.0:1783952033.286577:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1240 00000100:00100000:0.0:1783952033.286613:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+21:2399:x1870605447730176:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000080:0.0:1783952033.286630:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14f0d4000 x1870605447730176/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:294/0 lens 224/224 e 0 to 0 dl 1783952044 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952033.286661:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+21:2399:x1870605447730176:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 79us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952033.286667:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1240 00000100:00100000:0.0:1783952033.286685:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447730560 00000100:00100000:0.0:1783952033.286688:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447730560 00000100:00100000:0.0:1783952033.286710:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447730432 00000100:00100000:0.0:1783952033.286712:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447730432 00000100:00100000:0.0:1783952033.286761:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2722 00000100:00100000:0.0:1783952033.286767:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+8:2399:x1870605447730560:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952033.286792:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+8:2399:x1870605447730560:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952033.286797:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2722 00000100:00100000:0.0:1783952033.286806:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2723 00000100:00100000:0.0:1783952033.286811:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+8:2399:x1870605447730432:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952033.286830:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+8:2399:x1870605447730432:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 18us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952033.286835:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2723 00000100:00080000:0.0:1783952033.286855:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952033.286858:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952033.286860:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952033.286862:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952033.287371:0:89066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447730048 00000100:00100000:3.0:1783952033.287378:0:89066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447730048 00000100:00100000:3.0:1783952033.287440:0:89066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 88 00000100:00100000:3.0:1783952033.287448:0:89066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1742de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2399:x1870605447730048:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952033.287498:0:89066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1742de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2399:x1870605447730048:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 51us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952033.287505:0:89066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 88 00010000:00010000:3.0:1783952033.314137:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783952033.675294:0:90427:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783952033.675347:0:90427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.675362:0:90427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.675369:0:90427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.675377:0:90427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.675403:0:90427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783952033.675410:0:90427:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783952033.675440:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783952033.675444:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783952033.675449:0:90427:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783952033.675474:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b174b12800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783952033.675529:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952033.675536:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.675559:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216aa00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952033.675563:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.675572:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952033.675579:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952033.675585:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783952033.675620:0:15262:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783952033.675622:0:15262:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783952033.675648:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.675654:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952033.675679:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.675685:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216aa00/0x22c73c7857bb4b57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4b5e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.675696:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952033.675698:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952033.675700:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952033.675714:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465472768:0@lo:39:umount.0 00000100:00100000:2.0:1783952033.675791:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952033.675861:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465472896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952033.675892:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952033.675948:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465472896 00000100:00100000:3.0:1783952033.675955:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465472896 00000100:00100000:3.0:1783952033.676036:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1783952033.676052:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465472896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952033.676065:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952033.676080:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b176d22200/0x22c73c7857bb4b5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4b57 expref: 24 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.676093:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952033.676131:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3645:x1870605465472896:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952033.676139:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1783952033.676175:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465472896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952033.679234:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465472768 00000100:00100000:0.0:1783952033.679247:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465472768 00000100:00100000:0.0:1783952033.679322:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:0.0:1783952033.679332:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465472768:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783952033.679380:0:66237:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4c6f 00000100:00080000:0.0:1783952033.679395:0:66237:0:(import.c:65:import_set_state_nolock()) ffff97b046486800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1783952033.679425:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050958a80 x1870605465472768/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:294/0 lens 224/224 e 0 to 0 dl 1783952044 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952033.679488:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1870605465472768:12345-0@lo:39:umount.0 Request processed in 158us (3697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952033.679496:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000020:00000080:0.0:1783952033.679506:0:66237:0:(genops.c:906:class_export_put()) final put ffff97b046484000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1783952033.679550:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783952033.679558:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046484000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783952033.679628:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b046486800 for lustre-MDT0000 00000100:00080000:0.0:1783952033.679675:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b174b12800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783952033.679688:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465472768:0@lo:39:umount.0 00000100:00080000:3.0:1783952033.680287:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783952033.680291:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783952033.680296:0:90427:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783952033.681213:0:90427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681228:0:90427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681236:0:90427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681243:0:90427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681269:0:90427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783952033.681275:0:90427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681298:0:90427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681304:0:90427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681309:0:90427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681323:0:90427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783952033.681329:0:90427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681336:0:90427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681341:0:90427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681347:0:90427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681358:0:90427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783952033.681363:0:90427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681369:0:90427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681385:0:90427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681391:0:90427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.681401:0:90427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1783952033.681404:0:90427:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1783952033.681437:0:90427:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783952033.681442:0:90427:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1783952033.681446:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1783952033.681451:0:90427:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1783952033.681548:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783952033.681562:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681569:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70a00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952033.681573:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681582:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952033.681605:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952033.681611:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783952033.681613:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1783952033.681615:0:7459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1783952033.681647:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681653:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952033.681672:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681679:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb4a77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4a7e expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681692:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783952033.681696:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681703:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22800 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952033.681711:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681729:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952033.681737:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952033.681742:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783952033.681744:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783952033.681746:0:7459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783952033.681760:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681767:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952033.681773:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681779:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b176d22800/0x22c73c7857bb4b96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4b9d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681789:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783952033.681793:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681798:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23000 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952033.681801:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681808:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952033.681820:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952033.681826:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783952033.681828:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783952033.681830:0:7459:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783952033.681846:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681852:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952033.681869:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681876:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b176d23000/0x22c73c7857bb4b49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4b50 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681884:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952033.681887:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681892:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70c00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952033.681894:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681901:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952033.681906:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952033.681921:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783952033.681923:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783952033.681924:0:7459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783952033.681939:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681945:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952033.681952:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681957:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb4a69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb4a70 expref: -99 pid: 89059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.681966:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952033.681968:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952033.681969:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952033.681986:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465473280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952033.682045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952033.682096:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952033.682102:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465473408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952033.682125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952033.682154:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465473280 00000100:00100000:2.0:1783952033.682161:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465473280 00000100:00100000:2.0:1783952033.682201:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465473408 00000100:00100000:2.0:1783952033.682204:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465473408 00000100:00100000:2.0:1783952033.682225:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1783952033.682232:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465473280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952033.682244:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952033.682263:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db70200/0x22c73c7857bb4b50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4b49 expref: 24 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.682274:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952033.682307:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3644:x1870605465473280:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952033.682314:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1783952033.682330:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1783952033.682336:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3644:x1870605465473408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952033.682344:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952033.682352:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b400/0x22c73c7857bb4a70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4a69 expref: 22 pid: 89066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.682361:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952033.682383:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3644:x1870605465473408:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952033.682388:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00010000:00010000:2.0:1783952033.682415:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952033.682437:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465473408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952033.682447:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465473280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952033.682532:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952033.682537:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952033.682546:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465473024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952033.682577:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952033.682624:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952033.682630:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465473152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952033.682652:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952033.682682:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465473024 00000100:00100000:0.0:1783952033.682686:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465473024 00000100:00100000:0.0:1783952033.682710:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465473152 00000100:00100000:0.0:1783952033.682713:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465473152 00000100:00100000:0.0:1783952033.682744:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1783952033.682751:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3642:x1870605465473024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952033.682767:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952033.682777:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a200/0x22c73c7857bb4a7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4a77 expref: 22 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952033.682786:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952033.682812:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3642:x1870605465473024:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952033.682819:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1783952033.682833:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1783952033.682839:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1472bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3642:x1870605465473152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952033.682846:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952033.682854:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a400/0x22c73c7857bb4b9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4b96 expref: 20 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952033.682862:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952033.682882:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1472bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3642:x1870605465473152:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952033.682888:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1783952033.682934:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465473152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952033.682941:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465473024:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1783952033.687539:0:90427:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1783952033.690154:0:89060:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149712 is committed 00010000:00010000:3.0:1783952033.690232:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.690245:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.690252:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.690259:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952033.690264:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.690272:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.690288:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b150d9e600) 00010000:00010000:3.0:1783952033.690298:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952033.690303:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.690310:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc200/0x22c73c7857bb4fa2 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783952033.690790:0:90427:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1783952033.690801:0:90427:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b144570000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783952033.690807:0:90427:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b144575800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783952033.690812:0:90427:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b144574800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783952033.690817:0:90427:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b04d9f1800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783952033.690831:0:90427:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b04d9f2800 458183b2-4c6d-478c-9fed-a955779e6611 192.168.202.48@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 111669149712 stale:0 00000020:00080000:0.0:1783952033.690836:0:90427:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff97b0489bb380) has exports, disconnecting them 00000020:00080000:0.0:1783952033.690840:0:90427:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b144570000), last request at 1783951996 00000020:00000080:0.0:1783952033.690848:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4c68 00000100:00080000:0.0:1783952033.690856:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b144573800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783952033.690919:0:90427:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b144570000): rc 0 00000020:00000080:0.0:1783952033.690922:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b144570000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1783952033.690938:0:90427:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b144575800), last request at 1783952032 00000020:00000080:0.0:1783952033.690942:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4c61 00000100:00080000:0.0:1783952033.690946:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b144576800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783952033.690996:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144570000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783952033.691046:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144573800 for lustre-MDT0000 00010000:00010000:2.0:1783952033.691117:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783952033.691165:0:90427:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b144575800): rc 0 00000020:00000080:0.0:1783952033.691167:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b144575800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783952033.691178:0:90427:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b144574800), last request at 1783952032 00000020:00000080:0.0:1783952033.691181:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4c5a 00000100:00080000:0.0:1783952033.691186:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b144576000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783952033.691220:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144575800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783952033.691254:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144576800 for lustre-MDT0000 00010000:00010000:2.0:1783952033.691545:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783952033.691701:0:90427:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b144574800): rc 0 00000020:00000080:0.0:1783952033.691704:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b144574800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1783952033.691752:0:90427:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b04d9f1800), last request at 1783951991 00000020:00000080:0.0:1783952033.691763:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4acb 00000100:00080000:0.0:1783952033.691775:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b144577000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783952033.691799:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144574800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783952033.691834:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144576000 for lustre-MDT0000 00010000:00010000:1.0:1783952033.691880:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783952033.691971:0:90427:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b04d9f1800): rc 0 00000020:00000080:0.0:1783952033.691974:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b04d9f1800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1783952033.691988:0:90427:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.48@tcp (ffff97b04d9f2800), last request at 1783952033 00000020:00000080:0.0:1783952033.691992:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4ac4 00000020:00010000:0.0:1783952033.691998:0:90427:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b04d9f2800: total 1 00000100:00080000:0.0:1783952033.692001:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b16e9fb800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783952033.692028:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1783952033.692060:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144577000 for lustre-MDT0000 00000020:00010000:2.0:1783952033.692110:0:6505:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b04d9f2800: total 0 00010000:00010000:2.0:1783952033.692114:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952033.692167:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b04d9f2800, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1783952033.692201:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216bc00/0x22c73c7857bb4e9f lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a23c expref: 11 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.692283:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb4ead lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a24a expref: 10 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.692299:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb4f9b lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a289 expref: 9 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.692312:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030e00/0x22c73c7857bb4fb7 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a297 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.692337:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb4fda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2b3 expref: 7 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.692357:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb4ea6 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a243 expref: 6 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.692372:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb5020 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2c1 expref: 5 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952033.692384:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b04d9f2800, canceled 7 locks, left on hash table 0. 00000020:00080000:1.0:1783952033.694774:0:90427:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b04d9f2800): rc 0 00000004:00000080:1.0:1783952033.694787:0:90427:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa80a41fbfae0 00000100:00080000:1.0:1783952033.694811:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783952033.694815:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783952033.695654:0:90427:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783952033.695680:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b176be1000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783952033.695791:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465473536:0@lo:39:umount.0 00000100:00100000:0.0:1783952033.695896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952033.696020:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465473536 00000100:00100000:1.0:1783952033.696028:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465473536 00000100:00100000:1.0:1783952033.696082:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:1.0:1783952033.696090:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465473536:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783952033.696119:0:26467:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4b0a 00000100:00080000:1.0:1783952033.696127:0:26467:0:(import.c:65:import_set_state_nolock()) ffff97b1445c2000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783952033.697941:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1783952033.698571:0:26467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411436 00000100:00100000:1.0:1783952033.698862:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3641:x1870605465473536:12345-0@lo:39:umount.0 Request processed in 2769us (2961us total) trans 77309411437 rc 0/0 00000100:00100000:1.0:1783952033.698875:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00080000:0.0:1783952033.698992:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b176be1000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783952033.699001:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465473536:0@lo:39:umount.0 00010000:00010000:3.0:1783952033.701663:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783952033.702950:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783952033.702956:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968952 gen 3 00000004:00080000:1.0:1783952033.702979:0:90427:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783952033.703037:0:90427:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783952033.703067:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b1469d7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783952033.703091:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783952033.703093:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968952 gen 3 00000004:00080000:1.0:1783952033.703100:0:90427:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783952033.703172:0:90427:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783952033.703185:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b17407c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783952033.703227:0:90427:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b0489bb380) has no exports 00000100:00100000:3.0:1783952033.703574:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465473664:0@lo:9:umount.0 00000100:00100000:3.0:1783952033.703674:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952033.703712:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465473792:0@lo:9:umount.0 00000100:00100000:3.0:1783952033.703746:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952033.703793:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465473664 00000100:00100000:3.0:1783952033.703802:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465473664 00000100:00100000:3.0:1783952033.703842:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465473792 00000100:00100000:3.0:1783952033.703845:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465473792 00000100:00100000:3.0:1783952033.703867:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4925 00000100:00100000:3.0:1783952033.703876:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465473664:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783952033.703902:0:26199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4b26 00000100:00080000:3.0:1783952033.703911:0:26199:0:(import.c:65:import_set_state_nolock()) ffff97b174695000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783952033.703951:0:26199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968953 00000100:00100000:3.0:1783952033.704077:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465473664:12345-0@lo:9:umount.0 Request processed in 201us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952033.704084:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4925 00000100:00100000:3.0:1783952033.704111:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4926 00000100:00100000:3.0:1783952033.704117:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465473792:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783952033.704129:0:26199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4b34 00000100:00080000:3.0:1783952033.704134:0:26199:0:(import.c:65:import_set_state_nolock()) ffff97b17407b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783952033.704156:0:26199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968954 00000100:00100000:3.0:1783952033.704231:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465473792:12345-0@lo:9:umount.0 Request processed in 114us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952033.704238:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4926 00010000:00010000:3.0:1783952033.704261:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952033.704266:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783952033.704292:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1469d7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783952033.704302:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783952033.704304:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783952033.704307:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465473664:0@lo:9:umount.0 00000100:00080000:3.0:1783952033.704317:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b17407c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783952033.704322:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783952033.704323:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783952033.704326:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465473792:0@lo:9:umount.0 00000020:00080000:1.0:1783952033.704632:0:90427:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b0489bb380) has no exports 00000020:00000080:2.0:1783952033.728404:0:6505:0:(genops.c:906:class_export_put()) final put ffff97b04d9f2800/458183b2-4c6d-478c-9fed-a955779e6611 00010000:00010000:2.0:1783952033.729647:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952033.729651:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952033.729654:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783952033.732320:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f2800/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-MDT0000 00000020:00000080:3.0:1783952033.739573:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b16e9fb800 for lustre-MDT0000 00000020:00000080:1.0:1783952033.787401:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4ae0 00000020:00000080:1.0:1783952033.787836:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b1514bc800/lustre-QMT0000_UUID 00000020:01000000:1.0:1783952033.787860:0:90427:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783952033.787960:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952033.787973:0:90427:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783952033.787978:0:90427:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff97b1449b4d40) has no exports 00000020:00000080:3.0:1783952033.789401:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1514bc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783952033.789944:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4ad9 00000020:00000080:0.0:1783952033.789953:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b046ae6800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783952033.790008:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952033.790022:0:90427:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783952033.790025:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b04d9f5800/lustre-QMT0000_UUID 00000020:00000080:0.0:1783952033.790027:0:90427:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783952033.790034:0:90427:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1783952033.790299:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046ae6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783952033.791329:0:90427:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b0476cfa20 - data ffff97b181d70a20/ffff97b04982e400 00000020:01000000:0.0:1783952033.791491:0:90427:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b174388240 - data ffff97b181d5bd80/ffff97b1761be800 00000100:00080000:2.0:1783952033.921106:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783952033.921115:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783952033.921130:0:90427:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff97b04ab3c380 x1870605465473536/t77309411437(77309411437) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952043 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952033.921563:0:90427:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783952033.932570:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783952033.932578:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968952 gen 4 00000004:00080000:0.0:1783952033.932625:0:90427:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783952033.932628:0:90427:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783952033.938095:0:89078:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783952033.938104:0:89078:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:2.0:1783952033.938118:0:89078:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:0.0:1783952033.939212:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783952033.939218:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968952 gen 4 00000004:00080000:0.0:1783952033.939236:0:90427:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783952033.939238:0:90427:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783952033.939843:0:89080:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783952033.939848:0:89080:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:3.0:1783952033.939858:0:89080:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:0.0:1783952033.941053:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4a93 00000020:00000080:0.0:1783952033.941063:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b1445c7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783952033.941697:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1445c7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783952033.942078:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4aa8 00000020:00000080:0.0:1783952033.942084:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b143af6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783952033.942102:0:90427:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783952033.942108:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952033.942120:0:90427:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783952033.942134:0:90427:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff97b0489b99c0) has no exports 00000020:00000080:3.0:1783952033.942241:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b143af6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1783952033.942534:0:90427:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783952033.942543:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4b2d 00000020:00000080:0.0:1783952033.942548:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b174b22000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783952033.942613:0:90427:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783952033.942618:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952033.942627:0:90427:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783952033.942629:0:90427:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff97b167c919c0) has no exports 00000020:00000080:0.0:1783952033.942635:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4b1f 00000020:00000080:0.0:1783952033.942639:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b17407f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783952033.953461:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b22000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1783952033.954073:0:90427:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783952033.954078:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783952033.954082:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968952 gen 5 00000004:00080000:0.0:1783952033.954089:0:90427:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783952033.954091:0:90427:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783952033.954131:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952033.954145:0:90427:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783952033.954154:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4b11 00000020:00000080:0.0:1783952033.954162:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b1762c7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783952033.954168:0:90427:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783952033.954173:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952033.954179:0:90427:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783952033.954183:0:90427:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff97b1449b3380) has no exports 00000020:00000080:0.0:1783952033.954189:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4b03 00000020:00000080:0.0:1783952033.954193:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b158cc3800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783952033.954710:0:90427:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783952033.954732:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783952033.954734:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968952 gen 5 00000004:00080000:0.0:1783952033.954738:0:90427:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783952033.954739:0:90427:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783952033.954764:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952033.954771:0:90427:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783952033.954795:0:90427:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783952033.954802:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4af5 00000020:00000080:0.0:1783952033.954807:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b1762c4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783952033.954810:0:90427:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783952033.954814:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952033.954819:0:90427:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783952033.954821:0:90427:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff97b1454599c0) has no exports 00000020:00000080:0.0:1783952033.954825:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4aee 00000020:00000080:0.0:1783952033.954828:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b176be7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783952033.956088:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783952033.956105:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b17407c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783952033.956114:0:8:0:(genops.c:906:class_export_put()) final put ffff97b1762c1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783952033.956116:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783952033.956121:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783952033.956206:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783952033.956212:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b158cc3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783952033.956227:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1469d7800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783952033.956231:0:8:0:(genops.c:906:class_export_put()) final put ffff97b1762c4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783952033.956233:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783952033.956236:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783952033.956263:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783952033.956267:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176be7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783952033.957788:0:90427:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783952033.957796:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783952033.957800:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783952033.957807:0:90427:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783952033.957860:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783952033.957875:0:90427:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783952033.957899:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b176be1000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783952033.957906:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783952033.957908:0:8:0:(genops.c:906:class_export_put()) final put ffff97b04d9f0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783952033.957910:0:90427:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783952033.957911:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783952033.957913:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b1742bd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783952033.957915:0:90427:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1742bd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783952033.957917:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783952033.957924:0:90427:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783952033.958009:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4ab6 00000020:00000080:2.0:1783952033.958015:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b143af3000/lustre-MDD0000_UUID 00000020:01000000:2.0:1783952033.958028:0:90427:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783952033.958032:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783952033.958037:0:90427:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783952033.958041:0:90427:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff97b0489bcd40) has no exports 00000020:00000080:2.0:1783952033.958059:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783952033.958062:0:90427:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783952033.958066:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4abd 00000020:00000080:2.0:1783952033.958079:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b1742b9800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783952033.958086:0:90427:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b174b31800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783952033.958089:0:90427:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174b31800 3 00000020:01000004:2.0:1783952033.958092:0:90427:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b174b31800 from lustre-MDT0000 00000020:00000080:2.0:1783952033.958107:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783952033.958111:0:90427:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783952033.958126:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b1445c3800/lustre-MDT0000_UUID 00000020:00000080:2.0:1783952033.958128:0:90427:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1445c3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783952033.958135:0:90427:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783952033.958164:0:90427:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783952033.958167:0:90427:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783952033.958171:0:90427:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783952033.958173:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783952033.958175:0:90427:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1783952033.958182:0:90427:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b146942000 75da5dc4-aa7e-42cf-a965-1b5f01232c6f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783952033.958190:0:90427:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b0410d9000 e66faa19-2cbc-412c-8aef-9c55427739f8 192.168.202.48@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783952033.958195:0:90427:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff97b14545b380) has exports, disconnecting them 00000020:00080000:2.0:1783952033.958199:0:90427:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97b146942000), last request at 1783951990 00000020:00000080:2.0:1783952033.958217:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4a5b 00000020:00010000:2.0:1783952033.958221:0:90427:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b146942000: total 2 00000100:00080000:2.0:1783952033.958225:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b146940000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783952033.958235:0:90427:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b146942000): rc 0 00000020:00080000:2.0:1783952033.958239:0:90427:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.48@tcp (ffff97b0410d9000), last request at 1783951990 00000020:00000080:2.0:1783952033.958281:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4a54 00000020:00010000:2.0:1783952033.958284:0:90427:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b0410d9000: total 2 00000100:00080000:2.0:1783952033.958287:0:90427:0:(import.c:65:import_set_state_nolock()) ffff97b0410dc000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783952033.958295:0:90427:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b0410d9000): rc 0 00000020:00080000:2.0:1783952033.958299:0:90427:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff97b14545b380) has no exports 00000020:00010000:3.0:1783952033.958918:0:15262:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b146942000: total 2 00010000:00010000:3.0:1783952033.958957:0:15262:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b146942000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783952033.958988:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71800/0x22c73c7857bb4bab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4ba4 expref: 14 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959006:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71200/0x22c73c7857bb4c29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4c22 expref: 13 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959017:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71600/0x22c73c7857bb4bb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4bb2 expref: 12 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959042:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71400/0x22c73c7857bb4c1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4c14 expref: 11 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959053:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b176d23800/0x22c73c7857bb4bd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4bce expref: 10 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959067:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b176d23e00/0x22c73c7857bb4c37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4c30 expref: 9 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959076:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b600/0x22c73c7857bb4bc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4bc0 expref: 8 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959087:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b176d22e00/0x22c73c7857bb4c45 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4c3e expref: 7 pid: 89066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959099:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb4c53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4c4c expref: 6 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959109:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb4be3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4bdc expref: 5 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959120:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b176d22c00/0x22c73c7857bb4bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4bea expref: 4 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959130:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b176d23c00/0x22c73c7857bb4bff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4bf8 expref: 3 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959139:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762afc00/0x22c73c7857bb4c0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb4c06 expref: 2 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959158:0:15262:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b146942000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1783952033.959178:0:15262:0:(genops.c:906:class_export_put()) final put ffff97b146942000/75da5dc4-aa7e-42cf-a965-1b5f01232c6f 00000020:00010000:3.0:1783952033.959185:0:15262:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b0410d9000: total 3 00010000:00010000:3.0:1783952033.959201:0:15262:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b0410d9000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1783952033.959219:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b176d23600/0x22c73c7857bb4b81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a219 expref: 5 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959229:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a600/0x22c73c7857bb4b8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a227 expref: 4 pid: 89065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959242:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b176d22600/0x22c73c7857bb4b88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a220 expref: 3 pid: 89064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959256:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb4b7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a212 expref: 2 pid: 89070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952033.959265:0:15262:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b0410d9000, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1783952033.959276:0:15262:0:(genops.c:906:class_export_put()) final put ffff97b0410d9000/e66faa19-2cbc-412c-8aef-9c55427739f8 00010000:00010000:3.0:1783952033.959282:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952033.959284:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952033.959285:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952033.959292:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952033.959328:0:89066:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97b16e1db800:89066] 2 exiting: rc = 0 00000020:00000080:3.0:1783952033.959409:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b143af3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1783952033.959414:0:8:0:(genops.c:906:class_export_put()) final put ffff97b1445c0000/lustre-MDD0000_UUID 00000020:00000080:3.0:1783952033.959416:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1445c0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1783952033.959420:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1783952033.959457:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1742b9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783952033.959470:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b146942000/75da5dc4-aa7e-42cf-a965-1b5f01232c6f for MGS 00000020:00000080:3.0:1783952033.959503:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0410d9000/e66faa19-2cbc-412c-8aef-9c55427739f8 for MGS 00000020:00000080:3.0:1783952033.959515:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b146940000 for MGS 00000020:00000080:3.0:1783952033.959520:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b0410dc000 for MGS 00000100:00100000:0.0:1783952034.017236:0:89065:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97b175f33000:89065] 1 exiting: rc = 0 00000100:00100000:0.0:1783952034.017409:0:89070:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff97b049cc5600:89070] 3 exiting: rc = 0 00000100:00100000:0.0:1783952034.017513:0:89064:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97b175f32c00:89064] 0 exiting: rc = 1 00000100:00100000:2.0:1783952034.017752:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017761:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017767:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017773:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017778:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017783:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017788:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017793:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017798:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017815:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017820:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017826:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017832:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017837:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017842:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017848:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017854:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017859:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017865:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017871:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017877:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017882:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017888:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017894:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017899:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017904:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017909:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017915:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017920:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017926:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017931:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017936:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017941:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017946:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017951:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017955:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017961:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017966:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017971:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017975:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017980:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017985:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017989:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.017993:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018004:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018009:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018014:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018024:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018032:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018037:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018075:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018080:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018085:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018090:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018095:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018100:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018105:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018110:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018115:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018121:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018127:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018132:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018137:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783952034.018142:0:90427:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1783952034.019036:0:90427:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b17425e000 - data ffff97b181d585e8/ffff97b165b67c00 00000020:01000000:3.0:1783952034.019187:0:90427:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b152217f00 - data ffff97b1657e71b0/ffff97b16dc92c00 00000020:00000080:2.0:1783952034.019811:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4a4d 00000020:00000080:2.0:1783952034.019821:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b047ade000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783952034.019839:0:90427:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b174b31800 from MGS, refs=2 00000020:01000004:2.0:1783952034.019843:0:90427:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174b31800 2 00000020:01000004:2.0:1783952034.019847:0:90427:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b174b31800 from MGS 00000020:00000080:2.0:1783952034.019870:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783952034.019878:0:90427:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783952034.019880:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b1469d3800/MGS 00000020:00000080:2.0:1783952034.019883:0:90427:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1469d3800/MGS for MGS 00000020:01000000:2.0:1783952034.019892:0:90427:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1783952034.019983:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b047ade000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783952034.020192:0:90427:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783952034.020196:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783952034.020207:0:90427:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783952034.020214:0:90427:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97b1762c5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783952034.020220:0:90427:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff97b0489b8000) has exports, disconnecting them 00000020:00080000:2.0:1783952034.020233:0:90427:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97b1762c5800), last request at 1783951991 00000020:00000080:2.0:1783952034.020237:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4b6c 00000020:00080000:2.0:1783952034.020260:0:90427:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b1762c5800): rc 0 00000020:00000080:2.0:1783952034.020264:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b1762c5800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783952034.020619:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783952034.030650:0:90427:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783952034.030660:0:90427:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783952034.030665:0:90427:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783952034.030672:0:90427:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783952034.030874:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783952034.030888:0:90427:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783952034.030895:0:90427:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174b31800 1 00000020:00000080:3.0:1783952034.030901:0:90427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4a3f 00000020:00000080:3.0:1783952034.030910:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b1469d0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783952034.031750:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b174b12800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783952034.031760:0:8:0:(genops.c:906:class_export_put()) final put ffff97b04b213000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783952034.031763:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04b213000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783952034.031769:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1783952034.037468:0:90427:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783952034.037482:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783952034.037492:0:90427:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783952034.037497:0:90427:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff97b048b5cd40) has no exports 00000020:00000080:0.0:1783952034.046833:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1469d0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783952034.222141:0:90427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783952034.222156:0:90427:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783952034.222162:0:90427:0:(genops.c:906:class_export_put()) final put ffff97b174b35800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783952034.222166:0:90427:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b35800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783952034.222178:0:90427:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783952034.222297:0:90427:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97b174b31000 00000020:02000400:3.0:1783952034.222361:0:90427:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1783952034.340985:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952035.372637:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952035.432755:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465473920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952035.432871:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952035.433066:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465473920 00000100:00100000:3.0:1783952035.433073:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465473920 00000100:00100000:3.0:1783952035.433126:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:3.0:1783952035.433135:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465473920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783952035.433166:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952035.433215:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465473920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952035.433224:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00080000:3.0:1783952035.433245:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952035.433281:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465473920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952035.440328:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465474048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952035.440403:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952035.440467:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465474048 00000100:00100000:3.0:1783952035.440475:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465474048 00000100:00100000:3.0:1783952035.440527:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:3.0:1783952035.440536:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465474048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783952035.440568:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952035.440631:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465474048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952035.440639:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00080000:3.0:1783952035.440660:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952035.440698:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465474048:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783952036.390396:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783952036.971475:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783952036.971486:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b17407c000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783952036.971523:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968953 is committed 00000020:00000080:1.0:1783952036.971682:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783952036.971753:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b174695000 for lustre-OST0000 00010000:00010000:3.0:1783952037.412651:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952037.473778:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465474176:0@lo:400:kworker.0 00000400:00000100:2.0:1783952037.473867:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465474176 offset 0 length 224: 4 00000100:00100000:2.0:1783952037.473906:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465474688:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.473942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.473965:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465475200:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.473987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.474011:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783952037.474017:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465474304:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.474053:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.474072:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465474816:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.474096:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.474131:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465474688 00000100:00100000:2.0:1783952037.474139:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465474688 00000100:00100000:2.0:1783952037.474222:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465475200 00000100:00100000:2.0:1783952037.474226:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465475200 00000100:00100000:2.0:1783952037.474244:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465474304 00000100:00100000:2.0:1783952037.474246:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465474304 00000100:00100000:2.0:1783952037.474262:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1783952037.474270:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465474688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.474326:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465474688:12345-0@lo:400:kworker.0 Request processed in 56us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952037.474333:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1783952037.474367:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:2.0:1783952037.474372:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870605465475200:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783952037.474378:0:66236:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783952037.474403:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870605465475200:12345-0@lo:400:kworker.0 Request processed in 30us (415us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783952037.474409:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:2.0:1783952037.474433:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:2.0:1783952037.474438:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870605465474304:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783952037.474442:0:66236:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783952037.474465:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870605465474304:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783952037.474469:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:2.0:1783952037.474493:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465474816 00000100:00100000:2.0:1783952037.474496:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465474816 00000100:00100000:2.0:1783952037.474519:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:2.0:1783952037.474522:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870605465474816:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783952037.474527:0:8444:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783952037.474551:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870605465474816:12345-0@lo:400:kworker.0 Request processed in 26us (454us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783952037.474557:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00080000:2.0:1783952037.474573:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952037.474638:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783952037.474643:0:3644:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783952037.474646:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783952037.474651:0:3644:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952037.474654:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3711 00000100:00080000:2.0:1783952037.474660:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952037.474704:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b05095a680 x1870605465475328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952037.474725:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465474304:0@lo:400:kworker.0 00000100:00080000:2.0:1783952037.474737:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783952037.474740:0:3644:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783952037.474743:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783952037.474747:0:3644:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952037.474749:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3711 00000100:00080000:2.0:1783952037.474753:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952037.474766:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b05095ad80 x1870605465475456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952037.474775:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465474816:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.474789:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465474688:0@lo:400:kworker.0 00000100:00080000:2.0:1783952037.474796:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783952037.474799:0:3644:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783952037.474802:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783952037.474804:0:3644:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952037.474807:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3711 00000100:00080000:2.0:1783952037.474810:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952037.474822:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b050958000 x1870605465475584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952037.474832:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465475200:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.474882:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465475328:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783952037.474910:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.474927:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465475456:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783952037.474946:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.474963:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465475584:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783952037.474982:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.475006:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465475456 00000100:00100000:2.0:1783952037.475010:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465475456 00000100:00100000:2.0:1783952037.475031:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:2.0:1783952037.475036:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465475456:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1783952037.475055:0:8445:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952037.475087:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465475456:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 51us (140us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952037.475094:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:2.0:1783952037.475110:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465475328 00000100:00100000:2.0:1783952037.475114:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465475328 00000100:00100000:2.0:1783952037.475130:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465475584 00000100:00100000:2.0:1783952037.475133:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465475584 00000100:00100000:2.0:1783952037.475145:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:2.0:1783952037.475150:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465475328:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1783952037.475159:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952037.475184:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465475328:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 34us (273us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952037.475189:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:2.0:1783952037.475199:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:2.0:1783952037.475209:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465475584:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1783952037.475218:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952037.475243:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465475584:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 32us (259us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952037.475249:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00080000:2.0:1783952037.475276:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952037.475281:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952037.475284:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465475328:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1783952037.475291:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952037.475294:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952037.475297:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465475456:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1783952037.475303:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952037.475307:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952037.475309:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465475584:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783952037.475361:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465474560:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.475387:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.475405:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465475072:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.475428:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.475448:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783952037.475454:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465474432:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.475478:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.475491:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465474944:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.475510:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.475549:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465475072 00000100:00100000:2.0:1783952037.475554:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465475072 00000100:00100000:2.0:1783952037.475616:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465474944 00000100:00100000:2.0:1783952037.475619:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465474944 00000100:00100000:2.0:1783952037.475643:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:2.0:1783952037.475650:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465475072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.475703:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465475072:12345-0@lo:400:kworker.0 Request processed in 53us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952037.475710:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:2.0:1783952037.475721:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:2.0:1783952037.475727:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465474944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.475753:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465474944:12345-0@lo:400:kworker.0 Request processed in 26us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952037.475759:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00100000:2.0:1783952037.475777:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465474560 00000100:00100000:2.0:1783952037.475781:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465474560 00000100:00100000:2.0:1783952037.475796:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465474432 00000100:00100000:2.0:1783952037.475798:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465474432 00000100:00100000:2.0:1783952037.475816:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1783952037.475822:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465474432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.475850:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465474432:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952037.475855:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1783952037.475867:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1783952037.475871:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1870605465474560:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783952037.475875:0:66237:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783952037.475897:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1870605465474560:12345-0@lo:400:kworker.0 Request processed in 25us (510us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783952037.475912:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00080000:2.0:1783952037.475930:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952037.475934:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952037.475936:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952037.475959:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465474432:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.475970:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465474944:0@lo:400:kworker.0 00000100:00080000:2.0:1783952037.475979:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783952037.475982:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783952037.475986:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783952037.475989:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952037.475992:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3711 00000100:00080000:2.0:1783952037.475997:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952037.476015:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de95500 x1870605465475712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952037.476032:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465474560:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.476044:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465475072:0@lo:400:kworker.0 00000100:00100000:2.0:1783952037.476070:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465475712:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783952037.476092:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952037.476116:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465475712 00000100:00100000:2.0:1783952037.476119:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465475712 00000100:00100000:2.0:1783952037.476138:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1783952037.476141:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465475712:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783952037.476152:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952037.476187:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465475712:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 44us (94us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952037.476193:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00080000:2.0:1783952037.476215:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952037.476219:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952037.476222:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465475712:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:0.0:1783952037.994054:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783952037.994064:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b17407d800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783952037.994098:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968954 is committed 00000020:00000080:2.0:1783952037.994484:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783952037.994542:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b17407b800 for lustre-OST0001 00000400:00000100:0.0:1783952038.382765:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447730688 offset 0 length 224: 4 00000100:00100000:0.0:1783952038.382811:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952038.382849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952038.382876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952038.382933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952038.382950:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447730944 00000100:00100000:2.0:1783952038.382960:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447730944 00000100:00100000:2.0:1783952038.383029:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447730816 00000100:00100000:2.0:1783952038.383032:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447730816 00000100:00100000:2.0:1783952038.383051:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1243 00000100:00080000:0.0:1783952038.383154:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952038.383219:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447731200 00000100:00100000:3.0:1783952038.383224:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447731200 00000100:00100000:3.0:1783952038.383262:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447731072 00000100:00100000:3.0:1783952038.383265:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447731072 00000100:00100000:3.0:1783952038.383283:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2726 00000100:00100000:3.0:1783952038.383291:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447731200:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952038.383363:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447731200:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 73us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952038.383371:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2726 00000100:00100000:2.0:1783952038.383447:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447730944:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952038.383481:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447730944:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 40us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952038.383522:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2727 00000100:00100000:3.0:1783952038.383529:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+7:2401:x1870605447731072:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952038.383554:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+7:2401:x1870605447731072:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952038.383559:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2727 00000100:00100000:1.0:1783952038.389450:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1243 00000100:00100000:1.0:1783952038.389467:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1870605447730816:12345-192.168.202.48@tcp:400:kworker.0 00000020:00080000:1.0:1783952038.389558:0:67035:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.48@tcp 00000100:00100000:1.0:1783952038.389649:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1870605447730816:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 184us (6771us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783952038.389659:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1243 00000100:00080000:1.0:1783952038.389842:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952038.389848:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952038.392209:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1243 00000100:00100000:3.0:1783952038.394903:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952038.396422:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447731328 00000100:00100000:2.0:1783952038.396437:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447731328 00000100:00100000:2.0:1783952038.396497:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1244 00000100:00100000:2.0:1783952038.396507:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447731328:12345-192.168.202.48@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1783952038.396530:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952038.396997:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447731328:12345-192.168.202.48@tcp:38:ptlrpcd_01_01.0 Request processed in 412us (2026us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952038.397008:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1244 00010000:00010000:3.0:1783952038.432965:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783952039.026662:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783952039.026708:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411437 is committed 00000020:00000080:2.0:1783952039.026713:0:75694:0:(genops.c:906:class_export_put()) final put ffff97b1445c5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783952039.026961:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1445c5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1783952039.027030:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1445c2000 for lustre-MDT0001 00010000:00010000:0.0:1783952039.457812:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952040.481013:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952040.544999:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465475840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952040.545077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952040.545198:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465475840 00000100:00100000:1.0:1783952040.545208:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465475840 00000100:00100000:1.0:1783952040.545272:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:1.0:1783952040.545281:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465475840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952040.545313:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1783952040.545396:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952040.546909:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783952040.546930:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465475968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952040.546986:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952040.547034:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465475968 00000100:00100000:0.0:1783952040.547040:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465475968 00000100:00100000:0.0:1783952040.547084:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:0.0:1783952040.547092:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465475968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952040.547119:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952040.547719:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465475968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 625us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952040.547728:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00080000:0.0:1783952040.547811:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952040.547852:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465475968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952040.550929:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465475840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5637us (5841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952040.550943:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:2.0:1783952040.561375:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465475840:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783952041.504755:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952042.529066:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952042.593902:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465476096:0@lo:400:kworker.0 00000400:00000100:0.0:1783952042.593967:0:3643:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465476096 offset 0 length 224: 4 00000100:00080000:2.0:1783952042.594039:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952042.594044:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952042.594048:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952042.594053:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3752 00000100:00080000:2.0:1783952042.594058:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783952042.594066:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952042.594093:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049e74000 x1870605465476224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952042.594156:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952042.594160:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952042.594162:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952042.594165:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3752 00000100:00080000:2.0:1783952042.594167:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783952042.594171:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952042.594183:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14dee3100 x1870605465476480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952042.594204:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952042.594207:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952042.594223:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952042.594227:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3752 00000100:00080000:2.0:1783952042.594229:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783952042.594233:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952042.594259:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e3480 x1870605465476736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952042.594321:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465476224:0@lo:38:kworker.0 00000100:00100000:1.0:1783952042.594363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952042.594385:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465476480:0@lo:38:kworker.0 00000100:00100000:1.0:1783952042.594433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952042.594450:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465476736:0@lo:38:kworker.0 00000100:00100000:1.0:1783952042.594473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952042.594516:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465476224 00000100:00100000:1.0:1783952042.594523:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465476224 00000100:00100000:1.0:1783952042.594556:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465476480 00000100:00100000:1.0:1783952042.594558:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465476480 00000100:00100000:1.0:1783952042.594576:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1783952042.594584:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465476224:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952042.594644:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952042.594686:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465476224:12345-0@lo:38:kworker.0 Request processed in 101us (322us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952042.594693:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1783952042.594709:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1783952042.594713:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465476480:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952042.594723:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952042.595618:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465476864:0@lo:400:kworker.0 00000100:00100000:3.0:1783952042.595672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952042.595725:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465476864 00000100:00100000:3.0:1783952042.595730:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465476864 00000100:00100000:3.0:1783952042.595803:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:3.0:1783952042.595810:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465476864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952042.595853:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465476864:12345-0@lo:400:kworker.0 Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952042.595869:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:3.0:1783952042.595911:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465476864:0@lo:400:kworker.0 00000100:00100000:3.0:1783952042.595950:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465476608:0@lo:400:kworker.0 00000100:00100000:3.0:1783952042.595976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952042.595996:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952042.596002:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465476352:0@lo:400:kworker.0 00000100:00100000:3.0:1783952042.596021:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952042.596045:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465476608 00000100:00100000:3.0:1783952042.596049:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465476608 00000100:00100000:3.0:1783952042.596073:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465476352 00000100:00100000:3.0:1783952042.596075:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465476352 00000100:00100000:3.0:1783952042.596088:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1783952042.596094:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465476608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952042.596126:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465476608:12345-0@lo:400:kworker.0 Request processed in 32us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952042.596133:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1783952042.596160:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1783952042.596166:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465476352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952042.596192:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465476352:12345-0@lo:400:kworker.0 Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952042.596197:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1783952042.596223:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465476352:0@lo:400:kworker.0 00000100:00100000:3.0:1783952042.596233:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465476608:0@lo:400:kworker.0 00000100:00100000:3.0:1783952042.596273:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465476736 00000100:00100000:3.0:1783952042.596284:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465476736 00000100:00100000:3.0:1783952042.596308:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:3.0:1783952042.596312:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465476736:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952042.596328:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952042.596360:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465476736:12345-0@lo:38:kworker.0 Request processed in 46us (1886us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952042.596366:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00080000:3.0:1783952042.596419:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952042.596423:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952042.596468:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952042.596473:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952042.596476:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465476224:0@lo:38:kworker.0 00000100:00080000:3.0:1783952042.596485:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952042.596489:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952042.596491:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465476736:0@lo:38:kworker.0 00000100:00100000:1.0:1783952042.597475:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465476480:12345-0@lo:38:kworker.0 Request processed in 2755us (3036us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952042.597486:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00080000:3.0:1783952042.597689:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952042.597695:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952042.597699:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465476480:0@lo:38:kworker.0 00000100:00100000:0.0:1783952042.598073:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465476992:0@lo:400:kworker.0 00000100:00100000:0.0:1783952042.598117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783952042.598190:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952042.598195:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952042.598198:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952042.598203:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3752 00000100:00080000:2.0:1783952042.598207:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783952042.598213:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952042.598254:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e1500 x1870605465477120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952042.598278:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465477120:0@lo:38:kworker.0 00000100:00100000:2.0:1783952042.598311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952042.598347:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465477120 00000100:00100000:2.0:1783952042.598352:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465477120 00000100:00100000:2.0:1783952042.598382:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1783952042.598387:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465477120:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952042.598421:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952042.598456:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465477120:12345-0@lo:38:kworker.0 Request processed in 68us (144us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952042.598463:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00080000:2.0:1783952042.598492:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952042.598508:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952042.598511:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465477120:0@lo:38:kworker.0 00000100:00100000:3.0:1783952042.599906:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465476992 00000100:00100000:3.0:1783952042.599916:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465476992 00000100:00100000:3.0:1783952042.600043:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:3.0:1783952042.600052:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465476992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952042.600129:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465476992:12345-0@lo:400:kworker.0 Request processed in 79us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952042.600136:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00100000:2.0:1783952042.600223:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465476992:0@lo:400:kworker.0 00000100:00080000:0.0:1783952042.600547:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000400:00000100:3.0:1783952043.503674:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447731456 offset 0 length 224: 4 00000100:00100000:3.0:1783952043.503723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952043.503760:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952043.503794:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952043.503843:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952043.503876:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447731712 00000100:00100000:3.0:1783952043.503884:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447731712 00000100:00080000:3.0:1783952043.503914:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952043.503962:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447731584 00000100:00100000:3.0:1783952043.503966:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447731584 00000100:00100000:3.0:1783952043.503988:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1246 00000100:00100000:3.0:1783952043.503999:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447731712:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952043.504073:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447731712:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952043.504080:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1246 00000100:00100000:3.0:1783952043.504099:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1248 00000100:00100000:3.0:1783952043.504104:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447731584:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783952043.504124:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952043.504151:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447731584:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 46us (308us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952043.504157:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1248 00000100:00100000:0.0:1783952043.504763:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447731840 00000100:00100000:0.0:1783952043.504769:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447731840 00000100:00100000:0.0:1783952043.504821:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447731968 00000100:00100000:0.0:1783952043.504825:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447731968 00000100:00100000:0.0:1783952043.504848:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2730 00000100:00100000:0.0:1783952043.504855:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447731840:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952043.504911:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447731840:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 56us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952043.504918:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2730 00000100:00100000:0.0:1783952043.504931:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2731 00000100:00100000:0.0:1783952043.504937:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447731968:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952043.504962:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447731968:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952043.504968:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2731 00000100:00080000:3.0:1783952043.505129:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952043.505132:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783952043.552935:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952044.576857:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952045.600857:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952045.664940:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465477248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952045.665012:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952045.665113:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465477248 00000100:00100000:0.0:1783952045.665128:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465477248 00000100:00100000:0.0:1783952045.665196:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:0.0:1783952045.665206:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465477248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952045.665237:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783952045.665444:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952045.665553:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465477248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 349us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952045.665659:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00100000:0.0:1783952045.666004:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465477376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952045.666042:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952045.666147:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465477248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952045.666208:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465477376 00000100:00100000:3.0:1783952045.666213:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465477376 00000100:00100000:2.0:1783952045.666334:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:2.0:1783952045.666343:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465477376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783952045.666364:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952045.666406:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465477376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952045.666413:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00100000:0.0:1783952045.666947:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465477376:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783952045.667089:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783952046.624796:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952047.653663:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783952047.712858:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952047.712865:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952047.712868:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952047.712890:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3757 00000100:00080000:0.0:1783952047.712895:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1783952047.712900:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1783952047.712902:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952047.712919:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465477504:0@lo:400:kworker.0 00000100:00100000:0.0:1783952047.712924:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b146b4c000 x1870605465477632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952047.712950:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952047.712953:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952047.712955:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952047.712958:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3757 00000100:00080000:0.0:1783952047.712961:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783952047.712964:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000400:00000100:2.0:1783952047.712969:0:3643:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465477504 offset 0 length 224: 4 00000100:00100000:0.0:1783952047.712974:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b146b4ce00 x1870605465477888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952047.712996:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952047.712999:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952047.713001:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952047.713004:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3757 00000100:00080000:0.0:1783952047.713006:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1783952047.713008:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465477760:0@lo:400:kworker.0 00000100:00080000:0.0:1783952047.713009:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952047.713020:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b146b4c380 x1870605465478144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952047.713040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783952047.713040:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952047.713043:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952047.713044:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952047.713054:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3757 00000100:00080000:0.0:1783952047.713056:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1783952047.713060:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1783952047.713060:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952047.713064:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465478400:0@lo:400:kworker.0 00000100:00100000:0.0:1783952047.713075:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047acd880 x1870605465478528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952047.713085:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952047.713098:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465477632:0@lo:38:kworker.0 00000100:00100000:2.0:1783952047.713114:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465477760 00000100:00100000:2.0:1783952047.713120:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465477760 00000100:00100000:0.0:1783952047.713124:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952047.713141:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465477888:0@lo:38:kworker.0 00000100:00100000:0.0:1783952047.713160:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952047.713170:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465477632 00000100:00100000:2.0:1783952047.713172:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465477632 00000100:00100000:0.0:1783952047.713174:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465478144:0@lo:38:kworker.0 00000100:00100000:2.0:1783952047.713186:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465477888 00000100:00100000:2.0:1783952047.713188:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465477888 00000100:00100000:0.0:1783952047.713196:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952047.713204:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1783952047.713210:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465478528:0@lo:38:kworker.0 00000100:00100000:2.0:1783952047.713213:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465477760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952047.713228:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952047.713250:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465478016:0@lo:400:kworker.0 00000100:00100000:2.0:1783952047.713259:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465477760:12345-0@lo:400:kworker.0 Request processed in 48us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952047.713271:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952047.713273:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1783952047.713282:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952047.713286:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465478272:0@lo:400:kworker.0 00000100:00100000:2.0:1783952047.713288:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465478528 00000100:00100000:2.0:1783952047.713291:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465478528 00000100:00100000:0.0:1783952047.713304:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952047.713314:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465478016 00000100:00100000:2.0:1783952047.713317:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465478016 00000100:00100000:2.0:1783952047.713334:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1783952047.713339:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465478016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952047.713385:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465478016:12345-0@lo:400:kworker.0 Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952047.717116:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1783952047.717133:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465477632:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952047.717158:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952047.717243:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465477632:12345-0@lo:38:kworker.0 Request processed in 113us (4116us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952047.717383:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1783952047.717390:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465477888:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952047.717402:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952047.717438:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465477888:12345-0@lo:38:kworker.0 Request processed in 47us (4276us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952047.717446:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1783952047.717481:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:3.0:1783952047.717485:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465478528:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952047.717495:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952047.717522:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465478528:12345-0@lo:38:kworker.0 Request processed in 35us (4292us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952047.717528:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00080000:3.0:1783952047.717563:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952047.717577:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465478400 00000100:00100000:3.0:1783952047.717584:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465478400 00000100:00100000:3.0:1783952047.717653:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465478272 00000100:00100000:3.0:1783952047.717657:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465478272 00000100:00100000:2.0:1783952047.717674:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1783952047.717679:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:3.0:1783952047.717685:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465478400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952047.717713:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00100000:2.0:1783952047.717722:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465478272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952047.717768:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465478272:12345-0@lo:400:kworker.0 Request processed in 48us (4462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952047.717774:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00100000:2.0:1783952047.717822:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465477760:0@lo:400:kworker.0 00000100:00080000:2.0:1783952047.717878:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952047.717881:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952047.718443:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1783952047.718482:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465478144 00000100:00100000:0.0:1783952047.718487:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465478144 00000100:00100000:0.0:1783952047.718520:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:0.0:1783952047.718525:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465478144:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952047.718537:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952047.718584:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465478144:12345-0@lo:38:kworker.0 Request processed in 58us (5386us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952047.718619:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:0.0:1783952047.718662:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465478272:0@lo:400:kworker.0 00000100:00100000:0.0:1783952047.718675:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465478016:0@lo:400:kworker.0 00000100:00080000:0.0:1783952047.719384:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952047.719392:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952047.719396:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465477632:0@lo:38:kworker.0 00000100:00080000:0.0:1783952047.719408:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952047.719411:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952047.719414:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465477888:0@lo:38:kworker.0 00000100:00080000:0.0:1783952047.719425:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952047.719429:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952047.719432:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465478144:0@lo:38:kworker.0 00000100:00080000:0.0:1783952047.719441:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952047.719444:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952047.719447:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465478528:0@lo:38:kworker.0 00000100:00100000:2.0:1783952047.720178:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465478400:12345-0@lo:400:kworker.0 Request processed in 2490us (7088us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952047.720187:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:3.0:1783952047.720719:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465478400:0@lo:400:kworker.0 00000100:00100000:0.0:1783952048.629429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952048.629522:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952048.633472:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952048.635513:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447732224 00000100:00100000:3.0:1783952048.635527:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447732224 00000100:00100000:3.0:1783952048.635608:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447732352 00000100:00100000:3.0:1783952048.635612:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447732352 00000100:00100000:3.0:1783952048.635660:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1249 00000100:00100000:3.0:1783952048.635670:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447732352:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952048.635769:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447732352:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 101us (6246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952048.635777:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1249 00000100:00100000:3.0:1783952048.635798:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1252 00000100:00100000:3.0:1783952048.635804:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447732224:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783952048.635825:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952048.635852:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447732224:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 47us (6431us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952048.635858:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1252 00000400:00000100:3.0:1783952048.636682:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447732096 offset 0 length 224: 4 00000100:00100000:3.0:1783952048.636759:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:3.0:1783952048.636997:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952048.637019:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447732608 00000100:00100000:3.0:1783952048.637026:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447732608 00000100:00100000:3.0:1783952048.637069:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447732480 00000100:00100000:3.0:1783952048.637073:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447732480 00000100:00100000:3.0:1783952048.637094:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2734 00000100:00100000:3.0:1783952048.637102:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447732608:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952048.637449:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447732608:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 346us (3985us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952048.637457:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2734 00000100:00100000:3.0:1783952048.637476:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2735 00000100:00100000:3.0:1783952048.637484:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:458183b2-4c6d-478c-9fed-a955779e6611+7:2399:x1870605447732480:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952048.637512:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:458183b2-4c6d-478c-9fed-a955779e6611+7:2399:x1870605447732480:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952048.637527:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2735 00000100:00080000:3.0:1783952048.637545:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952048.637548:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783952048.673190:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952049.697515:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952050.720824:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952050.785019:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465478656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952050.785106:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952050.785293:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465478656 00000100:00100000:0.0:1783952050.785303:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465478656 00000100:00100000:0.0:1783952050.785376:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:0.0:1783952050.785387:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465478656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952050.785425:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952050.785480:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465478656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952050.785488:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:0.0:1783952050.785538:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465478656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952050.785829:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465478784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952050.785874:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952050.785909:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465478784 00000100:00100000:0.0:1783952050.785913:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465478784 00000100:00100000:0.0:1783952050.785940:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:0.0:1783952050.785947:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465478784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952050.785964:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952050.785998:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465478784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952050.786005:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:0.0:1783952050.786034:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465478784:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783952050.787302:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952050.787312:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783952051.745866:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952052.768894:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783952052.834130:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952052.834137:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952052.834140:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952052.834157:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3762 00000100:00080000:0.0:1783952052.834163:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783952052.834171:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952052.834193:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b144cf6a00 x1870605465479040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952052.834240:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952052.834251:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952052.834253:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952052.834257:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3762 00000100:00080000:0.0:1783952052.834259:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783952052.834263:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952052.834276:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee2300 x1870605465479296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952052.834291:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952052.834294:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952052.834296:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952052.834299:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3762 00000100:00080000:0.0:1783952052.834301:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783952052.834305:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952052.834316:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee1180 x1870605465479552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952052.834336:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952052.834339:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952052.834341:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952052.834350:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3762 00000100:00080000:0.0:1783952052.834352:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783952052.834355:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952052.834370:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14debb100 x1870605465479936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952052.834399:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465478912:0@lo:400:kworker.0 00000400:00000100:0.0:1783952052.834449:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465478912 offset 0 length 224: 4 00000100:00100000:0.0:1783952052.834487:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465479808:0@lo:400:kworker.0 00000100:00100000:0.0:1783952052.834519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952052.834559:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783952052.834566:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465479680:0@lo:400:kworker.0 00000100:00100000:0.0:1783952052.834610:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952052.834637:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465479040:0@lo:38:kworker.0 00000100:00100000:0.0:1783952052.834675:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952052.834693:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465479296:0@lo:38:kworker.0 00000100:00100000:0.0:1783952052.834713:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952052.834726:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465479552:0@lo:38:kworker.0 00000100:00100000:0.0:1783952052.834747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952052.834762:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14debb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465479936:0@lo:38:kworker.0 00000100:00100000:0.0:1783952052.834782:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952052.834807:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144cf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465479168:0@lo:400:kworker.0 00000100:00100000:0.0:1783952052.834830:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952052.834847:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952052.834853:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465479424:0@lo:400:kworker.0 00000100:00100000:0.0:1783952052.834881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952052.834917:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465479808 00000100:00100000:0.0:1783952052.834925:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465479808 00000100:00100000:0.0:1783952052.834974:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465479680 00000100:00100000:0.0:1783952052.834977:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465479680 00000100:00100000:0.0:1783952052.835000:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736 00000100:00100000:0.0:1783952052.835008:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465479808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952052.835058:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465479808:12345-0@lo:400:kworker.0 Request processed in 50us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952052.835065:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736 00000100:00100000:0.0:1783952052.835080:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737 00000100:00100000:0.0:1783952052.835087:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465479680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952052.835114:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465479680:12345-0@lo:400:kworker.0 Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952052.835120:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737 00000100:00100000:0.0:1783952052.835142:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465479040 00000100:00100000:0.0:1783952052.835145:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465479040 00000100:00100000:0.0:1783952052.835163:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465479296 00000100:00100000:0.0:1783952052.835165:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465479296 00000100:00100000:0.0:1783952052.835171:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465479936 00000100:00100000:0.0:1783952052.835173:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465479936 00000100:00100000:0.0:1783952052.835180:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465479168 00000100:00100000:0.0:1783952052.835182:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465479168 00000100:00100000:0.0:1783952052.835195:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465479424 00000100:00100000:0.0:1783952052.835198:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465479424 00000100:00100000:0.0:1783952052.835210:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1783952052.835216:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465479168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952052.835248:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465479168:12345-0@lo:400:kworker.0 Request processed in 32us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952052.835263:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1783952052.835276:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1783952052.835282:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465479424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952052.835310:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465479424:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952052.835315:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1783952052.835327:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1783952052.835331:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465479040:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952052.835347:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952052.835378:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465479040:12345-0@lo:38:kworker.0 Request processed in 46us (703us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952052.835384:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1783952052.835395:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1783952052.835399:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465479296:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952052.835407:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952052.835430:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465479296:12345-0@lo:38:kworker.0 Request processed in 29us (716us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952052.835435:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1783952052.835445:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1783952052.835448:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465479936:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952052.835456:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952052.835480:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465479936:12345-0@lo:38:kworker.0 Request processed in 30us (697us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952052.835485:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1783952052.835515:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465479552 00000100:00100000:0.0:1783952052.835519:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465479552 00000100:00100000:0.0:1783952052.835564:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:0.0:1783952052.835568:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465479552:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952052.835578:0:8445:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952052.835640:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465479552:12345-0@lo:38:kworker.0 Request processed in 71us (892us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952052.835647:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00080000:0.0:1783952052.835672:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952052.835677:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952052.835679:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952052.835715:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465479424:0@lo:400:kworker.0 00000100:00100000:0.0:1783952052.835727:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465479168:0@lo:400:kworker.0 00000100:00080000:0.0:1783952052.835755:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952052.835759:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952052.835762:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465479040:0@lo:38:kworker.0 00000100:00080000:0.0:1783952052.835771:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952052.835773:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952052.835776:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465479296:0@lo:38:kworker.0 00000100:00080000:0.0:1783952052.835783:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952052.835786:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952052.835789:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465479552:0@lo:38:kworker.0 00000100:00080000:0.0:1783952052.835795:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952052.835797:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952052.835801:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14debb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465479936:0@lo:38:kworker.0 00000100:00100000:0.0:1783952052.835842:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465479680:0@lo:400:kworker.0 00000100:00100000:0.0:1783952052.835853:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465479808:0@lo:400:kworker.0 00000100:00100000:3.0:1783952053.745223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952053.745273:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:3.0:1783952053.745302:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447732736 offset 0 length 224: 4 00000100:00100000:3.0:1783952053.745328:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952053.745358:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447733248 00000100:00100000:3.0:1783952053.745368:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447733248 00000100:00100000:3.0:1783952053.745423:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447733120 00000100:00100000:3.0:1783952053.745426:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447733120 00000100:00100000:3.0:1783952053.745451:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2738 00000100:00100000:3.0:1783952053.745461:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447733248:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952053.745532:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447733248:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 72us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952053.745563:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2738 00000100:00100000:3.0:1783952053.745580:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2739 00000100:00100000:3.0:1783952053.745614:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+7:2399:x1870605447733120:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952053.745653:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:458183b2-4c6d-478c-9fed-a955779e6611+7:2399:x1870605447733120:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 66us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952053.745659:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2739 00000100:00080000:3.0:1783952053.745687:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952053.745690:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952053.746089:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447732992 00000100:00100000:0.0:1783952053.746095:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447732992 00000100:00100000:0.0:1783952053.746137:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1252 00000100:00100000:0.0:1783952053.746144:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447732992:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952053.746179:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2399:x1870605447732992:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 35us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952053.746185:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1252 00000100:00080000:3.0:1783952053.746462:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952053.757950:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952053.758043:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447732864 00000100:00100000:1.0:1783952053.758054:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447732864 00000100:00100000:1.0:1783952053.758099:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1256 00000100:00100000:1.0:1783952053.758107:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447732864:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:1.0:1783952053.758128:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952053.758311:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447732864:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 202us (369us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952053.758319:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1256 00010000:00010000:1.0:1783952053.795174:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1783952053.858348:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783952037/real 1783952037] req@ffff97b14de96680 x1870605465474176/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783952053 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952053.858380:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff97b14de96680 x1870605465474176/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783952053 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952053.858390:0:3644:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783952053.858393:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783952053.858397:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.148@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783952053.858399:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783952053.858403:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b14de96680 x1870605465474176/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783952053 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952053.858412:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b14de8ca80 x1870605465476096/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952058 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952053.858435:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b146b4d500 x1870605465477504/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952063 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952053.858443:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b144cf4000 x1870605465478912/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952068 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783952053.858472:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783952053.858475:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783952053.858476:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783952053.858478:0:3644:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1783952053.858501:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465474176:0@lo:400:kworker.0 00000100:00100000:1.0:1783952053.858553:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465478912:0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.858711:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465477504:0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.858719:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465476096:0@lo:400:kworker.0 00000100:00080000:2.0:1783952053.858746:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952053.858751:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783952053.858759:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952053.858764:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3705 00000100:00080000:2.0:1783952053.858771:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952053.858797:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e3800 x1870605465480064/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952053.858817:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952053.858821:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952053.858823:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952053.858825:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3767 00000100:00080000:2.0:1783952053.858828:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783952053.858832:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952053.858846:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e1500 x1870605465480192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952053.858870:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952053.858874:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952053.858876:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952053.858879:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3767 00000100:00080000:2.0:1783952053.858881:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783952053.858885:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952053.858896:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1518e3b80 x1870605465480448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952053.858911:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952053.858915:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952053.858916:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952053.858919:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3767 00000100:00080000:2.0:1783952053.858926:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783952053.858930:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952053.858940:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b146b4ca80 x1870605465480704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952053.858966:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952053.858969:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952053.858970:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952053.858974:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3767 00000100:00080000:2.0:1783952053.858984:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783952053.858988:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952053.858999:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b146b4c000 x1870605465481088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952053.859029:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465480064:0@lo:250:kworker.0 00000400:00000100:2.0:1783952053.859078:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465480064 offset 0 length 520: 4 00000100:00100000:2.0:1783952053.859111:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465480192:0@lo:38:kworker.0 00000100:00100000:2.0:1783952053.859143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952053.859163:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465480448:0@lo:38:kworker.0 00000100:00100000:2.0:1783952053.859184:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952053.859200:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465480704:0@lo:38:kworker.0 00000100:00100000:2.0:1783952053.859224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952053.859252:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465481088:0@lo:38:kworker.0 00000100:00100000:2.0:1783952053.859274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952053.859305:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465480320:0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.859339:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952053.859360:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952053.859365:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465480576:0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.859386:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952053.859414:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465480192 00000100:00100000:2.0:1783952053.859421:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465480192 00000100:00100000:2.0:1783952053.859452:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465480448 00000100:00100000:2.0:1783952053.859455:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465480448 00000100:00100000:2.0:1783952053.859464:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465481088 00000100:00100000:2.0:1783952053.859466:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465481088 00000100:00100000:2.0:1783952053.859474:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465480320 00000100:00100000:2.0:1783952053.859475:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465480320 00000100:00100000:2.0:1783952053.859492:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465480576 00000100:00100000:2.0:1783952053.859494:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465480576 00000100:00100000:2.0:1783952053.859505:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1783952053.859512:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465480320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.859573:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465480320:12345-0@lo:400:kworker.0 Request processed in 61us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952053.859580:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1783952053.859616:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1783952053.859622:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465480576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.859645:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465480576:12345-0@lo:400:kworker.0 Request processed in 24us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952053.859650:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1783952053.859661:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1783952053.859665:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465480192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952053.859681:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952053.859716:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465480192:12345-0@lo:38:kworker.0 Request processed in 50us (572us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952053.859723:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1783952053.859736:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1783952053.859740:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465480448:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952053.859750:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952053.859772:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465480448:12345-0@lo:38:kworker.0 Request processed in 31us (587us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952053.859778:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1783952053.859788:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1783952053.859792:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465481088:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952053.859800:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952053.859821:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465481088:12345-0@lo:38:kworker.0 Request processed in 28us (546us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952053.859827:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1783952053.859849:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465480704 00000100:00100000:2.0:1783952053.859852:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465480704 00000100:00100000:2.0:1783952053.859873:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:2.0:1783952053.859877:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465480704:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952053.859886:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952053.859911:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465480704:12345-0@lo:38:kworker.0 Request processed in 33us (686us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952053.859917:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:2.0:1783952053.859951:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465480960:0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.859976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952053.860003:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783952053.860009:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465480832:0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.860031:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952053.860057:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465480960 00000100:00100000:2.0:1783952053.860060:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465480960 00000100:00100000:2.0:1783952053.860083:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465480832 00000100:00100000:2.0:1783952053.860086:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465480832 00000100:00100000:2.0:1783952053.860103:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740 00000100:00100000:2.0:1783952053.860109:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465480960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.860145:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465480960:12345-0@lo:400:kworker.0 Request processed in 36us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952053.860151:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740 00000100:00100000:2.0:1783952053.860162:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741 00000100:00100000:2.0:1783952053.860168:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465480832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.860193:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465480832:12345-0@lo:400:kworker.0 Request processed in 26us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952053.860199:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741 00000100:00100000:2.0:1783952053.860238:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465480576:0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.860249:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465480320:0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.860275:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465480832:0@lo:400:kworker.0 00000100:00100000:2.0:1783952053.860284:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465480960:0@lo:400:kworker.0 00000100:00080000:2.0:1783952053.860311:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952053.860316:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952053.860319:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465480192:0@lo:38:kworker.0 00000100:00080000:2.0:1783952053.860327:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952053.860336:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952053.860339:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465480448:0@lo:38:kworker.0 00000100:00080000:2.0:1783952053.861764:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952053.861773:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952053.861777:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465480704:0@lo:38:kworker.0 00000100:00080000:2.0:1783952053.861791:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952053.861794:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952053.861797:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465481088:0@lo:38:kworker.0 00000100:00100000:0.0:1783952054.769857:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952054.769900:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952054.769924:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:0.0:1783952054.769944:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447733376 offset 0 length 520: 4 00000100:00100000:0.0:1783952054.769963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952054.769992:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447733888 00000100:00100000:0.0:1783952054.770001:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447733888 00000100:00100000:0.0:1783952054.770050:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447733760 00000100:00100000:0.0:1783952054.770054:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447733760 00000100:00100000:0.0:1783952054.770079:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2742 00000100:00100000:0.0:1783952054.770088:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447733888:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952054.770165:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447733888:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952054.770172:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2742 00000100:00100000:0.0:1783952054.770189:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2743 00000100:00100000:0.0:1783952054.770195:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447733760:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952054.770242:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447733760:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 47us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952054.770249:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2743 00000100:00100000:0.0:1783952054.770268:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447733632 00000100:00100000:0.0:1783952054.770271:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447733632 00000100:00100000:0.0:1783952054.770296:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447733504 00000100:00100000:0.0:1783952054.770299:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447733504 00000100:00100000:0.0:1783952054.770315:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1255 00000100:00100000:0.0:1783952054.770322:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447733632:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952054.770349:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447733632:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952054.770355:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1255 00000100:00100000:0.0:1783952054.770367:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1260 00000100:00100000:0.0:1783952054.770371:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447733504:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:0.0:1783952054.770390:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952054.770414:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447733504:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 41us (450us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952054.770419:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1260 00010000:00010000:0.0:1783952054.823070:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952055.843099:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952055.909340:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465481216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952055.909410:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952055.909457:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952055.909463:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465481344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952055.909487:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952055.909542:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465481216 00000100:00100000:2.0:1783952055.909549:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465481216 00000100:00100000:2.0:1783952055.909616:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465481344 00000100:00100000:2.0:1783952055.909620:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465481344 00000100:00100000:2.0:1783952055.909641:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1783952055.909648:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465481216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783952055.909678:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952055.909723:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465481216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952055.909731:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1783952055.909748:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:2.0:1783952055.909753:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465481344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952055.909776:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952055.909802:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465481344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952055.909809:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00080000:2.0:1783952055.909824:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952055.909827:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952055.909858:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465481344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952055.909873:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465481216:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783952056.867024:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783952056.991365:0:91044:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783952056.991372:0:91044:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783952056.991373:0:91044:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783952056.991487:0:91044:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97b04b215800 00000020:01000004:2.0:1783952056.991512:0:91044:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783952056.991528:0:91044:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783952056.991543:0:91044:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97b14545b380) 00000020:00000080:2.0:1783952056.991563:0:91044:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783952057.056266:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.056472:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783952057.057057:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.057256:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.057426:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.057662:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783952057.057987:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1783952057.058155:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1783952057.058387:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1783952057.058722:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783952057.058929:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.059106:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.059321:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.059528:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783952057.061569:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.061929:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.062269:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.062449:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.062780:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.062942:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.063138:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.063346:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.063545:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.063972:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.064161:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.064445:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.064801:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.064993:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.065248:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.065435:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.065830:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.066084:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.066294:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.066490:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.066918:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.067154:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.067417:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.067773:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.068008:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.068221:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.068480:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.068876:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.069109:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.069334:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1783952057.069539:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.069908:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.070103:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1783952057.072940:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.073315:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.073459:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.073856:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.074034:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1783952057.074228:0:91044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1783952057.075135:0:91044:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783952057.075572:0:91044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783952057.075582:0:91044:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783952057.075756:0:91044:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb504a 00000020:01000004:0.0:1783952057.075765:0:91044:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783952057.075778:0:91044:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783952057.075784:0:91044:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b04b215800 from MGS 00000020:01000004:0.0:1783952057.075787:0:91044:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783952057.075808:0:91044:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97b048b5b380) 00000020:00000080:0.0:1783952057.075821:0:91044:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:0.0:1783952057.075886:0:91044:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b04b215800 from MGS, refs=2 00080000:01000000:0.0:1783952057.075891:0:91044:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783952057.075896:0:91044:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5058 00010000:00010000:0.0:1783952057.076015:0:91044:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1783952057.080419:0:91044:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783952057.081570:0:91048:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783952057.081694:0:91044:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783952057.081722:0:91044:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783952057.082236:0:91044:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783952057.082451:0:91044:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783952057.082579:0:91044:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783952057.082584:0:91044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783952057.088767:0:91044:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783952057.088785:0:91044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783952057.089925:0:91044:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783952057.089934:0:91044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783952057.090564:0:91044:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783952057.090802:0:91044:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1783952057.090804:0:91044:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1783952057.090807:0:91044:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1783952057.090812:0:91044:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 73, was 0): CONNECTING 00000100:00100000:1.0:1783952057.090818:0:91044:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:1.0:1783952057.889530:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952058.912824:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783952058.976935:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952058.976946:0:86521:0:(pinger.c:247:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783952058.976949:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952058.976970:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952058.976974:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952058.976981:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3768 00000100:00080000:1.0:1783952058.976985:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952058.976993:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952058.977052:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab3ce00 x1870605465481472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952058.977112:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465481472:0@lo:38:kworker.0 00000100:00100000:2.0:1783952058.977198:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783952058.977301:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952058.977306:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952058.977308:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952058.977313:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3768 00000100:00080000:1.0:1783952058.977315:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952058.977319:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952058.977334:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab3ca80 x1870605465481728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952058.977407:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465481472 00000100:00100000:3.0:1783952058.977415:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465481472 00000100:00100000:3.0:1783952058.977470:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:3.0:1783952058.977478:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465481472:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952058.977516:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952058.978450:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783952058.978467:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465481600:0@lo:400:kworker.0 00000100:00100000:0.0:1783952058.978518:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952058.978553:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465481600 00000100:00100000:0.0:1783952058.978558:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465481600 00000100:00100000:0.0:1783952058.978636:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:0.0:1783952058.978645:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465481600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952058.978694:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465481600:12345-0@lo:400:kworker.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952058.978701:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:0.0:1783952058.978758:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465481600:0@lo:400:kworker.0 00000100:00080000:0.0:1783952058.978805:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952058.980198:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465481728:0@lo:38:kworker.0 00000100:00100000:2.0:1783952058.980912:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783952058.981059:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952058.981064:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952058.981068:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952058.981073:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3768 00000100:00080000:1.0:1783952058.981077:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952058.981083:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952058.981102:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab3c700 x1870605465481984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952058.981136:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952058.981151:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952058.981153:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952058.981205:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3768 00000100:00080000:1.0:1783952058.981208:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952058.981212:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952058.981230:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab3dc00 x1870605465482368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952058.981345:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465481856:0@lo:400:kworker.0 00000100:00100000:1.0:1783952058.981407:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465482112:0@lo:400:kworker.0 00000100:00100000:1.0:1783952058.981451:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952058.981500:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783952058.981507:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465482240:0@lo:400:kworker.0 00000100:00100000:1.0:1783952058.981531:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952058.981571:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465482112 00000100:00100000:1.0:1783952058.981578:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465482112 00000100:00100000:1.0:1783952058.981644:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465482240 00000100:00100000:1.0:1783952058.981647:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465482240 00000100:00100000:1.0:1783952058.981671:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:1.0:1783952058.981680:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465482112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952058.981728:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465482112:12345-0@lo:400:kworker.0 Request processed in 50us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952058.981736:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00100000:1.0:1783952058.981754:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745 00000100:00100000:1.0:1783952058.981760:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465482240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952058.981801:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465481472:12345-0@lo:38:kworker.0 Request processed in 4321us (4601us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952058.981811:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00080000:2.0:1783952058.981885:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952058.981890:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952058.981893:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465481472:0@lo:38:kworker.0 00000100:00100000:2.0:1783952058.981912:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465481984:0@lo:38:kworker.0 00000100:00100000:2.0:1783952058.981955:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952058.981976:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465482368:0@lo:38:kworker.0 00000100:00100000:2.0:1783952058.982028:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952058.982152:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465482240:12345-0@lo:400:kworker.0 Request processed in 392us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952058.982165:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745 00000100:00100000:1.0:1783952058.982199:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465482240:0@lo:400:kworker.0 00000100:00100000:1.0:1783952058.982209:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465482112:0@lo:400:kworker.0 00000100:00080000:1.0:1783952058.982311:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952058.982317:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952058.982339:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465481984 00000100:00100000:1.0:1783952058.982343:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465481984 00000100:00100000:1.0:1783952058.982363:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1783952058.982368:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465481984:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952058.982387:0:8445:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952058.982417:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465481984:12345-0@lo:38:kworker.0 Request processed in 47us (462us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952058.982424:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00080000:2.0:1783952058.984234:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952058.984244:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952058.984249:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465481984:0@lo:38:kworker.0 00000100:00100000:2.0:1783952058.984276:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952058.984941:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465481728 00000100:00100000:3.0:1783952058.984950:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465481728 00000100:00100000:3.0:1783952058.984986:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465482368 00000100:00100000:3.0:1783952058.984990:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465482368 00000100:00100000:3.0:1783952058.985010:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1783952058.985017:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465481728:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952058.985039:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952058.985099:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465481728:12345-0@lo:38:kworker.0 Request processed in 81us (4187us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952058.985106:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1783952058.986691:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1783952058.986700:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465482368:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952058.986722:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952058.986792:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465482368:12345-0@lo:38:kworker.0 Request processed in 91us (4763us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952058.986815:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00080000:3.0:1783952058.987034:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952058.987039:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952058.987043:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465482368:0@lo:38:kworker.0 00000100:00080000:3.0:1783952058.987053:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952058.987056:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952058.987058:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465481728:0@lo:38:kworker.0 00000100:00100000:3.0:1783952058.987811:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465481856 00000100:00100000:3.0:1783952058.987820:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465481856 00000100:00100000:3.0:1783952058.987874:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1783952058.987882:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465481856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952058.987947:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465481856:12345-0@lo:400:kworker.0 Request processed in 65us (3669us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952058.987954:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00080000:0.0:1783952058.988053:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952058.988111:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465481856:0@lo:400:kworker.0 00000100:00100000:0.0:1783952059.893124:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952059.893181:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952059.893214:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952059.893255:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952059.893465:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447734144 00000100:00100000:3.0:1783952059.893475:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447734144 00000100:00100000:3.0:1783952059.893551:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447734016 00000100:00100000:3.0:1783952059.893555:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447734016 00000100:00100000:3.0:1783952059.893576:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1258 00000100:00100000:3.0:1783952059.893616:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447734144:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952059.893689:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447734144:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 104us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952059.893696:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1258 00000100:00100000:3.0:1783952059.893712:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1264 00000100:00100000:3.0:1783952059.893717:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870605447734016:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783952059.893749:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952059.893771:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870605447734016:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 54us (516us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952059.893777:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1264 00000100:00100000:2.0:1783952059.893940:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447734400 00000100:00100000:2.0:1783952059.893944:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447734400 00000100:00100000:2.0:1783952059.893980:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447734272 00000100:00100000:2.0:1783952059.893983:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447734272 00000100:00100000:2.0:1783952059.894013:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2746 00000100:00100000:2.0:1783952059.894020:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447734400:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952059.894046:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447734400:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952059.894051:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2746 00000100:00100000:2.0:1783952059.894062:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2747 00000100:00100000:2.0:1783952059.894067:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+7:2401:x1870605447734272:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952059.894084:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:458183b2-4c6d-478c-9fed-a955779e6611+7:2401:x1870605447734272:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 17us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952059.894090:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2747 00000100:00080000:0.0:1783952059.894414:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952059.894418:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952059.894421:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783952059.939958:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952060.963515:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952061.024854:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952061.024874:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465482496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952061.024941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952061.024998:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465482624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952061.025024:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952061.026263:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465482496 00000100:00100000:0.0:1783952061.026290:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465482496 00000100:00080000:1.0:1783952061.026326:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952061.026354:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465482624 00000100:00100000:0.0:1783952061.026358:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465482624 00000100:00100000:0.0:1783952061.026392:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1783952061.026402:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465482496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952061.026434:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952061.026510:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465482496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952061.026517:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1783952061.026535:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:0.0:1783952061.026541:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465482624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952061.026557:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952061.026584:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465482624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952061.026607:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00100000:0.0:1783952061.026661:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465482624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952061.026675:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465482496:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783952061.028360:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783952061.984903:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952063.008871:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952063.072768:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783952053/real 1783952053] req@ffff97b1518e3800 x1870605465480064/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783952063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952063.072803:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97b1518e3800 x1870605465480064/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783952063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952063.072825:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952063.072852:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783952063.072870:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465480064:0@lo:250:kworker.0 10000000:01000000:0.0:1783952063.072984:0:91044:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1783952063.073003:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216b000/0x22c73c7857bb4c3e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4c45 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073014:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b000/0x22c73c7857bb4c3e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4c45 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073021:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1783952063.073039:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073069:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216b000/0x22c73c7857bb4c3e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4c45 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073090:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb4ba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4bab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073096:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb4ba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4bab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073103:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952063.073107:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073111:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216ae00/0x22c73c7857bb4ba4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4bab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073119:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b176d23200/0x22c73c7857bb4bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4bc7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073126:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b176d23200/0x22c73c7857bb4bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4bc7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073131:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952063.073134:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073137:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b176d23200/0x22c73c7857bb4bc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4bc7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073146:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b176d22000/0x22c73c7857bb4bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4bf1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073152:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b176d22000/0x22c73c7857bb4bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4bf1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073169:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952063.073173:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073178:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b176d22000/0x22c73c7857bb4bea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4bf1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073187:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb4bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4bff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073192:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb4bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4bff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073198:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952063.073201:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073204:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb4bf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4bff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073212:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762ae200/0x22c73c7857bb4c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4c1b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073218:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762ae200/0x22c73c7857bb4c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4c1b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073223:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952063.073226:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073230:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762ae200/0x22c73c7857bb4c14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4c1b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073239:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb4c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4c29 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073256:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb4c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4c29 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073260:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952063.073265:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073269:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb4c22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4c29 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073277:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b176d22a00/0x22c73c7857bb4c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4c53 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073283:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b176d22a00/0x22c73c7857bb4c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4c53 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073289:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952063.073292:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073295:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b176d22a00/0x22c73c7857bb4c4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4c53 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073308:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b176d23a00/0x22c73c7857bb4bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4bb9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073315:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b176d23a00/0x22c73c7857bb4bb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4bb9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073320:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952063.073322:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073325:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b176d23a00/0x22c73c7857bb4bb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4bb9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073346:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b176d23400/0x22c73c7857bb4bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4bd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073353:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b176d23400/0x22c73c7857bb4bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4bd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073358:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952063.073362:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073365:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b176d23400/0x22c73c7857bb4bce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4bd5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073389:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b176d22400/0x22c73c7857bb4bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4be3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073397:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b176d22400/0x22c73c7857bb4bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4be3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073403:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783952063.073406:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073410:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b176d22400/0x22c73c7857bb4bdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4be3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073419:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb4c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4c0d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073425:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb4c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4c0d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073430:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783952063.073439:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073444:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb4c06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4c0d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.073485:0:91044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb4c30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb4c37 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952063.073492:0:91044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb4c30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb4c37 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952063.073496:0:91044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783952063.073500:0:91044:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783952063.073503:0:91044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb4c30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb4c37 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783952063.073520:0:91044:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 73, was 0): DISCONN 00000100:00080000:0.0:1783952063.073525:0:91044:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952063.073530:0:91044:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3768 00000100:00080000:0.0:1783952063.073535:0:91044:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783952063.073542:0:91044:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952063.073584:0:91044:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b164e3e680 x1870605465482752/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952063.073656:0:91044:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:1.0:1783952063.073944:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952063.073949:0:86521:0:(pinger.c:247:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783952063.073952:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952063.073955:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952063.073957:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952063.073961:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3773 00000100:00080000:1.0:1783952063.073963:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952063.073973:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952063.073991:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab3c380 x1870605465482880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952063.074029:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952063.074032:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952063.074034:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952063.074037:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3773 00000100:00080000:1.0:1783952063.074040:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952063.074043:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952063.074056:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab3fb80 x1870605465483136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952063.074069:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952063.074072:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952063.074074:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952063.074076:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3773 00000100:00080000:1.0:1783952063.074079:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952063.074081:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952063.074089:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab3dc00 x1870605465483392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952063.074116:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952063.074119:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952063.074120:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952063.074123:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3773 00000100:00080000:1.0:1783952063.074125:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952063.074133:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952063.074146:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049eab800 x1870605465483776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952063.074171:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465483520:0@lo:400:kworker.0 00000100:00100000:1.0:1783952063.074230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.074263:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783952063.074269:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465483648:0@lo:400:kworker.0 00000100:00100000:1.0:1783952063.074289:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.074310:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465483264:0@lo:400:kworker.0 00000100:00100000:1.0:1783952063.074334:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.074351:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952063.074356:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465483008:0@lo:400:kworker.0 00000100:00100000:1.0:1783952063.074389:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.074414:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465483264 00000100:00100000:1.0:1783952063.074421:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465483264 00000100:00100000:1.0:1783952063.074477:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465483008 00000100:00100000:1.0:1783952063.074480:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465483008 00000100:00100000:1.0:1783952063.074501:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1783952063.074509:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465483264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952063.074560:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465483264:12345-0@lo:400:kworker.0 Request processed in 51us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.074565:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1783952063.074583:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1783952063.074632:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465483008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952063.074660:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465483008:12345-0@lo:400:kworker.0 Request processed in 72us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.074675:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00080000:1.0:1783952063.074691:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952063.075276:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465483520 00000100:00100000:3.0:1783952063.075281:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465483520 00000100:00100000:3.0:1783952063.075325:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465483648 00000100:00100000:3.0:1783952063.075329:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465483648 00000100:00080000:0.0:1783952063.075353:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952063.075358:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952063.075373:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:3.0:1783952063.075385:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465483520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952063.075386:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:0.0:1783952063.075399:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465483648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952063.075442:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465483520:12345-0@lo:400:kworker.0 Request processed in 60us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952063.075460:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00100000:0.0:1783952063.075463:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465483648:12345-0@lo:400:kworker.0 Request processed in 56us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952063.075484:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000100:00100000:3.0:1783952063.075511:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465482752:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783952063.075545:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952063.075585:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465482880:0@lo:38:kworker.0 00000100:00100000:3.0:1783952063.075634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952063.075651:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465483136:0@lo:38:kworker.0 00000100:00100000:3.0:1783952063.075672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952063.075688:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465483392:0@lo:38:kworker.0 00000100:00100000:3.0:1783952063.075720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952063.075721:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465482880 00000100:00100000:2.0:1783952063.075726:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465482880 00000100:00100000:3.0:1783952063.075740:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465483776:0@lo:38:kworker.0 00000100:00100000:2.0:1783952063.075747:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465483136 00000100:00100000:2.0:1783952063.075749:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465483136 00000100:00100000:3.0:1783952063.075761:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952063.075762:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1783952063.075766:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465482880:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783952063.075787:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465483776 00000100:00100000:3.0:1783952063.075790:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465483776 00000100:00100000:3.0:1783952063.075807:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1783952063.075810:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465483136:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952063.075827:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1783952063.075833:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952063.075859:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465483136:12345-0@lo:38:kworker.0 Request processed in 47us (186us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952063.075865:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1783952063.075881:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1783952063.075884:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465483776:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952063.075894:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952063.076215:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465482752 00000100:00100000:0.0:1783952063.076220:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465482752 00000100:00100000:0.0:1783952063.076246:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783952063.076251:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0459b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3641:x1870605465482752:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783952063.076268:0:91049:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo t0 exp 0000000000000000 cur 3778 last 0 00000020:00000080:0.0:1783952063.076295:0:91049:0:(genops.c:1406:class_connect()) connect: client 75da5dc4-aa7e-42cf-a965-1b5f01232c6f, cookie 0x22c73c7857bb505f 00000100:00080000:0.0:1783952063.076422:0:91049:0:(import.c:65:import_set_state_nolock()) ffff97b0497f6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952063.076541:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465483008:0@lo:400:kworker.0 00000100:00100000:1.0:1783952063.077031:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465483264:0@lo:400:kworker.0 00000100:00100000:1.0:1783952063.077096:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465483392 00000100:00100000:1.0:1783952063.077101:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465483392 00000100:00100000:1.0:1783952063.077128:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:1.0:1783952063.077132:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465483392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952063.077145:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952063.077240:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465482880:12345-0@lo:38:kworker.0 Request processed in 1471us (1603us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952063.077248:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1783952063.081599:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465483776:12345-0@lo:38:kworker.0 Request processed in 5690us (5814us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952063.081614:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1783952063.081749:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465483648:0@lo:400:kworker.0 00000100:00100000:3.0:1783952063.081785:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465483520:0@lo:400:kworker.0 00000100:00100000:0.0:1783952063.082656:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0459b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:3641:x1870605465482752:12345-0@lo:250:mount.lustre.0 Request processed in 6399us (7106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952063.082669:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783952063.082976:0:3641:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.148@tcp: committing for last_committed 0 gen 27 00000100:00080000:2.0:1783952063.082988:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.148@tcp: connect to target with instance 0 00000100:00080000:2.0:1783952063.082997:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783952063.083002:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783952063.083006:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783952063.083009:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783952063.083031:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783952063.083041:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465482752:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1783952063.083057:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952063.083061:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952063.083064:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465482880:0@lo:38:kworker.0 00000100:00080000:2.0:1783952063.083074:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952063.083077:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952063.083079:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465483136:0@lo:38:kworker.0 00000020:01000000:3.0:1783952063.083194:0:86521:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.148@tcp 10000000:01000000:3.0:1783952063.083214:0:86521:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1783952063.083217:0:86521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783952063.083219:0:86521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783952063.083220:0:86521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952063.083221:0:86521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952063.083223:0:86521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952063.083224:0:86521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952063.083225:0:86521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783952063.083227:0:86521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952063.083228:0:86521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:0.0:1783952063.083232:0:91044:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1783952063.083243:0:91044:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000000:3.0:1783952063.083274:0:86521:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1783952063.083279:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465483904:0@lo:253:kworker.0 10000000:01000000:3.0:1783952063.083281:0:86521:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1783952063.083283:0:86521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783952063.083284:0:86521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783952063.083285:0:86521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952063.083286:0:86521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952063.083287:0:86521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952063.083288:0:86521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952063.083289:0:86521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783952063.083291:0:86521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952063.083292:0:86521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783952063.083304:0:86521:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783952063.083308:0:86521:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1783952063.083310:0:86521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783952063.083311:0:86521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783952063.083312:0:86521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952063.083313:0:86521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952063.083315:0:86521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952063.083316:0:86521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952063.083317:0:86521:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783952063.083318:0:86521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952063.083319:0:86521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783952063.083337:0:86521:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1783952063.083387:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.087573:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952063.087614:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465484032:0@lo:253:kworker.0 00000100:00100000:0.0:1783952063.087690:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.088543:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465483904 00000100:00100000:0.0:1783952063.088555:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465483904 00000100:00100000:0.0:1783952063.088631:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465484032 00000100:00100000:0.0:1783952063.088635:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465484032 00000100:00100000:0.0:1783952063.088655:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783952063.088663:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:3642:x1870605465483904:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783952063.088732:0:91051:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:0.0:1783952063.088867:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783952063.088875:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:3642:x1870605465484032:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783952063.088908:0:91049:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1783952063.088922:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783952063.088936:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465484160:0@lo:253:kworker.0 00000100:00100000:0.0:1783952063.088991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1783952063.089054:0:91044:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783952063.089061:0:91044:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783952063.089184:0:91044:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783952063.089218:0:91044:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783952063.089223:0:91044:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783952063.089224:0:91044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783952063.089225:0:91044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952063.089226:0:91044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952063.089227:0:91044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952063.089228:0:91044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952063.089230:0:91044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783952063.089231:0:91044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783952063.089233:0:91044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952063.089234:0:91044:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783952063.089237:0:91044:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783952063.089239:0:91044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783952063.089240:0:91044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783952063.089241:0:91044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952063.089243:0:91044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952063.089244:0:91044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952063.089245:0:91044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952063.089246:0:91044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783952063.089247:0:91044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783952063.089248:0:91044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952063.089249:0:91044:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783952063.089268:0:91044:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783952063.089281:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465484288:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783952063.089314:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.089324:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b480 going to sleep for 11 seconds 00000100:00100000:1.0:1783952063.091581:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465483392:12345-0@lo:38:kworker.0 Request processed in 14435us (15848us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952063.091610:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 10000000:01000000:0.0:1783952063.091828:0:91054:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783952063.092004:0:91051:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 115 00000100:00100000:0.0:1783952063.092205:0:91052:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1783952063.092213:0:91052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1783952063.093969:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465484160 00000100:00100000:0.0:1783952063.093984:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465484160 00000100:00100000:0.0:1783952063.094029:0:91052:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00080000:2.0:1783952063.094113:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952063.094121:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952063.094125:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465483392:0@lo:38:kworker.0 00000100:00080000:2.0:1783952063.094137:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952063.094140:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952063.094143:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465483776:0@lo:38:kworker.0 20000000:01000000:2.0:1783952063.104183:0:91056:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783952063.104206:0:91056:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783952063.104209:0:91056:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783952063.104212:0:91056:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000100:00100000:1.0:1783952063.104402:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465484288 00000100:00100000:1.0:1783952063.104412:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465484288 00000100:00100000:1.0:1783952063.104463:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783952063.104474:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3645:x1870605465484160:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783952063.104515:0:91055:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000040:00080000:2.0:1783952063.104554:0:91056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1783952063.104826:0:91051:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783952063.104857:0:91051:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783952063.113237:0:91052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:0.0:1783952063.113736:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783952063.113751:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:91044:x1870605465484288:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783952063.113797:0:91057:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783952063.113801:0:91057:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783952063.113804:0:91057:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1783952063.113811:0:91057:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783952063.114197:0:91051:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783952063.114212:0:91051:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783952063.114347:0:91049:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783952063.114428:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:91044:x1870605465484288:12345-0@lo:253:mount.lustre.0 Request processed in 679us (25110us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952063.114439:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:0.0:1783952063.114482:0:91054:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783952063.114487:0:91054:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1783952063.114676:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465484288:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783952063.114692:0:91044:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783952063.114695:0:91044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783952063.114696:0:91044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783952063.114698:0:91044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783952063.114699:0:91044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783952063.114700:0:91044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783952063.114701:0:91044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783952063.114702:0:91044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783952063.114704:0:91044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783952063.114715:0:91044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783952063.114716:0:91044:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783952063.114741:0:91044:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b04b215800 from lustre-MDT0000 10000000:01000000:1.0:1783952063.114768:0:91044:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783952063.114771:0:91044:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783952063.114780:0:91044:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97b04b215800 10000000:01000000:1.0:1783952063.114784:0:91044:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783952063.114788:0:91044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97b04b215800 10000000:01000000:1.0:1783952063.114792:0:91044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783952063.114795:0:91044:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b04b215800 from 1 10000000:01000000:1.0:1783952063.114798:0:91044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783952063.114837:0:91044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.114849:0:91044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.114860:0:91044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.114866:0:91054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952063.114883:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465484416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783952063.114885:0:91054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783952063.114897:0:91054:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000411473s 00010000:00010000:0.0:1783952063.114903:0:91054:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.114910:0:91054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952063.114945:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.114982:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b480 going to sleep for 11 seconds 00000100:00100000:1.0:1783952063.115232:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465484416 00000100:00100000:1.0:1783952063.115238:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465484416 00000100:00100000:1.0:1783952063.115265:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783952063.115271:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:91044:x1870605465484416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783952063.115283:0:91057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952063.115297:0:91057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140030600/0x22c73c7857bb5074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb506d expref: -99 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.115326:0:91057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140030600/0x22c73c7857bb5074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb506d expref: 9 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.115349:0:91057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140030600/0x22c73c7857bb5074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb506d expref: 9 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.115358:0:91057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030600, rc 0) 00010000:00010000:0.0:1783952063.115374:0:91054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.115390:0:91054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.115397:0:91054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbdc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952063.115402:0:91054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952063.115409:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:91044:x1870605465484416:12345-0@lo:101:mount.lustre.0 Request processed in 135us (461us total) trans 0 rc 0/0 00010000:00010000:0.0:1783952063.115414:0:91054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952063.115420:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1783952063.115433:0:91054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.115442:0:91054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952063.115506:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465484416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783952063.115521:0:91044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952063.115530:0:91044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952063.115544:0:91044:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783952063.115560:0:91044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952063.115568:0:91044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952063.115575:0:91044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783952063.115579:0:91044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783952063.115584:0:91044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97b04b215800 10000000:01000000:3.0:1783952063.115609:0:91044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783952063.115613:0:91044:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783952063.115616:0:91044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783952063.115638:0:91044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952063.115646:0:91044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952063.115654:0:91044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952063.115669:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465484544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783952063.115705:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952063.115739:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b15253ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783952063.115825:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3642:x1870605465483904:12345-0@lo:253:kworker.0 Request processed in 27160us (32437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952063.115837:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783952063.115860:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465484544 00000100:00100000:2.0:1783952063.115864:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465484544 00000100:00100000:2.0:1783952063.115882:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783952063.115887:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:91044:x1870605465484544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783952063.115894:0:91051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952063.115904:0:91051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1820cd200/0x22c73c7857bb5082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb507b expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952063.115918:0:91051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1820cd200/0x22c73c7857bb5082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb507b expref: 9 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952063.115936:0:91051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1820cd200/0x22c73c7857bb5082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb507b expref: 9 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952063.115943:0:91051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1820cd200, rc 0) 00000100:00100000:2.0:1783952063.115971:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:91044:x1870605465484544:12345-0@lo:101:mount.lustre.0 Request processed in 83us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952063.115976:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783952063.116012:0:91054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5066 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783952063.116109:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783952063.116111:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783952063.116112:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952063.116114:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952063.116115:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952063.116116:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952063.116118:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783952063.116120:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952063.116122:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783952063.116125:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465483904:0@lo:253:kworker.0 00000100:00100000:3.0:1783952063.116170:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465484544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783952063.117034:0:91044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952063.117046:0:91044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952063.121088:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465484672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783952063.121164:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952063.121217:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04855e240 going to sleep for 11 seconds 00000100:00100000:3.0:1783952063.121501:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465484672 00000100:00100000:3.0:1783952063.121509:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465484672 00000100:00100000:3.0:1783952063.121560:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783952063.121570:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:91044:x1870605465484672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783952063.121759:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91044:x1870605465484672:12345-0@lo:501:mount.lustre.0 Request processed in 190us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952063.121768:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783952063.122370:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465484672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783952063.122418:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465484800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783952063.122477:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.123038:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b177815300 going to sleep for 11 seconds 20000000:01000000:3.0:1783952063.123814:0:91049:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783952063.123830:0:91049:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783952063.123924:0:91055:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783952063.124107:0:91054:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783952063.124113:0:91054:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783952063.124134:0:91054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.124159:0:91054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783952063.124186:0:91054:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000411473s 00010000:00010000:0.0:1783952063.124192:0:91054:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.124200:0:91054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.124207:0:91054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.124219:0:91054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.124226:0:91054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbdc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952063.124230:0:91054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.124238:0:91054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.124251:0:91054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.124259:0:91054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.124265:0:91054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5089 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952063.124561:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:3642:x1870605465484032:12345-0@lo:253:kworker.0 Request processed in 35683us (36868us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952063.124580:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783952063.124663:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465484800 00000100:00100000:3.0:1783952063.124669:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465484800 00000020:01000004:0.0:1783952063.124815:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783952063.124824:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783952063.124825:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952063.124826:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952063.124828:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952063.124829:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952063.124831:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783952063.124833:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952063.124835:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783952063.124839:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465484032:0@lo:253:kworker.0 00000100:00100000:2.0:1783952063.132170:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783952063.132228:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:91044:x1870605465484800:12345-0@lo:503:mount.lustre.0 20000000:01000000:1.0:1783952063.132873:0:91055:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783952063.132892:0:91055:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783952063.132970:0:91054:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783952063.132977:0:91054:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783952063.133002:0:91054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.133020:0:91054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783952063.133031:0:91054:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000411473s 00010000:00010000:0.0:1783952063.133036:0:91054:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.133043:0:91054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.133050:0:91054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.133058:0:91054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.133064:0:91054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbda00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952063.133069:0:91054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.133090:0:91054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.133105:0:91054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.133114:0:91054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.133120:0:91054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5090 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952063.133506:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:3645:x1870605465484160:12345-0@lo:253:kworker.0 Request processed in 29031us (44511us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.133517:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1783952063.133565:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783952063.133567:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783952063.133569:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783952063.133570:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783952063.133571:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783952063.133573:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783952063.133574:0:3645:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783952063.133576:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783952063.133577:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783952063.133580:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465484160:0@lo:253:kworker.0 00000100:00100000:1.0:1783952063.134770:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:91044:x1870605465484800:12345-0@lo:503:mount.lustre.0 Request processed in 2573us (12285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.134779:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783952063.134884:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465484800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783952063.135713:0:91058:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91058:1870605465484928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952063.135764:0:91058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.135830:0:91058:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b177815840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952063.135864:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465484928 00000100:00100000:2.0:1783952063.135870:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465484928 00000100:00100000:2.0:1783952063.136011:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783952063.136021:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:91058:x1870605465484928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952063.136656:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:91058:x1870605465484928:12345-0@lo:502:llog_process_th.0 Request processed in 634us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952063.136664:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783952063.136732:0:91058:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91058:1870605465484928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783952063.136760:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952063.136771:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952063.136774:0:91058:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783952063.136779:0:91058:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783952063.136782:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783952063.136797:0:91058:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97b048b58000) 00000020:00000080:0.0:1783952063.136818:0:91058:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1783952063.136825:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783952063.137039:0:91058:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783952063.137048:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb509e 00000020:00000080:0.0:1783952063.137341:0:91058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783952063.137353:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783952063.137356:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952063.137357:0:91058:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783952063.137360:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952063.137363:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952063.137365:0:91058:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783952063.137368:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783952063.137375:0:91058:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97b048b599c0) 00000020:00000080:0.0:1783952063.137387:0:91058:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1783952063.137390:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783952063.137392:0:91058:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783952063.137395:0:91058:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783952063.137400:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783952063.137445:0:91058:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b04b215800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783952063.137467:0:91058:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97b048b5cd40) 00000020:00000080:0.0:1783952063.137477:0:91058:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1783952063.137525:0:91058:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783952063.137529:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb50b3 00000020:00000080:0.0:1783952063.137660:0:91058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783952063.137666:0:91058:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783952063.137670:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x22c73c7857bb50ba 00080000:01000000:0.0:1783952063.137675:0:91058:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783952063.137678:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb50c1 00010000:00010000:1.0:1783952063.241778:0:91058:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1783952063.241930:0:91058:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 458183b2-4c6d-478c-9fed-a955779e6611 idx: 0 lr: 107374182411 srv lr: 111669149696 lx: 0 gen 23 00000001:00080000:1.0:1783952063.241980:0:91058:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149696 lx: 0 gen 22 00000001:00000004:1.0:1783952063.242009:0:91058:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149696 00000001:00080000:1.0:1783952063.242137:0:91058:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1783952063.242561:0:91058:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b153094240: xid 1870605447723520, transno 111669149703, client gen 23, slot idx 0 00000001:00080000:1.0:1783952063.242574:0:91058:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b1748e6f00: xid 1870605447723264, transno 111669149702, client gen 23, slot idx 1 00000020:00000080:1.0:1783952063.243124:0:91058:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97b167c94d40) 00000020:00000080:1.0:1783952063.245696:0:91058:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1783952063.245811:0:91058:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783952063.245822:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb50dd 00000020:00000080:1.0:1783952063.255409:0:91058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783952063.259880:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x22c73c7857bb50e4 00000020:00000080:1.0:1783952063.260200:0:91058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783952063.260408:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952063.260417:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.260419:0:91058:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783952063.260423:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783952063.260427:0:91058:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1783952063.260428:0:91058:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783952063.260430:0:91058:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783952063.260431:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783952063.260434:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.260435:0:91058:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783952063.260438:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783952063.260442:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.260444:0:91058:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783952063.260459:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783952063.260503:0:91058:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783952063.260517:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952063.260526:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.260528:0:91058:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783952063.260532:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783952063.260535:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.260537:0:91058:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783952063.260540:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783952063.260545:0:91058:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:00000080:1.0:1783952063.260569:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783952063.260635:0:91058:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff97b167c919c0) 00000020:00000080:1.0:1783952063.260655:0:91058:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1783952063.260662:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783952063.260724:0:91058:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783952063.260731:0:91058:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783952063.260736:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb50f2 00010000:00080000:1.0:1783952063.260768:0:91058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b176be3000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1783952063.263841:0:91058:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1783952063.267058:0:91058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783952063.267076:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783952063.267122:0:91058:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783952063.267162:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb50f9 00000100:00080000:3.0:1783952063.267173:0:91058:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783952063.267179:0:91058:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97b176be3000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952063.267717:0:91058:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1447b1880 x1870605465485056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952063.267756:0:91058:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783952063.267897:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952063.267902:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952063.267905:0:91058:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783952063.267908:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783952063.267911:0:91058:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1783952063.267913:0:91058:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783952063.267915:0:91058:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783952063.267916:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783952063.267918:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952063.267920:0:91058:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783952063.267923:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783952063.267927:0:91058:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783952063.267930:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952063.267932:0:91058:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783952063.267934:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783952063.267938:0:91058:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:3.0:1783952063.267963:0:91058:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783952063.267966:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783952063.267994:0:91058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97b0489bcd40) 00000020:00000080:3.0:1783952063.268013:0:91058:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783952063.268019:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783952063.268090:0:91058:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783952063.268098:0:91058:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783952063.268105:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5107 00010000:00080000:3.0:1783952063.268137:0:91058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b04661c800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:3.0:1783952063.268349:0:91058:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1783952063.268735:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465485056:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783952063.268805:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952063.269908:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465485056 00000100:00100000:3.0:1783952063.269919:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465485056 00000100:00100000:3.0:1783952063.269999:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1783952063.270006:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465485056:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783952063.270037:0:8445:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3778 last 0 00000020:00000080:3.0:1783952063.270095:0:8445:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb510e 00000004:00100000:3.0:1783952063.270111:0:8445:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783952063.270233:0:8445:0:(import.c:65:import_set_state_nolock()) ffff97b1469d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952063.270309:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465485056:12345-0@lo:38:llog_process_th.0 Request processed in 301us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952063.270317:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:0.0:1783952063.271987:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783952063.272002:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1783952063.272011:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783952063.272017:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783952063.272020:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b176be3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783952063.272042:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465485056:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783952063.272298:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465485184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952063.272354:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952063.272436:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465485184 00000100:00100000:2.0:1783952063.272442:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465485184 00000100:00100000:2.0:1783952063.272497:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:2.0:1783952063.272506:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465485184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783952063.272539:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000040:01000000:1.0:1783952063.272941:0:91058:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783952063.272979:0:91058:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783952063.273507:0:91058:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000100:00100000:2.0:1783952063.274639:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465485184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2129us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952063.274652:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000040:00080000:1.0:1783952063.274909:0:91058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783952063.274938:0:91058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:1.0:1783952063.275106:0:91058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000100:00100000:0.0:1783952063.275838:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465485184:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783952063.275979:0:91064:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:3.0:1783952063.275985:0:91064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783952063.276126:0:91064:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:3.0:1783952063.276143:0:91064:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783952063.276290:0:91064:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:3.0:1783952063.276294:0:91064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783952063.277430:0:91058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952063.277443:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783952063.277497:0:91058:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783952063.277525:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5115 00000100:00080000:1.0:1783952063.277537:0:91058:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783952063.277543:0:91058:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b04661c800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952063.277762:0:91058:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab3c380 x1870605465485312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952063.277821:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465485312:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783952063.277893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952063.277983:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465485312 00000100:00100000:2.0:1783952063.277992:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465485312 00000100:00100000:2.0:1783952063.278037:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4927 00000100:00100000:2.0:1783952063.278046:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3641:x1870605465485312:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1783952063.278074:0:26199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3778 last 0 00000020:00000080:2.0:1783952063.278103:0:26199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb511c 00002000:00100000:2.0:1783952063.278117:0:26199:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97b174b12800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783952063.278121:0:26199:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783952063.278124:0:26199:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783952063.278230:0:26199:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783952063.278257:0:26199:0:(import.c:65:import_set_state_nolock()) ffff97b174b17000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783952063.278966:0:91058:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783952063.279082:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952063.279089:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.279091:0:91058:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783952063.279094:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783952063.279097:0:91058:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1783952063.279099:0:91058:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783952063.279101:0:91058:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783952063.279102:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783952063.279105:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.279106:0:91058:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783952063.279109:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783952063.279113:0:91058:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783952063.279116:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.279118:0:91058:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783952063.279121:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783952063.279125:0:91058:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:1.0:1783952063.279158:0:91058:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783952063.279162:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783952063.279177:0:91058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97b1447b99c0) 00000020:00000080:1.0:1783952063.279198:0:91058:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783952063.279203:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783952063.281073:0:91058:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783952063.281085:0:91058:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783952063.281096:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb512a 00010000:00080000:1.0:1783952063.281137:0:91058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b1742bc000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1783952063.281464:0:91058:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1783952063.281540:0:91058:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783952063.281558:0:91058:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783952063.282470:0:91058:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:1.0:1783952063.283485:0:91058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783952063.283519:0:91058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:1.0:1783952063.283734:0:91058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000040:00080000:1.0:1783952063.284719:0:91066:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:1.0:1783952063.284725:0:91066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1783952063.284888:0:91066:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000040:00080000:1.0:1783952063.284907:0:91066:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1783952063.285023:0:91066:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:1.0:1783952063.285026:0:91066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783952063.285904:0:91058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952063.285915:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783952063.285957:0:91058:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783952063.285983:0:91058:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5131 00000100:00080000:1.0:1783952063.285995:0:91058:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783952063.286002:0:91058:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97b1742bc000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952063.286038:0:91058:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab3c700 x1870605465485440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952063.286057:0:91058:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783952063.286113:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952063.286117:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.286119:0:91058:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783952063.286121:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783952063.286126:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.286127:0:91058:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783952063.286130:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783952063.286131:0:91058:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783952063.286133:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952063.286136:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.286137:0:91058:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783952063.286139:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783952063.286141:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.286143:0:91058:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783952063.286161:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783952063.286203:0:91058:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91058:1870605465485568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952063.286289:0:91058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.286335:0:91058:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952063.287669:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465485568 00000100:00100000:3.0:1783952063.287680:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465485568 00000100:00100000:3.0:1783952063.287739:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783952063.287750:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:91058:x1870605465485568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952063.287915:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:91058:x1870605465485568:12345-0@lo:502:llog_process_th.0 Request processed in 167us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952063.287924:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783952063.288717:0:91058:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91058:1870605465485568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783952063.288768:0:91058:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952063.288776:0:91058:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952063.288778:0:91058:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783952063.288784:0:91058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1783952063.288934:0:91044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1783952063.288958:0:91044:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783952063.288981:0:91044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.288992:0:91044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952063.288999:0:91044:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b04b215800 from 1 10000000:01000000:1.0:1783952063.289002:0:91044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783952063.289036:0:91044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.289044:0:91044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.289054:0:91044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952063.289074:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465485696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783952063.289122:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.289261:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952063.289295:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465485696 00000100:00100000:1.0:1783952063.289300:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465485696 00000100:00100000:1.0:1783952063.289332:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783952063.289340:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:91044:x1870605465485696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783952063.289351:0:91057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952063.289364:0:91057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140030200/0x22c73c7857bb513f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5138 expref: -99 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.289385:0:91057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140030200/0x22c73c7857bb513f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5138 expref: 9 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.289394:0:91057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140030200/0x22c73c7857bb513f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5138 expref: 9 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.289403:0:91057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030200, rc 0) 00000100:00100000:1.0:1783952063.289438:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:91044:x1870605465485696:12345-0@lo:101:mount.lustre.0 Request processed in 99us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.289444:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783952063.289497:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465485696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783952063.289510:0:91044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.289519:0:91044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952063.290716:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465485312:12345-0@lo:8:llog_process_th.0 Request processed in 12664us (12817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952063.290729:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4927 00000100:00100000:1.0:1783952063.291136:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465485824:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783952063.291288:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783952063.291300:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783952063.291308:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783952063.291315:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783952063.291320:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b04661c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783952063.291424:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.291463:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e9c0 going to sleep for 11 seconds 00000004:00080000:0.0:1783952063.292347:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783952063.292359:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465485312:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783952063.292390:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465485440:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783952063.292444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783952063.292551:0:91064:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783952063.292666:0:91064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3778235077214ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783952063.292673:0:91064:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783952063.292710:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465485440 00000100:00100000:1.0:1783952063.292720:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465485440 00000100:00100000:1.0:1783952063.292752:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4928 00000100:00100000:1.0:1783952063.292762:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3641:x1870605465485440:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783952063.292795:0:26202:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3778 last 0 00000020:00000080:1.0:1783952063.292825:0:26202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5146 00002000:00100000:1.0:1783952063.292843:0:26202:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97b1742be000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783952063.292847:0:26202:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783952063.292850:0:26202:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783952063.292909:0:26202:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783952063.292936:0:26202:0:(import.c:65:import_set_state_nolock()) ffff97b1742be800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952063.292989:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465485440:12345-0@lo:8:llog_process_th.0 Request processed in 228us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.292997:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4928 00000100:00100000:2.0:1783952063.293079:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465485824 00000100:00100000:2.0:1783952063.293085:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465485824 00000100:00100000:2.0:1783952063.293119:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783952063.293126:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:91044:x1870605465485824:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783952063.293143:0:91052:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783952063.293177:0:91052:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783952063.293181:0:91052:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783952063.293185:0:91052:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783952063.293187:0:91052:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 118 00000100:00100000:2.0:1783952063.293284:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:91044:x1870605465485824:12345-0@lo:256:mount.lustre.0 Request processed in 158us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952063.293290:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783952063.293868:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783952063.293878:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783952063.293886:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783952063.293891:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783952063.293893:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1742bc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783952063.293908:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783952063.293915:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465485440:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1783952063.293942:0:91066:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783952063.294401:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465485824:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783952063.295028:0:91044:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783952063.295051:0:91044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.295063:0:91044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952063.295072:0:91044:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b04b215800 from 1 10000000:01000000:1.0:1783952063.295075:0:91044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783952063.295119:0:91044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.295128:0:91044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.295138:0:91044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952063.295310:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465485952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783952063.295382:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.295421:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952063.295672:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465486080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952063.295707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.295924:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465485952 00000100:00100000:0.0:1783952063.295933:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465485952 00000100:00100000:0.0:1783952063.295977:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783952063.295995:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:91044:x1870605465485952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783952063.296009:0:91049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952063.296024:0:91049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5154 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb514d expref: -99 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.296046:0:91049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb514d expref: 10 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.296056:0:91049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5154 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb514d expref: 10 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.296065:0:91049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbda00, rc 0) 00000100:00100000:0.0:1783952063.296106:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91044:x1870605465485952:12345-0@lo:101:mount.lustre.0 Request processed in 113us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952063.296113:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783952063.296331:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465485952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783952063.296348:0:91044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.296357:0:91044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952063.296424:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465486208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783952063.296463:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.296486:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f397540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952063.296634:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465486080 00000100:00100000:2.0:1783952063.296640:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465486080 00000100:00100000:2.0:1783952063.296684:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:2.0:1783952063.296692:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465486080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783952063.296715:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952063.296755:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465486080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952063.296761:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:1.0:1783952063.296849:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465486208 00000100:00100000:1.0:1783952063.296854:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465486208 00000100:00100000:1.0:1783952063.296874:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783952063.296880:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91044:x1870605465486208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783952063.297020:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91044:x1870605465486208:12345-0@lo:501:mount.lustre.0 Request processed in 139us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.297027:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1783952063.297097:0:91066:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3778239508376ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783952063.297105:0:91066:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783952063.297146:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465486080:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783952063.297298:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952063.297325:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465486208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783952063.297364:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465486336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783952063.297420:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.297465:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f397540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952063.297680:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465486336 00000100:00100000:2.0:1783952063.297686:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465486336 00000100:00100000:2.0:1783952063.297720:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783952063.297736:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91044:x1870605465486336:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783952063.297834:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91044:x1870605465486336:12345-0@lo:503:mount.lustre.0 Request processed in 99us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952063.297841:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783952063.298773:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465486336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783952063.299644:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465486464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952063.299702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952063.299753:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465486464 00000100:00100000:3.0:1783952063.299759:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465486464 00000100:00100000:3.0:1783952063.299809:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:3.0:1783952063.299816:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465486464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783952063.299843:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952063.299882:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465486464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952063.299889:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00080000:3.0:1783952063.299910:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952063.299945:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465486464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952063.300252:0:91068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91068:1870605465486592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952063.300306:0:91068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.300340:0:91068:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f397180 going to sleep for 11 seconds 00000100:00100000:1.0:1783952063.300391:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465486592 00000100:00100000:1.0:1783952063.300397:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465486592 00000100:00100000:1.0:1783952063.300442:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783952063.300459:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91068:x1870605465486592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952063.301110:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91068:x1870605465486592:12345-0@lo:502:llog_process_th.0 Request processed in 659us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.301118:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783952063.301220:0:91068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91068:1870605465486592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783952063.301248:0:91068:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952063.301258:0:91068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952063.301260:0:91068:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783952063.301268:0:91068:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b04b215800 00000020:00000080:0.0:1783952063.301270:0:91068:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783952063.301278:0:91068:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783952063.301280:0:91068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952063.301281:0:91068:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783952063.301284:0:91068:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952063.301286:0:91068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952063.301287:0:91068:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783952063.301290:0:91068:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b04b215800 00000020:00000080:0.0:1783952063.301292:0:91068:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783952063.301371:0:91068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91068:1870605465486720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952063.301406:0:91068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.301439:0:91068:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f397180 going to sleep for 11 seconds 00000100:00100000:3.0:1783952063.301497:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465486720 00000100:00100000:3.0:1783952063.301502:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465486720 00000100:00100000:3.0:1783952063.301539:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783952063.301546:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91068:x1870605465486720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952063.301655:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91068:x1870605465486720:12345-0@lo:502:llog_process_th.0 Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952063.301663:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783952063.301870:0:91068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91068:1870605465486720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783952063.301890:0:91068:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783952063.301894:0:91068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952063.301895:0:91068:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783952063.301899:0:91068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783952063.302063:0:91044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783952063.302086:0:91044:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783952063.302106:0:91044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952063.302124:0:91044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952063.302201:0:91044:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783952063.302205:0:91044:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97b04b215800 10000000:01000000:3.0:1783952063.302208:0:91044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97b04b215800 10000000:01000000:3.0:1783952063.302212:0:91044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783952063.302218:0:91044:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b04b215800 from 1 10000000:01000000:3.0:1783952063.302221:0:91044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783952063.302247:0:91044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952063.302255:0:91044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952063.302264:0:91044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952063.302279:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465486848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783952063.302311:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952063.302333:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952063.310724:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465486848 00000100:00100000:1.0:1783952063.310743:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465486848 00000100:00100000:1.0:1783952063.310810:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783952063.310821:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:91044:x1870605465486848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783952063.310838:0:91049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952063.310856:0:91049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140030800/0x22c73c7857bb5162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb515b expref: -99 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.310885:0:91049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140030800/0x22c73c7857bb5162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb515b expref: 11 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.310896:0:91049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140030800/0x22c73c7857bb5162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb515b expref: 11 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.310906:0:91049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030800, rc 0) 00000100:00100000:1.0:1783952063.310997:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91044:x1870605465486848:12345-0@lo:101:mount.lustre.0 Request processed in 178us (8685us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.311005:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783952063.311827:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465486848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783952063.311848:0:91044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952063.311859:0:91044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952063.311939:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465486976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783952063.311983:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952063.312023:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1525de600 going to sleep for 11 seconds 00000100:00100000:1.0:1783952063.312074:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465486976 00000100:00100000:1.0:1783952063.312079:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465486976 00000100:00100000:1.0:1783952063.312120:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783952063.312128:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91044:x1870605465486976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783952063.312357:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91044:x1870605465486976:12345-0@lo:501:mount.lustre.0 Request processed in 229us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.312376:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783952063.312459:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465486976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783952063.312488:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465487104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783952063.312535:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952063.312558:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1525de600 going to sleep for 11 seconds 00000100:00100000:0.0:1783952063.312629:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465487104 00000100:00100000:0.0:1783952063.312640:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465487104 00000100:00100000:0.0:1783952063.312671:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783952063.312678:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91044:x1870605465487104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783952063.312769:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91044:x1870605465487104:12345-0@lo:503:mount.lustre.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952063.312776:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783952063.312856:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465487104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783952063.313419:0:91071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91071:1870605465487232:0@lo:502:llog_process_th.0 00000004:00080000:2.0:1783952063.315375:0:91045:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783952063.315966:0:91071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.316013:0:91071:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049198d80 going to sleep for 11 seconds 00000004:00080000:2.0:1783952063.317054:0:91045:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783952063.320142:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465487232 00000100:00100000:1.0:1783952063.320171:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465487232 00000100:00100000:1.0:1783952063.320323:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783952063.320334:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91071:x1870605465487232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952063.320552:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91071:x1870605465487232:12345-0@lo:502:llog_process_th.0 Request processed in 219us (4587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.320561:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783952063.325739:0:91071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91071:1870605465487232:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783952063.325827:0:91071:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783952063.325844:0:91071:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97b1447bcd40) 00000020:00000080:1.0:1783952063.325871:0:91071:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1783952063.326051:0:91071:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b04b215800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783952063.326056:0:91071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b04b215800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783952063.326058:0:91071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b04b215800 4 00010000:00080000:1.0:1783952063.326090:0:91071:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b144764000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1783952063.327857:0:91071:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1783952063.327963:0:91071:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783952063.328008:0:91071:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783952063.328021:0:91071:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x22c73c7857bb5170 00000100:00080000:1.0:1783952063.328031:0:91071:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783952063.328036:0:91071:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b144764000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952063.328073:0:91071:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab3df80 x1870605465487360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952063.328113:0:91071:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783952063.331353:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465487360:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783952063.331444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952063.335075:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465487360 00000100:00100000:2.0:1783952063.335088:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465487360 00000100:00100000:2.0:1783952063.335210:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1783952063.335219:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465487360:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783952063.338319:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465487360:12345-0@lo:38:llog_process_th.0 Request processed in 2865us (6639us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783952063.338336:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1783952063.339257:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783952063.339267:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b144764000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952063.339272:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783952063.339277:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465487360:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783952063.339970:0:91071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91071:1870605465487488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952063.340049:0:91071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952063.340101:0:91071:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d240 going to sleep for 11 seconds 00000100:00100000:0.0:1783952063.341319:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465487488 00000100:00100000:0.0:1783952063.341328:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465487488 00000100:00100000:0.0:1783952063.341382:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783952063.341392:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91071:x1870605465487488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952063.341538:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91071:x1870605465487488:12345-0@lo:502:llog_process_th.0 Request processed in 147us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952063.341546:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783952063.341791:0:91071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91071:1870605465487488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952063.341843:0:91071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91071:1870605465487616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952063.341881:0:91071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952063.341959:0:91071:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d240 going to sleep for 11 seconds 00000100:00100000:1.0:1783952063.348025:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465487616 00000100:00100000:1.0:1783952063.348040:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465487616 00000100:00100000:1.0:1783952063.348235:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783952063.348246:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91071:x1870605465487616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952063.348433:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91071:x1870605465487616:12345-0@lo:502:llog_process_th.0 Request processed in 189us (6551us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.348442:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783952063.348547:0:91071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91071:1870605465487616:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783952063.348584:0:91071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783952063.349182:0:91044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783952063.349208:0:91044:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783952063.349225:0:91044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.349236:0:91044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783952063.349288:0:91044:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783952063.349290:0:91044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783952063.349292:0:91044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952063.349293:0:91044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952063.349294:0:91044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952063.349295:0:91044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952063.349296:0:91044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783952063.349298:0:91044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783952063.349299:0:91044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952063.349306:0:91044:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783952063.349310:0:91044:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783952063.349312:0:91044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783952063.349314:0:91044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783952063.349315:0:91044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952063.349316:0:91044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952063.349316:0:91044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952063.349317:0:91044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952063.349318:0:91044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783952063.349319:0:91044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783952063.349320:0:91044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952063.349321:0:91044:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783952063.349340:0:91044:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783952063.349357:0:91044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465487744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783952063.349406:0:91044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.349814:0:91044:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f3979c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952063.349908:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465487744 00000100:00100000:2.0:1783952063.349915:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465487744 00000100:00100000:2.0:1783952063.349966:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783952063.349974:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91044:x1870605465487744:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783952063.350002:0:91052:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783952063.350016:0:91052:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783952063.362943:0:91052:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783952063.363073:0:91052:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783952063.363527:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:91044:x1870605465487744:12345-0@lo:253:mount.lustre.0 Request processed in 13549us (14115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952063.363541:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783952063.363672:0:91044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:91044:1870605465487744:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783952063.363687:0:91044:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783952063.363691:0:91044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783952063.363693:0:91044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783952063.363694:0:91044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952063.363695:0:91044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952063.363697:0:91044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952063.363698:0:91044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952063.363699:0:91044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783952063.363700:0:91044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783952063.363703:0:91044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952063.363705:0:91044:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783952063.363720:0:91044:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1783952063.366811:0:91054:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783952063.366824:0:91054:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783952063.366853:0:91054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.366871:0:91054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b140030200/0x22c73c7857bb513f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5138 expref: 10 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.366879:0:91054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.366923:0:91054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b140030200/0x22c73c7857bb513f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5138 expref: 10 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.366939:0:91054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b140030200/0x22c73c7857bb513f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5138 expref: 10 pid: 91057 timeout: 3878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952063.367305:0:91054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:91054:1870605465487872:0@lo:104: 00000100:00100000:0.0:1783952063.367387:0:91054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952063.367429:0:91054:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f397540 going to sleep for 11 seconds 00000100:00100000:0.0:1783952063.368376:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465487872 00000100:00100000:0.0:1783952063.368388:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465487872 00000100:00100000:0.0:1783952063.368456:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1783952063.368466:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:91054:x1870605465487872:12345-0@lo:104: 00010000:00010000:0.0:1783952063.368482:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952063.368546:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783952063.368552:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:91054:x1870605465487872:12345-0@lo:104: Request processed in 88us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952063.368559:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1783952063.368615:0:91054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:91054:1870605465487872:0@lo:104: 00010000:00010000:0.0:1783952063.368636:0:91054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369014:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952063.369021:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369030:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031600 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783952063.369034:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369043:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783952063.369051:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952063.369069:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783952063.369112:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369119:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952063.369140:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369148:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b140031600/0x22c73c7857bb5138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb513f expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369179:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952063.369181:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952063.369183:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952063.369197:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465488000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952063.369246:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952063.369299:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465488000 00000100:00100000:1.0:1783952063.369304:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465488000 00010000:00010000:1.0:1783952063.369325:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b140030200/0x22c73c7857bb513f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5138 expref: 11 pid: 91057 timeout: 3878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952063.369348:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:1.0:1783952063.369354:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:3644:x1870605465488000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952063.369365:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952063.369371:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b140030200/0x22c73c7857bb513f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5138 expref: 11 pid: 91057 timeout: 3878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369380:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b140030200/0x22c73c7857bb513f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5138 expref: 11 pid: 91057 timeout: 3878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369403:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140030200/0x22c73c7857bb513f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5138 expref: 11 pid: 91057 timeout: 3878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369415:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369424:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783952063.369438:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002615011s 00010000:00010000:1.0:1783952063.369442:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369461:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369468:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369474:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369479:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbdc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952063.369483:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369491:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369507:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369523:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952063.369567:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:3644:x1870605465488000:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952063.369574:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:0.0:1783952063.369606:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465488000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952063.369613:0:91054:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369620:0:91054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952063.369627:0:91054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb5177 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783952063.389838:0:91044:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411352 00000040:01000000:0.0:1783952063.390436:0:91044:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1783952063.390865:0:91077:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783952063.392827:0:91044:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1783952063.393941:0:91078:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91078:1870605465488128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952063.394031:0:91078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952063.394065:0:91078:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396600 going to sleep for 11 seconds 00000100:00100000:0.0:1783952063.394364:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465488128 00000040:00080000:1.0:1783952063.394372:0:91077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783952063.394372:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465488128 00000100:00100000:0.0:1783952063.394419:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:0.0:1783952063.394427:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91078:x1870605465488128:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783952063.394526:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91078:x1870605465488128:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 100us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952063.394543:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000040:01000000:0.0:1783952063.394883:0:91044:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783952063.394914:0:91044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1783952063.395319:0:91076:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411352 00000020:00080000:2.0:1783952063.395324:0:91076:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411352 00000100:00100000:3.0:1783952063.395649:0:91078:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91078:1870605465488128:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783952063.395694:0:91078:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783952063.395741:0:91078:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91078:1870605465488256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952063.395797:0:91078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952063.395821:0:91078:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b5a480 going to sleep for 11 seconds 00000100:00100000:2.0:1783952063.395880:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465488256 00000100:00100000:2.0:1783952063.395886:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465488256 00000100:00100000:2.0:1783952063.395937:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:2.0:1783952063.395944:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91078:x1870605465488256:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783952063.396076:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91078:x1870605465488256:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952063.396083:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:3.0:1783952063.396756:0:91078:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91078:1870605465488256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952063.396842:0:91078:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91078:1870605465488384:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952063.396878:0:91078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952063.396904:0:91078:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046b5a480 going to sleep for 11 seconds 00000100:00100000:2.0:1783952063.396987:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465488384 00000100:00100000:2.0:1783952063.396992:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465488384 00000100:00100000:2.0:1783952063.397030:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:2.0:1783952063.397037:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91078:x1870605465488384:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783952063.397113:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91078:x1870605465488384:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952063.397120:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000004:00000080:0.0:1783952063.397697:0:91044:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783952063.397713:0:91044:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783952063.397800:0:91044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783952063.398369:0:91078:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91078:1870605465488384:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783952063.398429:0:91078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783952063.401424:0:91044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783952063.402049:0:91044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783952063.402088:0:91044:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783952063.404381:0:91044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783952063.405687:0:91044:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00000040:00080000:3.0:1783952063.406140:0:91078:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783952063.406425:0:91078:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1783952063.406627:0:91077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783952063.407008:0:91077:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783952063.407012:0:91077:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1783952063.411371:0:91044:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149703 00010000:00080000:0.0:1783952063.412864:0:91079:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 91079 00010000:02000000:0.0:1783952063.412874:0:91079:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:1.0:1783952063.413121:0:91044:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783952063.413138:0:91044:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783952063.413364:0:91044:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1783952063.413394:0:91044:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00010000:00080000:0.0:1783952063.430078:0:91079:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783952063.430088:0:91079:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:3.0:1783952063.436707:0:91044:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783952063.436976:0:91044:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783952064.034244:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783952064.608710:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783952064.608718:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b04b215800 from 119 10000000:01000000:0.0:1783952064.608723:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783952064.608766:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.608779:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.608789:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952064.608815:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465488512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.608959:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.609054:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d9240 going to sleep for 11 seconds 00000100:00100000:2.0:1783952064.616284:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465488512 00000100:00100000:2.0:1783952064.616303:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465488512 00000100:00100000:2.0:1783952064.616382:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783952064.616393:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:6514:x1870605465488512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952064.616409:0:91051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952064.616429:0:91051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1820cd400/0x22c73c7857bb5185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb517e expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.616469:0:91051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1820cd400/0x22c73c7857bb5185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb517e expref: 11 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.616480:0:91051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1820cd400/0x22c73c7857bb5185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb517e expref: 11 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.616489:0:91051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1820cd400, rc 0) 00000100:00100000:2.0:1783952064.616572:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465488512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (7612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952064.616580:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783952064.616777:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465488512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952064.616797:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.616808:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952064.616878:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465488640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.616923:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.616965:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d9240 going to sleep for 11 seconds 00000100:00100000:2.0:1783952064.617346:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465488640 00000100:00100000:2.0:1783952064.617352:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465488640 00000100:00100000:2.0:1783952064.617391:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783952064.617399:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465488640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783952064.617423:0:91049:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783952064.617449:0:91049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783952064.617452:0:91049:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 119 00000100:00100000:2.0:1783952064.617544:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465488640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952064.617551:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783952064.617739:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465488640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783952064.617791:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783952064.617799:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.617807:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952064.617815:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783952064.617817:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b151231000 from 52 10000000:01000000:0.0:1783952064.617820:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783952064.617842:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb518c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.617849:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb518c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.617868:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb518c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952064.617884:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465488768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.617913:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.617948:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141359180 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.618004:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465488768 00000100:00100000:3.0:1783952064.618009:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465488768 00000100:00100000:3.0:1783952064.618034:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783952064.618042:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465488768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952064.618051:0:91052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952064.618063:0:91052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71800/0x22c73c7857bb5193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb518c expref: -99 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.618080:0:91052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71800/0x22c73c7857bb5193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb518c expref: 12 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.618088:0:91052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71800/0x22c73c7857bb5193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb518c expref: 12 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.618096:0:91052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71800, rc 0) 00000100:00100000:3.0:1783952064.618137:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465488768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.618213:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783952064.618337:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465488768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952064.618349:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb518c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5193 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.618357:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb518c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5193 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952064.618416:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465488896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.618455:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.618482:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141359180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952064.618534:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465488896 00000100:00100000:2.0:1783952064.618538:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465488896 00000100:00100000:2.0:1783952064.618571:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783952064.618578:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465488896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952064.618745:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465488896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952064.618752:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783952064.618867:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465488896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.618895:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.618938:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.618966:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b141359180 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.619016:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465489024 00000100:00100000:3.0:1783952064.619020:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465489024 00000100:00100000:3.0:1783952064.619049:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783952064.619056:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465489024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.619222:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465489024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.619229:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783952064.619410:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783952064.623949:0:91128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783952064.624169:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783952064.624194:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783952064.624206:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb518c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5193 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.624217:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb518c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5193 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952064.624226:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783952064.624229:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b151231000 from 116 10000000:01000000:3.0:1783952064.624232:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783952064.624271:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb519a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.624279:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb519a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.624290:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb519a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952064.624314:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.624384:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952064.624431:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1525de600 going to sleep for 11 seconds 00000100:00100000:1.0:1783952064.624563:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465489152 00000100:00100000:1.0:1783952064.624572:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465489152 00000100:00100000:1.0:1783952064.624654:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783952064.624663:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465489152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952064.624678:0:91051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952064.624692:0:91051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140030200/0x22c73c7857bb51a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb519a expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.624740:0:91051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140030200/0x22c73c7857bb51a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb519a expref: 13 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.624752:0:91051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140030200/0x22c73c7857bb51a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb519a expref: 13 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.624763:0:91051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030200, rc 0) 00000100:00100000:1.0:1783952064.624812:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465489152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952064.624818:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783952064.625000:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952064.625016:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb519a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.625024:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb519a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb51a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952064.625090:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.625125:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952064.625165:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1525de600 going to sleep for 11 seconds 00000100:00100000:1.0:1783952064.625397:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465489280 00000100:00100000:1.0:1783952064.625402:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465489280 00000100:00100000:1.0:1783952064.625446:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783952064.625454:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465489280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783952064.625472:0:91049:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783952064.625491:0:91049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783952064.625495:0:91049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1783952064.625497:0:91049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1783952064.625500:0:91049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1783952064.625502:0:91049:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:1.0:1783952064.625581:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465489280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952064.625628:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783952064.625727:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783952064.625803:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783952064.625811:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb519a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.625819:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb519a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952064.625828:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783952064.625830:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1783952064.625832:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783952064.625855:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70000/0x22c73c7857bb51a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.625863:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70000/0x22c73c7857bb51a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.625870:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70000/0x22c73c7857bb51a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952064.625886:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.625933:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952064.625964:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf480 going to sleep for 11 seconds 00000100:00100000:1.0:1783952064.626045:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465489408 00000100:00100000:1.0:1783952064.626049:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465489408 00000100:00100000:1.0:1783952064.626086:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783952064.626093:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465489408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952064.626111:0:91052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952064.626122:0:91052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140031600/0x22c73c7857bb51af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb51a8 expref: -99 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.626140:0:91052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140031600/0x22c73c7857bb51af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb51a8 expref: 14 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.626159:0:91052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140031600/0x22c73c7857bb51af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb51a8 expref: 14 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.626167:0:91052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031600, rc 0) 00000100:00100000:1.0:1783952064.626198:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465489408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952064.626204:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783952064.628048:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952064.628085:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70000/0x22c73c7857bb51a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.628097:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70000/0x22c73c7857bb51a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb51af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952064.628330:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.628384:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952064.628426:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf480 going to sleep for 11 seconds 00000100:00100000:0.0:1783952064.628670:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465489536 00000100:00100000:0.0:1783952064.628676:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465489536 00000100:00100000:0.0:1783952064.628724:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783952064.628732:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465489536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.628897:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465489536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952064.628904:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783952064.629419:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.629472:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.629580:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952064.629638:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf480 going to sleep for 11 seconds 00000100:00100000:1.0:1783952064.629695:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465489664 00000100:00100000:1.0:1783952064.629701:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465489664 00000100:00100000:1.0:1783952064.629745:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783952064.629753:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465489664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.630649:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465489664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 893us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952064.630659:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783952064.630763:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952064.631581:0:91129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1783952064.631850:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1783952064.631884:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783952064.631895:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70000/0x22c73c7857bb51a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.631905:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70000/0x22c73c7857bb51a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952064.631915:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1783952064.631918:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b151231000 from 1 10000000:01000000:3.0:1783952064.631920:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783952064.631957:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb51b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.631966:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb51b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.631989:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb51b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952064.632011:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.632060:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952064.632094:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783952064.632173:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465489792 00000100:00100000:1.0:1783952064.632180:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465489792 00000100:00100000:1.0:1783952064.632225:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783952064.632234:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465489792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952064.632247:0:91051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952064.632259:0:91051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140030000/0x22c73c7857bb51bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb51b6 expref: -99 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.632293:0:91051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140030000/0x22c73c7857bb51bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb51b6 expref: 15 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.632304:0:91051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140030000/0x22c73c7857bb51bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb51b6 expref: 15 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.632312:0:91051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030000, rc 0) 00000100:00100000:1.0:1783952064.632357:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465489792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952064.632363:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783952064.632521:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952064.632537:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb51b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51bd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.632546:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb51b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb51bd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952064.632560:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783952064.632564:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb51b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51bd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.632570:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb51b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51bd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952064.632577:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783952064.632578:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b151231000 from 7 10000000:01000000:0.0:1783952064.632580:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783952064.632630:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb51c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.632637:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb51c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.632655:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb51c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952064.632670:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.632698:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.632722:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ed84180 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.632776:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465489920 00000100:00100000:3.0:1783952064.632780:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465489920 00000100:00100000:3.0:1783952064.632811:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783952064.632817:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17462b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465489920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952064.632824:0:91057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952064.632832:0:91057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70600/0x22c73c7857bb51cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb51c4 expref: -99 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.632845:0:91057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70600/0x22c73c7857bb51cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb51c4 expref: 16 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.632853:0:91057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70600/0x22c73c7857bb51cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb51c4 expref: 16 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.632860:0:91057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70600, rc 0) 00000100:00100000:3.0:1783952064.632897:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17462b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465489920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.632903:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783952064.632965:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465489920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952064.632976:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb51c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.632983:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb51c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb51cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952064.633031:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.633056:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.633113:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ed84180 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.634537:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465490048 00000100:00100000:3.0:1783952064.634548:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465490048 00000100:00100000:3.0:1783952064.634605:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783952064.634614:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17462a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465490048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.634775:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17462a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465490048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.634784:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783952064.646166:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.646229:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.646306:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.646340:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ed84180 going to sleep for 11 seconds 00000100:00100000:0.0:1783952064.646793:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465490176 00000100:00100000:0.0:1783952064.646801:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465490176 00000100:00100000:0.0:1783952064.646846:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783952064.646855:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17462a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465490176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.646983:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17462a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465490176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952064.646997:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783952064.647052:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952064.658078:0:91131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783952064.658716:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783952064.658744:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783952064.658757:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb51c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.658769:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb51c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952064.658778:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783952064.658780:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b046482800 from 52 10000000:01000000:1.0:1783952064.658784:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783952064.658825:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031400/0x22c73c7857bb51d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.658834:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b140031400/0x22c73c7857bb51d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.658844:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b140031400/0x22c73c7857bb51d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952064.658890:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.658967:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952064.659011:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16134e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.659063:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465490304 00000100:00100000:3.0:1783952064.659070:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465490304 00000100:00100000:3.0:1783952064.659125:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783952064.659157:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465490304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952064.659170:0:91055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952064.659184:0:91055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71c00/0x22c73c7857bb51d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb51d2 expref: -99 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.659210:0:91055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71c00/0x22c73c7857bb51d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb51d2 expref: 17 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.659222:0:91055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71c00/0x22c73c7857bb51d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb51d2 expref: 17 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.659231:0:91055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71c00, rc 0) 00000100:00100000:3.0:1783952064.659281:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465490304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.659288:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783952064.659569:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952064.659615:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b140031400/0x22c73c7857bb51d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51d9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.659626:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b140031400/0x22c73c7857bb51d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb51d9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952064.659685:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.659714:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.659734:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ed84180 going to sleep for 11 seconds 00000100:00100000:1.0:1783952064.659794:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465490432 00000100:00100000:1.0:1783952064.659799:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465490432 00000100:00100000:1.0:1783952064.659839:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783952064.659847:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465490432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.659961:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465490432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952064.659968:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783952064.662400:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.662482:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.662787:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.662835:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ed84180 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.662928:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465490560 00000100:00100000:3.0:1783952064.662936:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465490560 00000100:00100000:3.0:1783952064.662985:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783952064.662995:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465490560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.663112:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465490560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.663130:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783952064.663448:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783952064.684709:0:91132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783952064.685176:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783952064.685207:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783952064.685220:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031400/0x22c73c7857bb51d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51d9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.685231:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140031400/0x22c73c7857bb51d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51d9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952064.685240:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783952064.685242:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1783952064.685245:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783952064.685285:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb51e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.685293:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb51e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.685304:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb51e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952064.685343:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.685407:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952064.685466:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.685930:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465490688 00000100:00100000:3.0:1783952064.685938:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465490688 00000100:00100000:3.0:1783952064.685994:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783952064.686004:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465490688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952064.686019:0:91052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952064.686034:0:91052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71a00/0x22c73c7857bb51e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb51e0 expref: -99 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.686059:0:91052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71a00/0x22c73c7857bb51e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb51e0 expref: 18 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.686069:0:91052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71a00/0x22c73c7857bb51e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb51e0 expref: 18 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.686078:0:91052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71a00, rc 0) 00000100:00100000:3.0:1783952064.686125:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465490688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.686340:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783952064.686477:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952064.686493:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb51e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.686502:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb51e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb51e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952064.686577:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.686630:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952064.686653:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.686829:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465490816 00000100:00100000:3.0:1783952064.686834:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465490816 00000100:00100000:3.0:1783952064.686868:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783952064.686876:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17462b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465490816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.687071:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17462b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465490816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.687078:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783952064.687961:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.688012:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.688065:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952064.688103:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.688331:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465490944 00000100:00100000:3.0:1783952064.688338:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465490944 00000100:00100000:3.0:1783952064.688381:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783952064.688389:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465490944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.689733:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465490944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1338us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.689744:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783952064.693111:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465490944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783952064.704367:0:91134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1783952064.704746:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1783952064.704773:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783952064.704785:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb51e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.704797:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb51e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952064.704821:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783952064.704824:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b046482800 from 7 10000000:01000000:1.0:1783952064.704827:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783952064.704866:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031200/0x22c73c7857bb51ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.704873:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b140031200/0x22c73c7857bb51ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.704883:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b140031200/0x22c73c7857bb51ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952064.704908:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.704977:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952064.705021:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:2.0:1783952064.706354:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465491072 00000100:00100000:2.0:1783952064.706368:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465491072 00000100:00100000:2.0:1783952064.706422:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783952064.706432:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17710a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465491072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952064.706457:0:91057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952064.706476:0:91057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86a400/0x22c73c7857bb51f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb51ee expref: -99 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.706504:0:91057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86a400/0x22c73c7857bb51f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb51ee expref: 19 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.706530:0:91057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86a400/0x22c73c7857bb51f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb51ee expref: 19 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.706539:0:91057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a400, rc 0) 00000100:00100000:2.0:1783952064.706639:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17710a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465491072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952064.706714:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952064.706732:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b140031200/0x22c73c7857bb51ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.706741:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b140031200/0x22c73c7857bb51ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb51f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952064.706832:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.706874:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.706899:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465491200 00000100:00100000:0.0:1783952064.706902:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465491200 00000100:00100000:1.0:1783952064.716702:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ed84f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783952064.718565:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783952064.722334:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783952064.722356:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465491200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.722556:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465491200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (15680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952064.722565:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783952064.725052:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.725126:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.725223:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952064.725273:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952064.725338:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465491328 00000100:00100000:2.0:1783952064.725346:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465491328 00000100:00100000:2.0:1783952064.725406:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783952064.725415:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b176ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465491328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952064.725543:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b176ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465491328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952064.725552:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783952064.725675:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952064.735085:0:91136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783952064.736148:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783952064.736206:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783952064.736220:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031200/0x22c73c7857bb51ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.736231:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140031200/0x22c73c7857bb51ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb51f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952064.736241:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783952064.736244:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174849000 from 52 10000000:01000000:2.0:1783952064.736247:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783952064.736289:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb51fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.736297:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb51fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.736308:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb51fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952064.736353:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952064.736423:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952064.736481:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522af780 going to sleep for 11 seconds 00000100:00100000:0.0:1783952064.737357:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465491456 00000100:00100000:0.0:1783952064.737368:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465491456 00000100:00100000:0.0:1783952064.737424:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783952064.737443:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b176edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465491456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952064.737458:0:91057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952064.737474:0:91057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb51fc expref: -99 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.737500:0:91057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb51fc expref: 20 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.737511:0:91057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb51fc expref: 20 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.737520:0:91057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc600, rc 0) 00000100:00100000:0.0:1783952064.737609:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b176edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465491456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952064.737624:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783952064.737657:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952064.737674:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb51fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5203 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.737684:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb51fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5203 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952064.737755:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952064.737784:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952064.737864:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522af780 going to sleep for 11 seconds 00000100:00100000:0.0:1783952064.738950:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465491584 00000100:00100000:0.0:1783952064.738958:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465491584 00000100:00100000:0.0:1783952064.739010:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783952064.739018:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465491584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.739167:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465491584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952064.739608:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952064.739660:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952064.739708:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952064.739740:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465491712 00000100:00100000:2.0:1783952064.739744:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465491712 00000100:00100000:0.0:1783952064.739799:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783952064.747442:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783952064.747462:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465491712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952064.747657:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465491712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (7947us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952064.747665:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783952064.747733:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522af780 going to sleep for 11 seconds 00000100:00100000:2.0:1783952064.747767:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783952064.760320:0:91137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783952064.761036:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783952064.761069:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783952064.761082:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb51fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5203 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.761101:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb51fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5203 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952064.761110:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783952064.761113:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783952064.761116:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783952064.761176:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd400/0x22c73c7857bb520a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.761184:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbd400/0x22c73c7857bb520a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.761196:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbd400/0x22c73c7857bb520a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952064.761222:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.761297:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952064.761346:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14850c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.762696:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465491840 00000100:00100000:3.0:1783952064.762706:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465491840 00000100:00100000:3.0:1783952064.762763:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783952064.762772:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465491840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952064.762788:0:91057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952064.762803:0:91057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70800/0x22c73c7857bb5211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb520a expref: -99 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.762829:0:91057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70800/0x22c73c7857bb5211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb520a expref: 21 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.762840:0:91057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70800/0x22c73c7857bb5211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb520a expref: 21 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.762849:0:91057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70800, rc 0) 00000100:00100000:3.0:1783952064.762909:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465491840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.762915:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783952064.763087:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952064.763106:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbd400/0x22c73c7857bb520a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5211 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.763115:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbd400/0x22c73c7857bb520a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5211 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952064.763215:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.763246:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952064.763263:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:0.0:1783952064.763453:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465491968 00000100:00100000:0.0:1783952064.763458:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465491968 00000100:00100000:0.0:1783952064.763495:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783952064.763503:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465491968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952064.763662:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465491968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952064.763670:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783952064.764355:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465491968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.764390:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.764431:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952064.764478:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.764521:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465492096 00000100:00100000:3.0:1783952064.764526:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465492096 00000100:00100000:3.0:1783952064.764579:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783952064.764616:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b176d18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465492096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.766076:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b176d18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465492096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1455us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952064.766087:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783952064.766385:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783952064.772468:0:91139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783952064.783803:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783952064.783843:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783952064.783856:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd400/0x22c73c7857bb520a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5211 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.783868:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbd400/0x22c73c7857bb520a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5211 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952064.785149:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783952064.785154:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b174849000 from 7 10000000:01000000:3.0:1783952064.785159:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783952064.785204:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70200/0x22c73c7857bb5218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.785215:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70200/0x22c73c7857bb5218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.785226:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70200/0x22c73c7857bb5218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952064.785252:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.785321:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952064.785364:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434a8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783952064.786769:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465492224 00000100:00100000:0.0:1783952064.786782:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465492224 00000100:00100000:0.0:1783952064.786852:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783952064.786862:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b176d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465492224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952064.786879:0:91049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952064.786897:0:91049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb521f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5218 expref: -99 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.786940:0:91049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb521f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5218 expref: 22 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.786967:0:91049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb521f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5218 expref: 22 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952064.786976:0:91049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd200, rc 0) 00000100:00100000:0.0:1783952064.787067:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b176d18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465492224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952064.787076:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783952064.787581:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952064.787623:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70200/0x22c73c7857bb5218 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb521f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.787633:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70200/0x22c73c7857bb5218 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb521f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952064.787709:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.787744:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952064.787790:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952064.787856:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465492352 00000100:00100000:1.0:1783952064.787861:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465492352 00000100:00100000:1.0:1783952064.787898:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783952064.787906:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aaf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465492352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.788021:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aaf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465492352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952064.788028:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783952064.788097:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.788140:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.788187:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952064.788215:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952064.788356:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465492480 00000100:00100000:1.0:1783952064.788361:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465492480 00000100:00100000:1.0:1783952064.788395:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783952064.788402:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b63ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465492480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952064.788512:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b63ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465492480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952064.788519:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783952064.789379:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783952064.790493:0:91142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783952064.790800:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783952064.790831:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783952064.790842:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70200/0x22c73c7857bb5218 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb521f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.790852:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70200/0x22c73c7857bb5218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb521f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952064.790860:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1783952064.790862:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97b167c90000 from 1 10000000:01000000:3.0:1783952064.790864:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783952064.790903:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb5226 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.790911:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb5226 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.790921:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb5226 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952064.790943:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.790999:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952064.791053:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952064.793324:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465492608 00000100:00100000:1.0:1783952064.793341:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465492608 00000100:00100000:1.0:1783952064.793408:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783952064.793418:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b63dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465492608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952064.793446:0:91052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952064.793467:0:91052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140030400/0x22c73c7857bb522d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5226 expref: -99 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.793496:0:91052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140030400/0x22c73c7857bb522d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5226 expref: 23 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.793507:0:91052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140030400/0x22c73c7857bb522d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5226 expref: 23 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.793515:0:91052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030400, rc 0) 00000100:00100000:1.0:1783952064.793583:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b63dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465492608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952064.793609:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783952064.794375:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952064.794397:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb5226 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb522d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.794407:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb5226 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb522d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952064.794429:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783952064.794444:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb5226 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb522d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.794451:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb5226 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb522d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952064.794459:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783952064.794461:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97b167c90000 from 1 10000000:01000000:3.0:1783952064.794464:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783952064.794491:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb5234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.794498:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb5234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952064.794507:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb5234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952064.794527:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.794624:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952064.794659:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465492736 00000100:00100000:2.0:1783952064.794665:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465492736 00000100:00100000:2.0:1783952064.794707:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783952064.794715:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465492736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952064.794727:0:91055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952064.794739:0:91055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86b600/0x22c73c7857bb523b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5234 expref: -99 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.794757:0:91055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86b600/0x22c73c7857bb523b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5234 expref: 24 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.794766:0:91055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86b600/0x22c73c7857bb523b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5234 expref: 24 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.794773:0:91055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86b600, rc 0) 00000100:00100000:2.0:1783952064.794804:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465492736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952064.794810:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783952064.794847:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783952064.794859:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952064.794869:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb5234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb523b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952064.794876:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb5234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb523b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952064.794963:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952064.794990:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952064.795011:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c7f180 going to sleep for 11 seconds 00000100:00100000:3.0:1783952064.796032:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465492864 00000100:00100000:3.0:1783952064.796048:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465492864 00000100:00100000:3.0:1783952064.796099:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783952064.796106:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465492864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952064.796402:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465492864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (1410us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783952064.796410:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783952064.796507:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465492864:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783952064.796704:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783952064.796714:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb5234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb523b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952064.796724:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb5234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb523b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952065.005344:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952065.005390:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952065.005428:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952065.005527:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447734912 00000100:00100000:3.0:1783952065.005546:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447734912 00000100:00100000:3.0:1783952065.005640:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447734784 00000100:00100000:3.0:1783952065.005644:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447734784 00000100:00100000:3.0:1783952065.005672:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2750 00000100:00100000:3.0:1783952065.005682:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447734912:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952065.005762:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447734912:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 81us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952065.005770:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2750 00000100:00100000:3.0:1783952065.005787:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2751 00000100:00100000:3.0:1783952065.005795:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447734784:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952065.005822:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447734784:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952065.005828:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2751 00000100:00080000:0.0:1783952065.006094:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952065.006099:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952065.006463:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447734656 00000100:00100000:2.0:1783952065.006470:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447734656 00000100:00100000:2.0:1783952065.006523:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1261 00000100:00100000:2.0:1783952065.006540:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447734656:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952065.006621:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447734656:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 90us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952065.006628:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1261 00000100:00080000:0.0:1783952065.006787:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952065.007241:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952065.007284:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952065.007355:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447734528 00000100:00100000:3.0:1783952065.007360:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447734528 00000100:00100000:3.0:1783952065.007394:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1269 00000100:00100000:3.0:1783952065.007400:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1870605447734528:12345-192.168.202.48@tcp:38:kworker.0 00010000:00080000:3.0:1783952065.007428:0:67035:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '458183b2-4c6d-478c-9fed-a955779e6611' at ffff97b17484a000, cookie 0x22c73c7857bb50c8 00010000:00080000:3.0:1783952065.007443:0:67035:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp recovering/t111669149704 exp ffff97b17484a000 cur 3779 last 1783952063 00010000:02000400:3.0:1783952065.007463:0:67035:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:2.0:1783952065.009133:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447735040 00000100:00100000:2.0:1783952065.009145:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447735040 00000100:00100000:2.0:1783952065.009198:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 60 00000100:00100000:2.0:1783952065.009205:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dc0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:0+-99:2397:x1870605447735040:12345-192.168.202.48@tcp:250:kworker.0 00010000:00080000:2.0:1783952065.009231:0:91057:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e66faa19-2cbc-412c-8aef-9c55427739f8@192.168.202.48@tcp t0 exp 0000000000000000 cur 3779 last 0 00000020:00000080:2.0:1783952065.009265:0:91057:0:(genops.c:1406:class_connect()) connect: client e66faa19-2cbc-412c-8aef-9c55427739f8, cookie 0x22c73c7857bb5242 00000100:00080000:2.0:1783952065.009407:0:91057:0:(import.c:65:import_set_state_nolock()) ffff97b174b12000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783952065.009492:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dc0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e66faa19-2cbc-412c-8aef-9c55427739f8+5:2397:x1870605447735040:12345-192.168.202.48@tcp:250:kworker.0 Request processed in 285us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952065.009501:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 60 00010000:00080000:3.0:1783952065.021789:0:67035:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1783952065.021822:0:67035:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783952065.022055:0:67035:0:(import.c:65:import_set_state_nolock()) ffff97b176bca000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952065.022627:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447734528:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 15223us (15384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952065.022639:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1269 00000100:00100000:0.0:1783952065.028384:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952065.028490:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447725056 00000100:00100000:2.0:1783952065.028502:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447725056 00000100:00100000:2.0:1783952065.028576:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1270 00000100:00100000:2.0:1783952065.028627:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447725056:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00080000:2.0:1783952065.028665:0:66236:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149704, current: 111669149704, replaying 00000100:00100000:2.0:1783952065.028678:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447725056:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 93us (303us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952065.028685:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1270 00010000:00080000:1.0:1783952065.028753:0:91079:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:1.0:1783952065.058765:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952066.083285:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952066.148841:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783952066.148865:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465492992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952066.148970:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952066.149034:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465492992 00000100:00100000:1.0:1783952066.149042:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465492992 00000100:00100000:1.0:1783952066.149134:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:1.0:1783952066.149143:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465492992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952066.149174:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952066.149685:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465492992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 542us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952066.149694:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00080000:1.0:1783952066.149717:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952066.149806:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465492992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952066.155374:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465493120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952066.155465:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952066.155718:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465493120 00000100:00100000:2.0:1783952066.155727:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465493120 00000100:00100000:2.0:1783952066.155813:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:2.0:1783952066.155823:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465493120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952066.155858:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783952066.155970:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952066.156070:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465493120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 249us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952066.156078:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:3.0:1783952066.156239:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465493120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952066.926864:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952066.927004:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447735168 00000100:00100000:0.0:1783952066.927014:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447735168 00000100:00100000:0.0:1783952066.927091:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:0.0:1783952066.927103:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+5:42446:x1870605447735168:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952066.927126:0:91052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952066.927149:0:91052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbca00/0x22c73c7857bb5249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2c8 expref: -99 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952066.927181:0:91052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbca00/0x22c73c7857bb5249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2c8 expref: 6 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952066.927214:0:91052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbca00/0x22c73c7857bb5249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2c8 expref: 6 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952066.927223:0:91052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbca00, rc 0) 00000100:00100000:0.0:1783952066.927278:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447735168:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 178us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952066.927286:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:0.0:1783952066.951385:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952066.951551:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447735296 00000100:00100000:1.0:1783952066.951563:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447735296 00000100:00100000:1.0:1783952066.951647:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:1.0:1783952066.951658:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dc08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447735296:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783952066.951686:0:91051:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1783952066.951711:0:91051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783952066.951715:0:91051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1783952066.951718:0:91051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1783952066.951720:0:91051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1783952066.951722:0:91051:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:3.0:1783952066.954528:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dc08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447735296:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 Request processed in 2859us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952066.954542:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:1.0:1783952066.964156:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952066.964296:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447735424 00000100:00100000:3.0:1783952066.964307:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447735424 00000100:00100000:3.0:1783952066.964367:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:3.0:1783952066.964379:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+6:42446:x1870605447735424:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952066.964398:0:91055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952066.964434:0:91055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb5250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2cf expref: -99 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952066.964467:0:91055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb5250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2cf expref: 7 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952066.964495:0:91055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb5250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2cf expref: 7 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952066.964505:0:91055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71e00, rc 0) 00000100:00100000:3.0:1783952066.964564:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+7:42446:x1870605447735424:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 188us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952066.964570:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:3.0:1783952066.971572:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952066.971697:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447735552 00000100:00100000:1.0:1783952066.971707:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447735552 00000100:00100000:1.0:1783952066.971759:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:1.0:1783952066.971769:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0459b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+7:42446:x1870605447735552:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952066.971938:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0459b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447735552:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 170us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952066.971945:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:3.0:1783952066.979853:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952066.980020:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447735680 00000100:00100000:1.0:1783952066.980031:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447735680 00000100:00100000:1.0:1783952066.980089:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:1.0:1783952066.980098:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447735680:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952066.980250:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447735680:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 152us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952066.980258:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:1.0:1783952066.999106:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952067.003336:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447735808 00000100:00100000:0.0:1783952067.003353:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447735808 00000100:00100000:0.0:1783952067.003438:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:0.0:1783952067.003451:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+8:42446:x1870605447735808:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952067.003471:0:91052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952067.003492:0:91052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb5257 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2d6 expref: -99 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952067.003537:0:91052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb5257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2d6 expref: 9 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952067.003549:0:91052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb5257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2d6 expref: 9 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952067.003558:0:91052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc000, rc 0) 00000100:00100000:0.0:1783952067.003655:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447735808:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 207us (4558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952067.003674:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:2.0:1783952067.014217:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952067.014290:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447735936 00000100:00100000:3.0:1783952067.014300:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447735936 00000100:00100000:3.0:1783952067.014357:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:3.0:1783952067.014367:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447735936:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952067.014675:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447735936:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 309us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952067.014683:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:2.0:1783952067.016989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952067.017205:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447736064 00000100:00100000:3.0:1783952067.017214:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447736064 00000100:00100000:3.0:1783952067.017253:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:3.0:1783952067.017259:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447736064:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952067.017364:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447736064:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 105us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952067.017369:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:0.0:1783952067.028467:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952067.029372:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447736192 00000100:00100000:3.0:1783952067.029399:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447736192 00000100:00100000:2.0:1783952067.029944:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:2.0:1783952067.029955:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+9:42446:x1870605447736192:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952067.029986:0:91049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952067.030009:0:91049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb525e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2dd expref: -99 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952067.030042:0:91049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb525e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2dd expref: 10 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952067.030054:0:91049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb525e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2dd expref: 10 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952067.030064:0:91049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86b400, rc 0) 00000100:00100000:2.0:1783952067.030149:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447736192:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 195us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952067.030156:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:2.0:1783952067.036508:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952067.036657:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447736320 00000100:00100000:3.0:1783952067.036668:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447736320 00000100:00100000:3.0:1783952067.036722:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:3.0:1783952067.036732:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447736320:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952067.036876:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:42446:x1870605447736320:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 119us (351us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783952067.036884:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 70 00010000:00010000:2.0:1783952067.110403:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.129905:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783952068.462472:0:91330:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783952068.706909:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465493248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952068.706979:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952068.707035:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465493248 00000100:00100000:1.0:1783952068.707042:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465493248 00000100:00100000:1.0:1783952068.707087:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:1.0:1783952068.707095:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465493248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783952068.707131:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:1.0:1783952068.707177:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465493248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952068.707184:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:1.0:1783952068.707230:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465493248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783952068.711869:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1783952068.711892:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952068.711897:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952068.711901:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952068.711908:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3778 00000100:00080000:0.0:1783952068.711912:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952068.711919:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952068.711946:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b048dfaa00 x1870605465493504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952068.712375:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465493632:0@lo:400:kworker.0 00000100:00100000:2.0:1783952068.712459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952068.712504:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465493376:0@lo:400:kworker.0 00000100:00100000:2.0:1783952068.712535:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952068.712644:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465493632 00000100:00100000:2.0:1783952068.712658:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465493632 00000100:00100000:2.0:1783952068.712712:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1783952068.712722:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465493632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952068.712778:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465493632:12345-0@lo:400:kworker.0 Request processed in 58us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952068.712785:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1783952068.712831:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465493632:0@lo:400:kworker.0 00000100:00080000:0.0:1783952068.712938:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952068.712943:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952068.712946:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952068.712951:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3778 00000100:00080000:0.0:1783952068.712954:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952068.712958:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952068.712975:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b048df8000 x1870605465493760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952068.713328:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465493888:0@lo:400:kworker.0 00000100:00100000:2.0:1783952068.713357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783952068.713408:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952068.713413:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952068.713415:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952068.713419:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3778 00000100:00080000:0.0:1783952068.713422:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952068.713427:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952068.713443:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049e5ad80 x1870605465494016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952068.713508:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952068.713515:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465494144:0@lo:400:kworker.0 00000100:00100000:1.0:1783952068.713529:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465493504:0@lo:38:kworker.0 00000100:00100000:2.0:1783952068.713543:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952068.713566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952068.713605:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465493888 00000100:00100000:1.0:1783952068.713608:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465493760:0@lo:38:kworker.0 00000100:00100000:2.0:1783952068.713615:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465493888 00000100:00100000:1.0:1783952068.713630:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783952068.713691:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952068.713694:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952068.713696:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952068.713699:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3778 00000100:00080000:0.0:1783952068.713702:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952068.713705:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952068.713719:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14f0d4700 x1870605465494400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952068.713742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783952068.713745:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952068.713747:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b144764000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952068.713751:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b144764000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952068.713761:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de95500 x1870605465494784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952068.713810:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465493504 00000100:00100000:1.0:1783952068.713810:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465494016:0@lo:38:kworker.0 00000100:00100000:2.0:1783952068.713813:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465493504 00000100:00100000:2.0:1783952068.713829:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465493760 00000100:00100000:2.0:1783952068.713832:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465493760 00000100:00100000:1.0:1783952068.713838:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952068.713845:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1783952068.713852:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465493888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952068.713856:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465494400:0@lo:38:kworker.0 00000100:00100000:1.0:1783952068.713878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952068.713886:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465493888:12345-0@lo:400:kworker.0 Request processed in 35us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952068.713888:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465494784:0@lo:38:kworker.0 00000100:00100000:2.0:1783952068.713893:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1783952068.713906:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465494400 00000100:00100000:1.0:1783952068.713906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952068.713909:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465494400 00000100:00100000:2.0:1783952068.713917:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465494784 00000100:00100000:2.0:1783952068.713919:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465494784 00000100:00080000:1.0:1783952068.713924:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952068.713928:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:2.0:1783952068.713933:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465493504:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783952068.713936:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465494144 00000100:00100000:1.0:1783952068.713938:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465494144 00010000:00080000:2.0:1783952068.713956:0:67035:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3783 last 0 00000100:00100000:1.0:1783952068.713970:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752 00000100:00100000:1.0:1783952068.713976:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465494144:12345-0@lo:400:kworker.0 00000020:00000080:2.0:1783952068.713989:0:67035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x22c73c7857bb5265 00000004:00100000:2.0:1783952068.714004:0:67035:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1783952068.714006:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465494144:12345-0@lo:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952068.714011:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752 00000100:00100000:1.0:1783952068.714031:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1783952068.714036:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465493760:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783952068.714049:0:66236:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3783 last 0 00000020:00000080:1.0:1783952068.714070:0:66236:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x22c73c7857bb526c 00000004:00100000:1.0:1783952068.714076:0:66236:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783952068.714101:0:66236:0:(import.c:65:import_set_state_nolock()) ffff97b144764800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952068.714138:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870605465493760:12345-0@lo:38:kworker.0 Request processed in 100us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952068.714153:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1783952068.714219:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1783952068.714223:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465494400:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783952068.714237:0:66236:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3783 last 0 00000020:00000080:1.0:1783952068.714256:0:66236:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x22c73c7857bb5273 00000004:00100000:1.0:1783952068.714263:0:66236:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783952068.714278:0:66236:0:(import.c:65:import_set_state_nolock()) ffff97b144760000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783952068.714278:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1783952068.714283:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465494784:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783952068.714297:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3783 last 0 00000100:00100000:1.0:1783952068.714305:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870605465494400:12345-0@lo:38:kworker.0 Request processed in 81us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952068.714311:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000020:00000080:0.0:1783952068.714320:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x22c73c7857bb527a 00000004:00100000:0.0:1783952068.714326:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1783952068.714329:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465494016 00000100:00100000:1.0:1783952068.714332:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465494016 00000100:00080000:0.0:1783952068.714341:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b164ceb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952068.714352:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:1.0:1783952068.714356:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465494016:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783952068.714369:0:23862:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff97b17704d000, cookie 0x22c73c7857bb50cf 00000100:00100000:0.0:1783952068.714371:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465494784:12345-0@lo:38:kworker.0 Request processed in 86us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952068.714376:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00010000:00080000:1.0:1783952068.714387:0:23862:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378653 exp ffff97b17704d000 cur 3783 last 1783952063 00000004:00100000:1.0:1783952068.714406:0:23862:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1783952068.714417:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465494656:0@lo:400:kworker.0 00000100:00080000:1.0:1783952068.714421:0:23862:0:(import.c:65:import_set_state_nolock()) ffff97b144763800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783952068.714444:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952068.714450:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465494016:12345-0@lo:38:kworker.0 Request processed in 93us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952068.714457:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:0.0:1783952068.714472:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465494144:0@lo:400:kworker.0 00000100:00100000:1.0:1783952068.714476:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465494656 00000100:00100000:1.0:1783952068.714479:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465494656 00000100:00100000:0.0:1783952068.714483:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465493888:0@lo:400:kworker.0 00000100:00100000:1.0:1783952068.714503:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:0.0:1783952068.714507:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465494528:0@lo:400:kworker.0 00000100:00100000:1.0:1783952068.714509:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465494656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952068.714530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952068.714544:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465494656:12345-0@lo:400:kworker.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952068.714549:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952068.714550:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:0.0:1783952068.714553:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465494272:0@lo:400:kworker.0 00000100:00100000:1.0:1783952068.714559:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465494528 00000100:00100000:1.0:1783952068.714562:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465494528 00000100:00100000:0.0:1783952068.714575:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783952068.714729:0:67035:0:(import.c:65:import_set_state_nolock()) ffff97b15036a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783952068.714760:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870605465493504:12345-0@lo:38:kworker.0 Request processed in 825us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952068.714767:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1783952068.715185:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465493376 00000100:00100000:3.0:1783952068.715191:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465493376 00000100:00100000:3.0:1783952068.715220:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783952068.715227:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04982e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465493376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952068.715267:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04982e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465493376:12345-0@lo:400:kworker.0 Request processed in 41us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952068.715273:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783952068.716335:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465494272 00000100:00100000:1.0:1783952068.716343:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465494272 00000100:00100000:0.0:1783952068.716350:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:0.0:1783952068.716361:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465494528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952068.716394:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:1.0:1783952068.716409:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465494272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952068.716447:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465494272:12345-0@lo:400:kworker.0 Request processed in 39us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952068.716452:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00010000:00080000:1.0:1783952068.716477:0:91079:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783952068.716482:0:91079:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 111669149704 00000020:00080000:1.0:1783952068.716487:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783952068.716490:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 111669149704, next_transno: 111669149704 00010000:00080000:1.0:1783952068.716505:0:91079:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149704) 00000020:00080000:1.0:1783952068.716508:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783952068.716518:0:91079:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447725056 t111669149704 from 192.168.202.48@tcp req@ffff97b164e3f100 x1870605447725056/t0(111669149704) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:326/0 lens 528/0 e 0 to 0 dl 1783952076 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952068.716626:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952068.716631:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952068.716667:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465494656:0@lo:400:kworker.0 00010000:00080000:1.0:1783952068.716709:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b14f0d4700 x1870605465494400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952068.716722:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00000100:00080000:1.0:1783952068.717482:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff97b14f0d4700 x1870605465494400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952093 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952068.717492:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783952068.717497:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783952068.717500:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783952068.717504:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465494400:0@lo:38:kworker.0 00010000:00080000:1.0:1783952068.717523:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b14de95500 x1870605465494784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952068.717533:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:1.0:1783952068.717538:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783952068.717541:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783952068.717543:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b144764000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783952068.717547:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465494784:0@lo:38:kworker.0 00010000:00080000:1.0:1783952068.717560:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b048dfaa00 x1870605465493504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952068.717568:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00100000:0.0:1783952068.717715:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465494528:12345-0@lo:400:kworker.0 Request processed in 1355us (3182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952068.717724:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:0.0:1783952068.717783:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465494272:0@lo:400:kworker.0 00000100:00100000:0.0:1783952068.717796:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465494528:0@lo:400:kworker.0 00000100:00100000:0.0:1783952068.717807:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465493376:0@lo:400:kworker.0 00000100:00080000:1.0:1783952068.718351:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff97b048dfaa00 x1870605465493504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952093 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952068.718358:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783952068.718362:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783952068.718365:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783952068.718368:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465493504:0@lo:38:kworker.0 00010000:00080000:1.0:1783952068.718384:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b048df8000 x1870605465493760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952068.727851:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00080000:1.0:1783952068.729051:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff97b048df8000 x1870605465493760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952093 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952068.729064:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1783952068.729069:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783952068.729073:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783952068.729080:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465493760:0@lo:38:kworker.0 00000100:00080000:1.0:1783952068.730880:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:1.0:1783952068.730898:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1783952068.730903:0:3641:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1783952068.730905:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:1.0:1783952068.730910:0:3641:0:(recover.c:53:ptlrpc_replay_next()) import ffff97b048caf800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:1.0:1783952068.730913:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000004:00080000:1.0:1783952068.730941:0:91079:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 14371us 00000100:00100000:3.0:1783952068.731149:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465494016:0@lo:38:kworker.0 00010000:00080000:3.0:1783952068.731198:0:91346:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1783952068.731203:0:91346:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1783952068.731208:0:91346:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1783952068.734477:0:91346:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1783952068.734938:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465494912:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1783952068.735010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952068.737228:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465494912 00000100:00100000:1.0:1783952068.737243:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465494912 00000100:00100000:1.0:1783952068.737363:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:1.0:1783952068.737374:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465494912:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1783952068.737408:0:8445:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b049af6a00 x1870605465494912/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:329/0 lens 224/0 e 0 to 0 dl 1783952079 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952068.737421:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465494912:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 51us (2413us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952068.737427:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00010000:00010000:1.0:1783952068.743865:0:91079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb5281 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.743892:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb5281 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.743906:0:91079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb5281 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.743918:0:91079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.743925:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.743931:0:91079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.744826:0:91079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb5281 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.744837:0:91079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb5281 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.744843:0:91079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb5281 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.744849:0:91079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952068.744853:0:91079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb5281 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.744860:0:91079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb5281 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.744873:0:91079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531c800) 00010000:00010000:1.0:1783952068.744883:0:91079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952068.744888:0:91079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb5281 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.744895:0:91079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb5281 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952068.744911:0:91079:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e0b7c57 reply state 0000000062d6c2ba transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.744922:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.744928:0:91079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b14531c900) 00010000:00010000:1.0:1783952068.744930:0:91079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952068.744934:0:91079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1783952068.745051:0:91079:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1783952068.745073:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783952068.745077:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000020:00080000:1.0:1783952068.745081:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783952068.745083:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000100:00100000:3.0:1783952068.748569:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952068.748617:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447725568 00000100:00100000:3.0:1783952068.748626:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447725568 00000100:00100000:3.0:1783952068.748682:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1275 00000100:00100000:3.0:1783952068.748693:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447725568:12345-192.168.202.48@tcp:36:rm.0 00010000:00080000:3.0:1783952068.748714:0:66236:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149705, current: 111669149705, replaying 00000100:00100000:3.0:1783952068.748746:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447725568:12345-192.168.202.48@tcp:36:rm.0 Request processed in 55us (185us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952068.748752:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1275 00000020:00080000:3.0:1783952068.748774:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952068.748778:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149705, next_transno: 111669149705 00010000:00080000:3.0:1783952068.748782:0:91079:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149705) 00000020:00080000:3.0:1783952068.748786:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952068.748794:0:91079:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447725568 t111669149705 from 192.168.202.48@tcp req@ffff97b048dfaa00 x1870605447725568/t0(111669149705) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:329/0 lens 512/0 e 0 to 0 dl 1783952079 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783952068.748880:0:91079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb528f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.748896:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb528f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.748909:0:91079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb528f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.748920:0:91079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.748927:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.748934:0:91079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.749013:0:91079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb529d lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.749021:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb529d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.749032:0:91079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb529d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751023:0:91079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb529d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751037:0:91079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb529d lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751046:0:91079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb529d lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751052:0:91079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952068.751057:0:91079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb529d lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751077:0:91079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb529d lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751092:0:91079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff97b04d805500) 00000001:00080000:3.0:1783952068.751343:0:91045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149704 is committed 00010000:00010000:3.0:1783952068.751377:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.751385:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.751391:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.751408:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499ce00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952068.751411:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.751418:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.751428:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b14531c900) 00010000:00010000:3.0:1783952068.751431:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952068.751435:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.751441:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499ce00/0x22c73c7857bb5288 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751490:0:91079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783952068.751494:0:91079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb529d lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751575:0:91079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb529d lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751629:0:91079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb528f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751636:0:91079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb528f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751641:0:91079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb528f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751646:0:91079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952068.751650:0:91079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb528f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751656:0:91079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb528f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751664:0:91079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b04d805600) 00010000:00010000:1.0:1783952068.751667:0:91079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952068.751670:0:91079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb528f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751687:0:91079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb528f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952068.751702:0:91079:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e72e77a2 reply state 0000000057631cd4 transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751715:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.751722:0:91079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b14531c900) 00010000:00010000:1.0:1783952068.751724:0:91079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952068.751727:0:91079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1783952068.751819:0:91079:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783952068.751837:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783952068.751840:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000020:00080000:1.0:1783952068.751844:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783952068.751846:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000100:00100000:3.0:1783952068.758673:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952068.758970:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447726976 00000100:00100000:3.0:1783952068.758984:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447726976 00000100:00100000:3.0:1783952068.759035:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1276 00000100:00100000:3.0:1783952068.759046:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447726976:12345-192.168.202.48@tcp:36:dd.0 00010000:00080000:3.0:1783952068.759065:0:66237:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149706, current: 111669149708, replaying 00000100:00100000:3.0:1783952068.759080:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447726976:12345-192.168.202.48@tcp:36:dd.0 Request processed in 36us (414us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952068.759086:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1276 00000020:00080000:3.0:1783952068.759105:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952068.759110:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149708, next_transno: 111669149706 00010000:00080000:3.0:1783952068.759115:0:91079:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 111669149706, ql: 1, comp: 1, conn: 2, next: 111669149708, next_update 0 last_committed: 111669149704) 00000020:00080000:3.0:1783952068.759120:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952068.759130:0:91079:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447726976 t111669149708 from 192.168.202.48@tcp req@ffff97b1447b0000 x1870605447726976/t0(111669149708) o36->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:329/0 lens 488/0 e 0 to 0 dl 1783952079 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783952068.761756:0:91079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.761777:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.761788:0:91079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783952068.761848:0:91079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149708 00000004:00010000:3.0:1783952068.761873:0:91079:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f19063e reply state 000000009f9ec6cd transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.761886:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.761905:0:91079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d805e00) 00010000:00010000:3.0:1783952068.761908:0:91079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952068.761913:0:91079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783952068.762048:0:91079:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783952068.762060:0:91079:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:3.0:1783952068.762074:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952068.762077:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000020:00080000:3.0:1783952068.762082:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952068.762084:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000100:00100000:3.0:1783952068.774025:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952068.774059:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447727360 00000100:00100000:3.0:1783952068.774070:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447727360 00000100:00100000:3.0:1783952068.774621:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1277 00000100:00100000:3.0:1783952068.774633:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+11:2397:x1870605447727360:12345-192.168.202.48@tcp:101:dd.0 00010000:00080000:3.0:1783952068.774653:0:68591:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 111669149709, current: 111669149709, replaying 00000100:00100000:3.0:1783952068.774665:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+11:2397:x1870605447727360:12345-192.168.202.48@tcp:101:dd.0 Request processed in 36us (648us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952068.774672:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1277 00000020:00080000:3.0:1783952068.774849:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952068.774854:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149709, next_transno: 111669149709 00010000:00080000:3.0:1783952068.774859:0:91079:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (111669149709) 00000020:00080000:3.0:1783952068.774861:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952068.774870:0:91079:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447727360 t111669149709 from 192.168.202.48@tcp req@ffff97b16dd78a80 x1870605447727360/t0(111669149709) o101->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:329/0 lens 640/0 e 0 to 0 dl 1783952079 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1783952068.774892:0:91079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952068.774913:0:91079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb52ab lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a297 expref: -99 pid: 91079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.774973:0:91079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb52b2 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.774987:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb52b2 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.774998:0:91079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb52b2 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783952068.776230:0:91079:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x47d:0x0], count =677 00000004:00080000:3.0:1783952068.776238:0:91079:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x47d:0x0]+677 in llog 00000004:00080000:3.0:1783952068.776272:0:91079:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x722:0x0], index 1: 0 00000004:00080000:3.0:1783952068.776277:0:91079:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x723:0x0], index 0: 0 00010000:00010000:3.0:1783952068.776372:0:91079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb52b2 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a297 expref: 14 pid: 91079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.776384:0:91079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d805e00) 00010000:00010000:3.0:1783952068.776387:0:91079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1783952068.776413:0:91079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb52ab lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a297 expref: 14 pid: 91079 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.776428:0:91079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb52b2 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a297 expref: 13 pid: 91079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.776463:0:91079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d805e00) 00010000:00010000:3.0:1783952068.776466:0:91079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1783952068.776468:0:91079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22a00, rc 0) 00010000:00080000:3.0:1783952068.777075:0:91079:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783952068.777115:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952068.777118:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000020:00080000:3.0:1783952068.777123:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952068.777124:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000100:00100000:2.0:1783952068.794767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952068.800049:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447736448 00000100:00100000:3.0:1783952068.800064:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447736448 00000100:00100000:3.0:1783952068.800148:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1264 00000100:00100000:3.0:1783952068.800160:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+13:2397:x1870605447736448:12345-192.168.202.48@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1783952068.800187:0:66236:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b049e77b80 x1870605447736448/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:329/0 lens 224/0 e 0 to 0 dl 1783952079 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952068.800214:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+13:2397:x1870605447736448:12345-192.168.202.48@tcp:400:ldlm_lock_repla.0 Request processed in 57us (5457us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952068.800221:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1264 00000020:00080000:0.0:1783952068.800242:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783952068.800247:0:91079:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149710 00010000:00080000:0.0:1783952068.800251:0:91079:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1783952068.800253:0:91079:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783952068.800261:0:91079:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1783952068.800264:0:91079:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1783952068.800381:0:91079:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000001:00100000:3.0:1783952068.806068:0:91045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00100000:3.0:1783952068.806077:0:91045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1783952068.806104:0:91045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149709 is committed 00010000:00010000:3.0:1783952068.806145:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806156:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806163:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806169:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952068.806174:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806186:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806203:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806210:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5296 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806232:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806238:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806244:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806249:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952068.806251:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806256:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806262:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.806267:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb52a4 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91079 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783952068.806308:0:91079:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783952068.806347:0:91079:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783952068.806360:0:91079:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff97b049af6a00 x1870605465494912/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:329/0 lens 224/0 e 0 to 0 dl 1783952079 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783952068.806479:0:91079:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.48@tcp: req@ffff97b049e77b80 x1870605447736448/t0(0) o400->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:329/0 lens 224/0 e 0 to 0 dl 1783952079 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783952068.806530:0:91079:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1783952068.814815:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1783952068.814832:0:3641:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff97b048df8000 x1870605465494912/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952084 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952068.814843:0:3641:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff97b048df8000 x1870605465494912/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952084 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952068.814849:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783952068.814862:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783952068.814868:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465494912:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783952068.814970:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465495040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952068.815032:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952068.815076:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465495040 00000100:00100000:0.0:1783952068.815081:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465495040 00000100:00100000:0.0:1783952068.815124:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1783952068.815133:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465495040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783952068.815165:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:0.0:1783952068.815210:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465495040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952068.815216:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1783952068.815252:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465495040:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1783952068.835578:0:91079:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa80a486b3e10 00100000:10000000:0.0:1783952068.835612:0:91079:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1783952068.843172:0:91067:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x722:0x0] 00000100:00100000:2.0:1783952068.843225:0:91067:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91067:1870605465495168:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783952068.843311:0:91067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952068.843342:0:91067:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04855e300 going to sleep for 11 seconds 00000100:00100000:2.0:1783952068.843369:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465495168 00000100:00100000:2.0:1783952068.843375:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465495168 00000100:00100000:2.0:1783952068.843433:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4929 00000100:00100000:2.0:1783952068.843443:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:91067:x1870605465495168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783952068.843472:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -31 00002000:02000040:2.0:1783952068.843476:0:8436:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1827 to 0x2c0000401:1857) 00000004:00080000:1.0:1783952068.844168:0:91065:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x723:0x0] 00000100:00100000:1.0:1783952068.844196:0:91065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91065:1870605465495296:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783952068.844238:0:91065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952068.844259:0:91065:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b177815780 going to sleep for 11 seconds 00000100:00100000:1.0:1783952068.844278:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465495296 00000100:00100000:1.0:1783952068.844282:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465495296 00000100:00100000:1.0:1783952068.844357:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4930 00000100:00100000:1.0:1783952068.844366:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:91065:x1870605465495296:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783952068.844385:0:26200:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -30 00002000:02000040:1.0:1783952068.844388:0:26200:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1828 to 0x280000401:1857) 00002000:00010000:2.0:1783952068.854857:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.854870:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb52b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.854888:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.854893:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.854900:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb52b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.854915:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb52b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.854925:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb52b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.854932:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb52b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.855432:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783952068.856036:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.856043:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb52c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.856053:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.856056:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.856060:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb52c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.856071:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb52c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.856079:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb52c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.856086:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb52c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.859780:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952068.859794:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb52b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.859807:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952068.859812:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb52b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.859823:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb52b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.859844:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb52b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.859850:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cdcbc25/0x22c73c7857bb52b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.859871:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952068.859882:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb52c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.859888:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952068.859891:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb52c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.859899:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb52c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.859907:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb52c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.859914:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.859916:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.859917:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.860873:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783952068.860882:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008486381d/0x22c73c7857bb52c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952068.861150:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.861157:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb52c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.861170:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.861179:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.861186:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb52c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.861199:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb52c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.861209:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb52c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.861217:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb52c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.862222:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952068.862231:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb52c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.862242:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ae00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952068.862247:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb52c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.862258:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb52c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.862276:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb52c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.862297:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.862299:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.862301:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.862710:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.862718:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054172b4c/0x22c73c7857bb52ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.862730:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.862734:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.862740:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054172b4c/0x22c73c7857bb52ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.862751:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054172b4c/0x22c73c7857bb52ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.862759:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054172b4c/0x22c73c7857bb52ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.862766:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054172b4c/0x22c73c7857bb52ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.862785:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.862794:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.862798:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054172b4c/0x22c73c7857bb52ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.862805:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499cc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.862808:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054172b4c/0x22c73c7857bb52ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.862829:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054172b4c/0x22c73c7857bb52ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.862840:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054172b4c/0x22c73c7857bb52ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.862847:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054172b4c/0x22c73c7857bb52ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.862863:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.862865:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.862866:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783952068.864169:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1783952068.864209:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.864217:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baa43b5f/0x22c73c7857bb52d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864230:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.864234:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.864239:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baa43b5f/0x22c73c7857bb52d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864250:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baa43b5f/0x22c73c7857bb52d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864271:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baa43b5f/0x22c73c7857bb52d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864279:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baa43b5f/0x22c73c7857bb52d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864296:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.864305:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.864309:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baa43b5f/0x22c73c7857bb52d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864317:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.864321:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baa43b5f/0x22c73c7857bb52d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864330:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baa43b5f/0x22c73c7857bb52d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864342:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baa43b5f/0x22c73c7857bb52d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864349:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baa43b5f/0x22c73c7857bb52d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864364:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.864371:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.864373:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.864451:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.864457:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a944d7bb/0x22c73c7857bb52dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864464:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.864467:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.864471:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a944d7bb/0x22c73c7857bb52dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864479:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a944d7bb/0x22c73c7857bb52dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864486:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a944d7bb/0x22c73c7857bb52dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.864492:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a944d7bb/0x22c73c7857bb52dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.865169:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783952068.865176:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096108b9d/0x22c73c7857bb52c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952068.865286:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.865292:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060554271/0x22c73c7857bb52e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.865301:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.865304:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.865308:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060554271/0x22c73c7857bb52e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.865319:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060554271/0x22c73c7857bb52e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.865334:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060554271/0x22c73c7857bb52e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.865342:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060554271/0x22c73c7857bb52e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.865490:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952068.865505:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a944d7bb/0x22c73c7857bb52dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.865513:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952068.865517:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a944d7bb/0x22c73c7857bb52dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.865526:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a944d7bb/0x22c73c7857bb52dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.865539:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a944d7bb/0x22c73c7857bb52dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.865547:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952068.865551:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060554271/0x22c73c7857bb52e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.865557:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952068.865560:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060554271/0x22c73c7857bb52e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.865579:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060554271/0x22c73c7857bb52e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.865619:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060554271/0x22c73c7857bb52e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.865626:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.865627:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.865629:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.865758:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783952068.865764:0:26200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a944d7bb/0x22c73c7857bb52dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952068.865824:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.865829:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcf9d369/0x22c73c7857bb52ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.865848:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.865851:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.865856:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcf9d369/0x22c73c7857bb52ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.865865:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcf9d369/0x22c73c7857bb52ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.865873:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcf9d369/0x22c73c7857bb52ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.865880:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcf9d369/0x22c73c7857bb52ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.865894:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.865902:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.865906:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcf9d369/0x22c73c7857bb52ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.865913:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.865916:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcf9d369/0x22c73c7857bb52ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.865923:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcf9d369/0x22c73c7857bb52ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.865945:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcf9d369/0x22c73c7857bb52ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.865953:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcf9d369/0x22c73c7857bb52ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.865964:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.865966:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.865968:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.866007:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.866012:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb52f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866020:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.866023:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.866028:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb52f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866036:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb52f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866044:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb52f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866050:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb52f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866073:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.866082:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.866085:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb52f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866091:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.866159:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb52f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866169:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb52f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866180:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb52f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866188:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb52f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866200:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.866201:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.866203:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.866240:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.866245:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb52f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866253:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.866261:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.866265:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb52f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866274:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb52f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866283:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb52f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866290:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb52f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866304:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.866309:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.866313:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb52f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866319:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499da00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.866323:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb52f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866331:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb52f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866341:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb52f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866357:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb52f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866368:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.866370:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.866371:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.866421:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.866426:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc62194c/0x22c73c7857bb52ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866434:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.866438:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.866442:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc62194c/0x22c73c7857bb52ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866451:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc62194c/0x22c73c7857bb52ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866459:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc62194c/0x22c73c7857bb52ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866467:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc62194c/0x22c73c7857bb52ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866478:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.866489:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.866492:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc62194c/0x22c73c7857bb52ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866510:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.866513:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc62194c/0x22c73c7857bb52ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866522:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc62194c/0x22c73c7857bb52ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866532:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc62194c/0x22c73c7857bb52ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866539:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc62194c/0x22c73c7857bb52ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866550:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.866551:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.866553:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.866610:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.866615:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1484712/0x22c73c7857bb5306 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866623:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.866626:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.866630:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1484712/0x22c73c7857bb5306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866651:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1484712/0x22c73c7857bb5306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866659:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1484712/0x22c73c7857bb5306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866665:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1484712/0x22c73c7857bb5306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866678:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.866685:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.866688:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1484712/0x22c73c7857bb5306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866695:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.866698:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1484712/0x22c73c7857bb5306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866706:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1484712/0x22c73c7857bb5306 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866716:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1484712/0x22c73c7857bb5306 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866723:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1484712/0x22c73c7857bb5306 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866743:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.866745:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.866746:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.866788:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.866792:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb530d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866800:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.866803:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.866807:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb530d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866816:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb530d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866824:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb530d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866831:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb530d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866843:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.866848:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.866852:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb530d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866868:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499ca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.866871:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb530d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866878:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb530d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866889:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb530d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866895:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb530d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866907:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.866909:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.866911:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.866950:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.866955:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb5314 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866963:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.866965:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.866969:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb5314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866978:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb5314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866991:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb5314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.866998:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb5314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867009:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.867015:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.867018:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb5314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867024:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.867028:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb5314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867035:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb5314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867046:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb5314 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867053:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb5314 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867066:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.867073:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.867075:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.867243:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.867249:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f0d608f/0x22c73c7857bb531b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867257:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.867260:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.867264:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f0d608f/0x22c73c7857bb531b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867273:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f0d608f/0x22c73c7857bb531b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867281:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f0d608f/0x22c73c7857bb531b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867289:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f0d608f/0x22c73c7857bb531b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867301:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.867306:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.867310:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f0d608f/0x22c73c7857bb531b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867316:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.867320:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0d608f/0x22c73c7857bb531b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867336:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0d608f/0x22c73c7857bb531b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867346:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f0d608f/0x22c73c7857bb531b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867354:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f0d608f/0x22c73c7857bb531b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867366:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.867368:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.867370:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.867416:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.867421:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026aafc91/0x22c73c7857bb5322 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867429:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.867432:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.867436:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026aafc91/0x22c73c7857bb5322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867445:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026aafc91/0x22c73c7857bb5322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867453:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026aafc91/0x22c73c7857bb5322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867465:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026aafc91/0x22c73c7857bb5322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867476:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.867482:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.867486:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026aafc91/0x22c73c7857bb5322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867543:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499ce00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.867548:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026aafc91/0x22c73c7857bb5322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867557:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026aafc91/0x22c73c7857bb5322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867568:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026aafc91/0x22c73c7857bb5322 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867576:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026aafc91/0x22c73c7857bb5322 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867608:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.867610:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.867611:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.867650:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.867662:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ab6a4ca/0x22c73c7857bb5329 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867670:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.867673:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.867676:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ab6a4ca/0x22c73c7857bb5329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867685:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ab6a4ca/0x22c73c7857bb5329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867693:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ab6a4ca/0x22c73c7857bb5329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867701:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ab6a4ca/0x22c73c7857bb5329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867713:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.867720:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.867723:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ab6a4ca/0x22c73c7857bb5329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867728:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499de00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.867731:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ab6a4ca/0x22c73c7857bb5329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867738:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ab6a4ca/0x22c73c7857bb5329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867754:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ab6a4ca/0x22c73c7857bb5329 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867761:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ab6a4ca/0x22c73c7857bb5329 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867773:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.867775:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.867777:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.867818:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.867823:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9fd24e/0x22c73c7857bb5330 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867830:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.867832:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.867836:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e9fd24e/0x22c73c7857bb5330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867843:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e9fd24e/0x22c73c7857bb5330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867850:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9fd24e/0x22c73c7857bb5330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867857:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e9fd24e/0x22c73c7857bb5330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867881:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.867888:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.867892:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e9fd24e/0x22c73c7857bb5330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867898:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.867902:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9fd24e/0x22c73c7857bb5330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867911:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9fd24e/0x22c73c7857bb5330 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867922:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e9fd24e/0x22c73c7857bb5330 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867928:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e9fd24e/0x22c73c7857bb5330 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867940:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.867942:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.867944:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.867982:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.867986:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000babc0710/0x22c73c7857bb5337 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.867993:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.868002:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.868006:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000babc0710/0x22c73c7857bb5337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868015:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000babc0710/0x22c73c7857bb5337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868023:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000babc0710/0x22c73c7857bb5337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868030:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000babc0710/0x22c73c7857bb5337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868043:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952068.868050:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.868053:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000babc0710/0x22c73c7857bb5337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868059:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499dc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.868063:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000babc0710/0x22c73c7857bb5337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868070:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000babc0710/0x22c73c7857bb5337 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868080:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000babc0710/0x22c73c7857bb5337 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.868218:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.868267:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000babc0710/0x22c73c7857bb5337 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868281:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.868283:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.868285:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.868327:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.868331:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebfaa46d/0x22c73c7857bb533e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868339:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.868342:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.868345:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfaa46d/0x22c73c7857bb533e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868353:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebfaa46d/0x22c73c7857bb533e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868360:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebfaa46d/0x22c73c7857bb533e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868366:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebfaa46d/0x22c73c7857bb533e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868424:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783952068.868468:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.868472:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb5345 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868481:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.868483:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.868488:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb5345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868561:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb5345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868570:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb5345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868578:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb5345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868610:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783952068.868617:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783952068.868620:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebfaa46d/0x22c73c7857bb533e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868627:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.868631:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebfaa46d/0x22c73c7857bb533e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868650:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebfaa46d/0x22c73c7857bb533e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868661:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebfaa46d/0x22c73c7857bb533e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868669:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebfaa46d/0x22c73c7857bb533e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868682:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.868685:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb5345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868691:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.868695:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb5345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868703:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb5345 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868711:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb5345 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868717:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c46afef/0x22c73c7857bb5345 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868738:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.868740:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.868742:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.868780:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.868785:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb534c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868793:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.868796:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.868800:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb534c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868810:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb534c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868817:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb534c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868825:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb534c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868837:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783952068.868868:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.868873:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb5353 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868890:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.868893:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.868897:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb5353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868907:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb5353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868915:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb5353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868923:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb5353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868933:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783952068.868939:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783952068.868943:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb534c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868949:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.868952:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb534c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868960:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb534c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868979:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb534c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868986:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098a657b6/0x22c73c7857bb534c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.868999:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.869002:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb5353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.869008:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.869011:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb5353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.869019:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb5353 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.869027:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb5353 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.869035:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb5353 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.869045:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.869046:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.869052:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.869087:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.869092:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb535a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869236:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783952068.869243:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060554271/0x22c73c7857bb52e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869265:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783952068.869730:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.869736:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb5361 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869746:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.869749:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.869754:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb5361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869765:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb5361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869773:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb5361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869792:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb5361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869807:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783952068.869813:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952068.869817:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb5361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869824:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86be00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.869827:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb5361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869835:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb5361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869846:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb5361 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869853:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd7fca8e/0x22c73c7857bb5361 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869867:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.869868:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.869870:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783952068.869907:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.869919:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb5368 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869927:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.869930:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.869934:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb5368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869943:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb5368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869951:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb5368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869958:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb5368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869969:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783952068.869975:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952068.869978:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb5368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869985:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.869988:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb5368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.869996:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb5368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870010:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb5368 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870018:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fae83a6/0x22c73c7857bb5368 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870029:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.870031:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.870033:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783952068.870076:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.870081:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb536f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870088:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.870090:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.870094:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb536f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870110:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb536f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870117:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb536f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870124:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb536f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870147:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783952068.870154:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952068.870158:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb536f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870165:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.870168:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb536f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870177:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb536f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870187:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb536f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870194:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f7f0bf/0x22c73c7857bb536f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870206:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.870208:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.870209:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783952068.870293:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.870298:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb5376 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870306:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.870313:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.870318:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb5376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870327:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb5376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870335:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb5376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870342:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb5376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870353:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783952068.870358:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952068.870362:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb5376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870368:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ac00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.870371:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb5376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870379:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb5376 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870388:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb5376 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870416:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000460f15a6/0x22c73c7857bb5376 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870429:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.870431:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.870433:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783952068.870466:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.870471:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743d6efe/0x22c73c7857bb537d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870479:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.870482:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.870486:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000743d6efe/0x22c73c7857bb537d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870668:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000743d6efe/0x22c73c7857bb537d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870679:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743d6efe/0x22c73c7857bb537d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870686:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000743d6efe/0x22c73c7857bb537d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1783952068.870726:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1783952068.870742:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783952068.870752:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952068.870756:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000743d6efe/0x22c73c7857bb537d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870763:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ba00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.870767:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000743d6efe/0x22c73c7857bb537d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870775:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000743d6efe/0x22c73c7857bb537d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870785:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000743d6efe/0x22c73c7857bb537d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870792:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000743d6efe/0x22c73c7857bb537d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870805:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.870806:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.870808:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783952068.870843:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.870848:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064282a4f/0x22c73c7857bb5384 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870856:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.870859:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.870863:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064282a4f/0x22c73c7857bb5384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870881:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064282a4f/0x22c73c7857bb5384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870889:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064282a4f/0x22c73c7857bb5384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870895:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064282a4f/0x22c73c7857bb5384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870908:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783952068.870914:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952068.870917:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064282a4f/0x22c73c7857bb5384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870924:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86aa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.870927:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064282a4f/0x22c73c7857bb5384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870935:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064282a4f/0x22c73c7857bb5384 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870944:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064282a4f/0x22c73c7857bb5384 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870950:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064282a4f/0x22c73c7857bb5384 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.870968:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.870970:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.870972:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783952068.871010:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952068.871015:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb538b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.871023:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:2.0:1783952068.871026:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952068.871030:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb538b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.871039:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb538b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.871045:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb538b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.871052:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb538b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.871063:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783952068.871070:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952068.871073:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb538b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.871090:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.871180:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.871184:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.871189:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb535a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871199:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb535a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871208:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb535a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871215:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb535a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871226:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783952068.871270:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.871275:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb5392 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871282:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.871284:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.871288:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb5392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871307:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb5392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871316:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb5392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871323:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb5392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871330:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783952068.871362:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.871367:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb5399 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871374:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.871376:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.871380:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb5399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871388:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb5399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871407:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb5399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871425:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb5399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871433:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783952068.871464:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.871469:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb53a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871476:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.871479:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.871483:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb53a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871491:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb53a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871563:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb53a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871571:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb53a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871579:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783952068.871629:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.871633:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb53a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871646:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.871650:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.871654:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb53a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871662:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb53a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871670:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb53a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871676:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb53a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871685:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783952068.871720:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.871725:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb53ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871733:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.871735:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.871739:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb53ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871748:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb53ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871767:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb53ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871774:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb53ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871782:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783952068.871811:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.871815:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb53b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871823:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.871826:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.871830:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb53b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871839:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb53b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871846:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb53b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871853:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb53b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871871:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1783952068.871906:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.871911:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb53bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871919:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.871922:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.871927:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb53bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871935:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb53bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871942:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb53bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871949:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb53bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.871956:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1783952068.871991:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.871995:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb53c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872003:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.872012:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.872016:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb53c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872024:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb53c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872033:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb53c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872039:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb53c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872047:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1783952068.872084:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.872090:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb53ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872181:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb538b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872191:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb538b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872202:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb538b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872208:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b036b84e/0x22c73c7857bb538b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872226:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783952068.872229:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb535a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872236:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.872239:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb535a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872247:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb535a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872256:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb535a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872271:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb535a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872290:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783952068.872294:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb5392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872300:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.872303:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb5392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872310:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb5392 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872319:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb5392 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872326:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb5392 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872336:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783952068.872338:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb5399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872343:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644de00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.872351:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb5399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872358:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb5399 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872367:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb5399 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872373:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb5399 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872383:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783952068.872386:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb53a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872391:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644dc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.872394:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb53a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872413:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb53a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872420:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb53a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872426:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb53a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872444:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783952068.872447:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb53a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872454:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.872457:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb53a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872465:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb53a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872476:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb53a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872482:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb53a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.872493:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783952068.872566:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.872570:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.872575:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb53ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872584:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb53ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872612:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb53ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872625:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb53ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872633:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783952068.872672:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.872677:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb53d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872685:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.872688:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.872692:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb53d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872700:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb53d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872707:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb53d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872713:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb53d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.872720:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:1.0:1783952068.872742:0:26200:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1827 00000100:00100000:1.0:1783952068.872838:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:91065:x1870605465495296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 28469us (28595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952068.872852:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4930 00000100:00100000:1.0:1783952068.872908:0:91065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91065:1870605465495296:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783952068.872924:0:91065:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x741:0x0] from OST, last_created [0x280000401:0x741:0x0]last_used is [0x280000401:0x723:0x0] 00000100:00100000:1.0:1783952068.873009:0:91065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91065:1870605465495552:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783952068.873041:0:91065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952068.873066:0:91065:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1472d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1783952068.873082:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465495424:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783952068.873328:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb53ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.873336:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.873339:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb53ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.873357:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb53ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.873368:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb53ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.873374:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb53ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.873389:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783952068.873393:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb53b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875202:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.875209:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb53b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875222:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb53b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875240:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb53b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875248:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb53b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875295:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783952068.875299:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb53bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875305:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.875308:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb53bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875315:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb53bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875324:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb53bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875331:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb53bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875342:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783952068.875346:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb53c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875351:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.875354:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb53c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875373:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb53c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875381:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb53c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875388:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb53c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875412:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783952068.875416:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb53ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875422:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644da00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.875425:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb53ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875432:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb53ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875440:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb53ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875447:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb53ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875469:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952068.875473:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb53d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875479:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952068.875482:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb53d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.875489:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb53d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.876619:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb53d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.876633:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb53d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952068.876656:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.876659:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.876661:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952068.876692:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465495552 00000100:00100000:2.0:1783952068.876702:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465495552 00000100:00100000:2.0:1783952068.876776:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4931 00000100:00100000:2.0:1783952068.876786:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:91065:x1870605465495552:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783952068.876840:0:26199:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1858 00000100:00100000:1.0:1783952068.877511:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952068.877626:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952068.877632:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465495424 00000100:00100000:0.0:1783952068.877638:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465495424 00000100:00100000:0.0:1783952068.877679:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:0.0:1783952068.877687:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465495424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783952068.877713:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 896 free 3923529728 avail 3692007424 00002000:00010000:1.0:1783952068.877714:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.877721:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb53d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877734:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.877739:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.877746:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb53d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952068.877758:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465495424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (248us total) trans 0 rc 0/0 00010000:00010000:1.0:1783952068.877760:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb53d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952068.877765:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00010000:00010000:1.0:1783952068.877769:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb53d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877776:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb53d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877797:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783952068.877815:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465495424:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1783952068.877838:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.877843:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb53df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877852:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.877855:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.877859:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb53df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877868:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb53df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877875:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb53df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877882:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb53df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877902:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783952068.877939:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.877943:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb53e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877951:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.877960:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.877965:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb53e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877974:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb53e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877982:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb53e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877989:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb53e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.877997:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783952068.878003:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783952068.878008:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb53d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878016:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878031:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb53d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952068.878035:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.878040:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb53ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878042:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb53d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878048:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.878050:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.878054:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb53ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878055:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb53d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878063:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb53ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878063:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb53d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878071:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb53ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878081:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783952068.878083:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb53ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878085:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb53df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878092:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783952068.878101:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ce00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878104:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb53df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878112:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb53df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878121:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb53df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952068.878127:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952068.878129:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb53df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878131:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb53f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878139:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.878141:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952068.878141:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952068.878144:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb53e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878145:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb53f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878151:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644cc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878154:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb53e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878155:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb53f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878163:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb53f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878163:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb53e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878172:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb53f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878172:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb53e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878178:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783952068.878184:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb53e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878196:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952068.878199:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb53ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952068.878206:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952068.878206:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878209:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb53ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878211:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb53fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878217:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb53ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878223:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.878226:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952068.878227:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb53ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878231:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb53fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878234:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb53ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878240:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb53fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878244:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952068.878247:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb53f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878249:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb53fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878253:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afe00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.878257:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb53fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878261:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb53f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878265:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952068.878268:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb53f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878277:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb53f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878284:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b82e7b/0x22c73c7857bb53f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878295:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1783952068.878297:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952068.878298:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb53fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878301:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a16c30/0x22c73c7857bb5402 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878305:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878309:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb53fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878310:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.878313:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952068.878316:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb53fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878317:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a16c30/0x22c73c7857bb5402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878326:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb53fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878327:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a16c30/0x22c73c7857bb5402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878334:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069d0127b/0x22c73c7857bb53fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878346:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a16c30/0x22c73c7857bb5402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878350:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952068.878351:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.878354:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a16c30/0x22c73c7857bb5402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878354:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.878368:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952068.878374:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952068.878378:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a16c30/0x22c73c7857bb5402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878384:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878387:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a16c30/0x22c73c7857bb5402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878407:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a16c30/0x22c73c7857bb5402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878418:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a16c30/0x22c73c7857bb5402 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952068.878419:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.878425:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd0a6d44/0x22c73c7857bb5409 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878426:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a16c30/0x22c73c7857bb5402 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878433:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.878435:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952068.878438:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.878439:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd0a6d44/0x22c73c7857bb5409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878440:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952068.878441:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.878448:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd0a6d44/0x22c73c7857bb5409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878455:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd0a6d44/0x22c73c7857bb5409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878463:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd0a6d44/0x22c73c7857bb5409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878494:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783952068.878537:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.878542:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b86b686/0x22c73c7857bb5410 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878550:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.878552:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.878556:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b86b686/0x22c73c7857bb5410 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878565:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b86b686/0x22c73c7857bb5410 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878571:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b86b686/0x22c73c7857bb5410 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878579:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b86b686/0x22c73c7857bb5410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878612:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783952068.878649:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.878655:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb5417 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878662:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.878671:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.878675:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb5417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878680:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783952068.878684:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb5417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878685:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd0a6d44/0x22c73c7857bb5409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878693:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb5417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878702:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb5417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878702:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878706:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd0a6d44/0x22c73c7857bb5409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878709:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783952068.878713:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd0a6d44/0x22c73c7857bb5409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878723:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd0a6d44/0x22c73c7857bb5409 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878730:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd0a6d44/0x22c73c7857bb5409 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878743:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:1.0:1783952068.878746:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952068.878746:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b86b686/0x22c73c7857bb5410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878751:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4f28434/0x22c73c7857bb541e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878752:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aee00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878756:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b86b686/0x22c73c7857bb5410 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878758:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.878761:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952068.878764:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b86b686/0x22c73c7857bb5410 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878765:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f28434/0x22c73c7857bb541e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878774:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b86b686/0x22c73c7857bb5410 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878775:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4f28434/0x22c73c7857bb541e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878782:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4f28434/0x22c73c7857bb541e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878787:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b86b686/0x22c73c7857bb5410 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878794:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f28434/0x22c73c7857bb541e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878798:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.878801:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952068.878802:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb5417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878807:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878810:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb5417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878817:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb5417 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878827:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb5417 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952068.878834:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952068.878834:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0126918/0x22c73c7857bb5417 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878838:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb5425 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878845:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:0.0:1783952068.878845:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.878848:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952068.878848:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4f28434/0x22c73c7857bb541e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878852:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb5425 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878854:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952068.878860:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb5425 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878862:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4f28434/0x22c73c7857bb541e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878868:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb5425 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878870:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4f28434/0x22c73c7857bb541e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878876:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb5425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878882:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952068.878892:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4f28434/0x22c73c7857bb541e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878899:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4f28434/0x22c73c7857bb541e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878912:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1783952068.878914:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952068.878916:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb5425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878918:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb542c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878922:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878925:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb5425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878930:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:0.0:1783952068.878932:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb5425 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878933:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.878937:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb542c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878942:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb5425 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878946:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb542c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878950:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046cf3c2e/0x22c73c7857bb5425 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878954:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb542c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.878962:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb542c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878965:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952068.878966:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952068.878968:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.878970:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952068.878973:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952068.878976:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb542c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878982:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.878985:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb542c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.878991:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb542c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879000:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb542c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879006:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000976bd568/0x22c73c7857bb542c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879014:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952068.879016:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952068.879017:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952068.879061:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.879067:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000380d2e5c/0x22c73c7857bb5433 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879075:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.879078:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.879082:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000380d2e5c/0x22c73c7857bb5433 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879091:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000380d2e5c/0x22c73c7857bb5433 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879111:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000380d2e5c/0x22c73c7857bb5433 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879118:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000380d2e5c/0x22c73c7857bb5433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879138:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783952068.879177:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.879182:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb543a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879190:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.879193:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952068.879194:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952068.879197:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb543a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879198:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000380d2e5c/0x22c73c7857bb5433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879207:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb543a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879215:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb543a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879215:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.879219:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000380d2e5c/0x22c73c7857bb5433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879223:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb543a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879227:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000380d2e5c/0x22c73c7857bb5433 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879237:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000380d2e5c/0x22c73c7857bb5433 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879239:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952068.879244:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000380d2e5c/0x22c73c7857bb5433 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879256:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952068.879259:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb543a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879265:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aec00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.879269:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb543a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952068.879274:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952068.879276:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb543a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879278:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb5441 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879285:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb543a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879286:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:1.0:1783952068.879289:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.879293:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb5441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879297:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d619b6/0x22c73c7857bb543a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879302:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb5441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879309:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.879310:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb5441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.879311:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952068.879312:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952068.879318:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb5441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879340:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783952068.879377:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952068.879383:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb5448 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.879390:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:3.0:1783952068.880740:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952068.880750:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb5441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.880759:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aea00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952068.880762:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb5441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.880771:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb5441 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.880787:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb5441 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.880795:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c980d021/0x22c73c7857bb5441 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.880831:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.880833:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.880835:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.880846:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.881691:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952068.881711:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952068.883063:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:91065:x1870605465495552:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6271us (10013us total) trans 4294968954 rc 0/0 00000100:00100000:0.0:1783952068.883074:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4931 00010000:00010000:1.0:1783952068.883267:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952068.883277:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb5448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.883295:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb5448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.883305:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb5448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.883312:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb5448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952068.883676:0:91065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91065:1870605465495552:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783952068.883694:0:91065:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x741:0x0]-[0x280000401:0x761:0x0] 00010000:00010000:0.0:1783952068.883763:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783952068.883852:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952068.883858:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dfc72d2/0x22c73c7857bb544f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.883869:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:0.0:1783952068.883873:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952068.883877:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfc72d2/0x22c73c7857bb544f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.883887:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfc72d2/0x22c73c7857bb544f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.883895:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dfc72d2/0x22c73c7857bb544f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.883919:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dfc72d2/0x22c73c7857bb544f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.883941:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783952068.883978:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952068.883982:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb5456 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.883990:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:0.0:1783952068.883993:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952068.883997:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb5456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884006:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb5456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884014:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb5456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884028:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb5456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884042:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783952068.884050:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783952068.884056:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb5448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884070:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.884074:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb5448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884084:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb5448 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884099:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb5448 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884106:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fce6b19/0x22c73c7857bb5448 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884124:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952068.884128:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dfc72d2/0x22c73c7857bb544f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884134:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.884137:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dfc72d2/0x22c73c7857bb544f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884144:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dfc72d2/0x22c73c7857bb544f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884154:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dfc72d2/0x22c73c7857bb544f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884168:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfc72d2/0x22c73c7857bb544f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884180:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952068.884184:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb5456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884190:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952068.884193:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb5456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884200:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb5456 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884209:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb5456 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884214:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb5456 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884225:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952068.884227:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952068.884228:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952068.884270:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952068.884276:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5bfe73a/0x22c73c7857bb545d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884290:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=3783s v=(0 0) 00010000:00010000:0.0:1783952068.884292:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952068.884296:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5bfe73a/0x22c73c7857bb545d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884304:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5bfe73a/0x22c73c7857bb545d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884311:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5bfe73a/0x22c73c7857bb545d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884318:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5bfe73a/0x22c73c7857bb545d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952068.884339:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1783952068.884393:0:8436:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1826 00000100:00100000:0.0:1783952068.884465:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:91067:x1870605465495168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 41022us (41152us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952068.884473:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4929 00010000:00010000:3.0:1783952068.884531:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952068.884537:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5bfe73a/0x22c73c7857bb545d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.884545:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbdc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952068.884548:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5bfe73a/0x22c73c7857bb545d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.884557:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5bfe73a/0x22c73c7857bb545d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.884568:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5bfe73a/0x22c73c7857bb545d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952068.884575:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5bfe73a/0x22c73c7857bb545d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952068.884577:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.884610:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.884612:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952068.884614:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952068.885219:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952068.885253:0:91067:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91067:1870605465495168:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783952068.885266:0:91067:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x741:0x0] from OST, last_created [0x2c0000401:0x741:0x0]last_used is [0x2c0000401:0x722:0x0] 00000100:00100000:2.0:1783952068.885348:0:91067:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91067:1870605465495808:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783952068.885393:0:91067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952068.885413:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952068.885426:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465495680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952068.885434:0:91067:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147240180 going to sleep for 11 seconds 00000100:00100000:0.0:1783952068.885455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952068.885496:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465495808 00000100:00100000:3.0:1783952068.885510:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465495808 00000100:00100000:3.0:1783952068.885562:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4932 00000100:00100000:3.0:1783952068.885571:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:91067:x1870605465495808:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783952068.885660:0:26203:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1858 00000100:00100000:3.0:1783952068.887079:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:91067:x1870605465495808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1505us (1681us total) trans 4294968955 rc 0/0 00000100:00100000:3.0:1783952068.887090:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4932 00000100:00100000:1.0:1783952068.887463:0:91067:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91067:1870605465495808:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783952068.887478:0:91067:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x741:0x0]-[0x2c0000401:0x761:0x0] 00000100:00100000:2.0:1783952068.889770:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465495680 00000100:00100000:2.0:1783952068.889782:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465495680 00000100:00100000:2.0:1783952068.889838:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:2.0:1783952068.889847:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465495680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783952068.889892:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952068.889975:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465495680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (4518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952068.889982:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:0.0:1783952068.890088:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465495680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783952069.153451:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783952069.220754:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:1.0:1783952069.386896:0:91386:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783952069.387155:0:91386:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783952070.125621:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952070.125660:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952070.125697:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952070.125728:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952070.125752:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952070.125794:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447736704 00000100:00100000:3.0:1783952070.125804:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447736704 00000100:00100000:3.0:1783952070.125864:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447736832 00000100:00100000:3.0:1783952070.125867:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447736832 00000100:00100000:3.0:1783952070.125893:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1265 00000100:00100000:3.0:1783952070.125903:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+7:2401:x1870605447736704:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952070.125979:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+7:2401:x1870605447736704:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 78us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952070.125987:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1265 00000100:00100000:3.0:1783952070.126005:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1266 00000100:00100000:3.0:1783952070.126013:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447736832:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952070.126039:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447736832:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952070.126046:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1266 00000100:00100000:3.0:1783952070.126084:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447736960 00000100:00100000:3.0:1783952070.126088:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447736960 00000100:00100000:3.0:1783952070.126110:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447737088 00000100:00100000:3.0:1783952070.126113:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447737088 00000100:00100000:3.0:1783952070.126132:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2756 00000100:00100000:3.0:1783952070.126138:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+7:2401:x1870605447736960:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952070.126165:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+7:2401:x1870605447736960:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952070.126171:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2756 00000100:00100000:3.0:1783952070.126182:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2757 00000100:00100000:3.0:1783952070.126188:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447737088:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952070.126212:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447737088:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952070.126218:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2757 00000100:00080000:1.0:1783952070.126508:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952070.126513:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952070.126516:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952070.126517:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783952070.126555:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447736576 00000100:00100000:1.0:1783952070.126560:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447736576 00000100:00100000:1.0:1783952070.126608:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 72 00000100:00100000:1.0:1783952070.126616:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447736576:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952070.126667:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447736576:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 52us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952070.126674:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 72 00010000:00010000:2.0:1783952070.177986:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783952070.601066:0:91436:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783952070.601296:0:91436:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783952071.200781:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952071.265494:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783952071.265540:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465495936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952071.265640:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952071.265787:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465495936 00000100:00100000:1.0:1783952071.265796:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465495936 00000100:00100000:1.0:1783952071.265855:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:1.0:1783952071.265866:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465495936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952071.265899:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952071.265947:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465495936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952071.265954:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00080000:0.0:1783952071.266138:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952071.266156:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465496064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952071.266185:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952071.266231:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465495936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952071.266306:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465496064 00000100:00100000:2.0:1783952071.266310:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465496064 00000100:00100000:2.0:1783952071.266362:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:2.0:1783952071.266369:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465496064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952071.266395:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952071.266429:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465496064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952071.266435:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00080000:0.0:1783952071.267318:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952071.267372:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465496064:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783952072.230003:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952073.083064:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952073.083248:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447737216 00000100:00100000:0.0:1783952073.083259:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447737216 00000100:00100000:0.0:1783952073.083342:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1278 00000100:00100000:0.0:1783952073.083353:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04697e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+7:69861:x1870605447737216:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1783952073.083408:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952073.083446:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb5464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2e4 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952073.083511:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952073.083525:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952073.083540:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952073.083645:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783952073.083649:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783952073.083685:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952073.083720:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb5464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2e4 expref: 9 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952073.083738:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2e4 expref: 8 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952073.083746:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:0.0:1783952073.083749:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783952073.083752:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd600, rc 0) 00000100:00080000:1.0:1783952073.083915:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952073.084021:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04697e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:69861:x1870605447737216:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 668us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952073.084029:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1278 00000100:00100000:1.0:1783952073.101683:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952073.101774:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447737344 00000100:00100000:3.0:1783952073.101786:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447737344 00000100:00100000:3.0:1783952073.101862:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1279 00000100:00100000:3.0:1783952073.101872:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+8:69861:x1870605447737344:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:3.0:1783952073.101915:0:67035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1783952073.101991:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+8:69861:x1870605447737344:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 122us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952073.101999:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1279 00000100:00100000:2.0:1783952073.106636:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952073.106711:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447737472 00000100:00100000:3.0:1783952073.106722:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447737472 00000100:00100000:3.0:1783952073.106799:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1280 00000100:00100000:3.0:1783952073.106815:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:69861:x1870605447737472:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:3.0:1783952073.106854:0:66238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783952073.106919:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:69861:x1870605447737472:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952073.106925:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1280 00000100:00080000:1.0:1783952073.107094:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952073.126431:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952073.126535:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447737600 00000100:00100000:0.0:1783952073.126546:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447737600 00000100:00100000:0.0:1783952073.126645:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2153 00000100:00100000:0.0:1783952073.126656:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+7:69861:x1870605447737600:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783952073.126693:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952073.126765:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+7:69861:x1870605447737600:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 111us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952073.126772:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2153 00000100:00080000:1.0:1783952073.126901:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952073.141238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952073.141334:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447737728 00000100:00100000:1.0:1783952073.141344:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447737728 00000100:00100000:1.0:1783952073.141428:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2154 00000100:00100000:1.0:1783952073.141438:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:69861:x1870605447737728:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:1.0:1783952073.141483:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952073.141549:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:69861:x1870605447737728:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 113us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952073.141557:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2154 00000100:00080000:0.0:1783952073.144109:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783952073.248818:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952073.825271:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952073.825298:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465496192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952073.825438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952073.825742:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465496448:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.825776:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952073.825794:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465496960:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.825815:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952073.825831:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1466b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465497472:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.825849:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952073.825864:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783952073.825870:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465496576:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.825888:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952073.825918:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465497088:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.825936:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952073.825950:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1466b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465497600:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.825966:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952073.825990:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465496960 00000100:00100000:2.0:1783952073.825996:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465496960 00000100:00100000:2.0:1783952073.826040:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465497472 00000100:00100000:2.0:1783952073.826044:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465497472 00000100:00100000:2.0:1783952073.826058:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465497088 00000100:00100000:2.0:1783952073.826061:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465497088 00000100:00100000:2.0:1783952073.826074:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465497600 00000100:00100000:2.0:1783952073.826076:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465497600 00000100:00100000:2.0:1783952073.826098:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758 00000100:00100000:2.0:1783952073.826106:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465496960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826165:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465496960:12345-0@lo:400:kworker.0 Request processed in 60us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952073.826173:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758 00000100:00100000:2.0:1783952073.826189:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00100000:2.0:1783952073.826195:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465497472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826220:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465497472:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952073.826225:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00100000:2.0:1783952073.826236:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760 00000100:00100000:2.0:1783952073.826241:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465497088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826266:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465497088:12345-0@lo:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952073.826271:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760 00000100:00100000:2.0:1783952073.826282:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761 00000100:00100000:2.0:1783952073.826287:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465497600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826310:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465497600:12345-0@lo:400:kworker.0 Request processed in 23us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952073.826315:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761 00000100:00100000:2.0:1783952073.826331:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465496448 00000100:00100000:2.0:1783952073.826334:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465496448 00000100:00100000:2.0:1783952073.826369:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465496576 00000100:00100000:2.0:1783952073.826372:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465496576 00000100:00100000:2.0:1783952073.826390:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:2.0:1783952073.826395:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465496448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826627:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465496448:12345-0@lo:400:kworker.0 Request processed in 230us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952073.826642:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:2.0:1783952073.826656:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1783952073.826662:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465496576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826692:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465496576:12345-0@lo:400:kworker.0 Request processed in 31us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952073.826697:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1783952073.826735:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465496576:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826745:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465497088:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826755:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1466b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465497600:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826764:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465496448:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826772:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465496960:0@lo:400:kworker.0 00000100:00100000:2.0:1783952073.826780:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1466b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465497472:0@lo:400:kworker.0 00000100:00100000:0.0:1783952073.826868:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465496192 00000100:00100000:0.0:1783952073.826873:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465496192 00000100:00100000:0.0:1783952073.826921:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:0.0:1783952073.826928:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465496192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783952073.826956:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:0.0:1783952073.826994:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465496192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952073.827000:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00080000:0.0:1783952073.827026:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952073.827030:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952073.827033:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952073.827034:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952073.827235:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465496704:0@lo:400:kworker.0 00000100:00100000:1.0:1783952073.827277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952073.827307:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1466b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465497216:0@lo:400:kworker.0 00000100:00100000:1.0:1783952073.827327:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952073.827339:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1466b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465497728:0@lo:400:kworker.0 00000100:00100000:1.0:1783952073.827367:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952073.827387:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783952073.827392:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465496320:0@lo:400:kworker.0 00000100:00100000:1.0:1783952073.827414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952073.827455:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465496832:0@lo:400:kworker.0 00000100:00100000:1.0:1783952073.827476:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952073.827490:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1466b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465497344:0@lo:400:kworker.0 00000100:00100000:1.0:1783952073.827511:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952073.827555:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465496320 00000100:00100000:1.0:1783952073.827559:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465496320 00000100:00100000:1.0:1783952073.827609:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783952073.827616:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465496320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952073.827662:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465496320:12345-0@lo:400:kworker.0 Request processed in 46us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952073.827668:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783952073.827694:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465496704 00000100:00100000:1.0:1783952073.827697:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465496704 00000100:00100000:1.0:1783952073.827718:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465497216 00000100:00100000:1.0:1783952073.827721:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465497216 00000100:00100000:1.0:1783952073.827730:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465497728 00000100:00100000:1.0:1783952073.827732:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465497728 00000100:00100000:1.0:1783952073.827741:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465496832 00000100:00100000:1.0:1783952073.827743:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465496832 00000100:00100000:1.0:1783952073.827766:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1783952073.827772:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465496704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952073.827799:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465496704:12345-0@lo:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952073.827804:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1783952073.827814:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1783952073.827819:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465497216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952073.827840:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465497216:12345-0@lo:400:kworker.0 Request processed in 21us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952073.827845:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1783952073.827855:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1783952073.827859:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465497728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952073.827879:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465497728:12345-0@lo:400:kworker.0 Request processed in 20us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952073.827885:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1783952073.828101:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465497344 00000100:00100000:0.0:1783952073.828104:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465497344 00000100:00100000:0.0:1783952073.828128:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:0.0:1783952073.828134:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465497344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952073.828166:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465497344:12345-0@lo:400:kworker.0 Request processed in 32us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952073.828171:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:0.0:1783952073.828193:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1783952073.828200:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465496832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952073.828240:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465496832:12345-0@lo:400:kworker.0 Request processed in 41us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952073.828246:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00080000:0.0:1783952073.828265:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952073.828268:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952073.828307:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465496320:0@lo:400:kworker.0 00000100:00100000:0.0:1783952073.828318:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465496832:0@lo:400:kworker.0 00000100:00100000:0.0:1783952073.828326:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1466b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465497344:0@lo:400:kworker.0 00000100:00100000:0.0:1783952073.828335:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465496704:0@lo:400:kworker.0 00000100:00100000:0.0:1783952073.828366:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1466b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465497216:0@lo:400:kworker.0 00000100:00100000:0.0:1783952073.828380:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1466b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465497728:0@lo:400:kworker.0 00000100:00100000:0.0:1783952073.828400:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952073.828407:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465497856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952073.828447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952073.828472:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465497856 00000100:00100000:0.0:1783952073.828476:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465497856 00000100:00100000:0.0:1783952073.828497:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:0.0:1783952073.828502:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14f0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465497856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783952073.828516:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783952073.828549:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14f0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465497856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952073.828555:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:0.0:1783952073.828580:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465497856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952073.829086:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465496192:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783952074.276621:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952074.337712:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465497984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952074.337790:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952074.337846:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465497984 00000100:00100000:0.0:1783952074.337855:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465497984 00000100:00100000:0.0:1783952074.337900:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:0.0:1783952074.337908:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465497984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783952074.337933:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952074.337975:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465497984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952074.337982:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:0.0:1783952074.338054:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465497984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952074.338682:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465498112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952074.338716:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952074.338773:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465498112 00000100:00100000:2.0:1783952074.338778:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465498112 00000100:00100000:2.0:1783952074.338812:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:2.0:1783952074.338819:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465498112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783952074.338834:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952074.339686:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465498112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 865us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952074.339695:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:3.0:1783952074.339773:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465498112:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1783952074.874526:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968955 is committed 00000001:00080000:0.0:1783952074.884041:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968954 is committed 00000100:00100000:2.0:1783952075.254283:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952075.254324:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952075.254352:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952075.254379:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952075.254383:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447737856 00000100:00100000:0.0:1783952075.254394:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447737856 00000100:00100000:0.0:1783952075.254440:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00100000:0.0:1783952075.254447:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2399:x1870605447737856:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952075.254460:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952075.254489:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447738240 00000100:00100000:2.0:1783952075.254494:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447738240 00000100:00100000:0.0:1783952075.254523:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2399:x1870605447737856:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952075.254524:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447738368 00000100:00100000:2.0:1783952075.254528:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447738368 00000100:00100000:0.0:1783952075.254534:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00100000:2.0:1783952075.254546:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2762 00000100:00100000:2.0:1783952075.254554:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447738240:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952075.254566:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447737984 00000100:00100000:0.0:1783952075.254570:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447737984 00000100:00100000:2.0:1783952075.254585:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447738240:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952075.254618:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2762 00000100:00100000:0.0:1783952075.254619:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447738112 00000100:00100000:0.0:1783952075.254623:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447738112 00000100:00100000:2.0:1783952075.254636:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2763 00000100:00100000:2.0:1783952075.254646:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447738368:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952075.254652:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1273 00000100:00100000:0.0:1783952075.254662:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:2399:x1870605447737984:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952075.254674:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447738368:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952075.254691:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2763 00000100:00100000:0.0:1783952075.254697:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:2399:x1870605447737984:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 35us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952075.254705:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1273 00000100:00100000:0.0:1783952075.254725:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1274 00000100:00100000:0.0:1783952075.254735:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447738112:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952075.254767:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447738112:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 34us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952075.254775:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1274 00000100:00080000:0.0:1783952075.254819:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952075.254824:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952075.254828:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952075.254831:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783952075.304708:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952076.326078:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952076.388708:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1466b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465498240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952076.388786:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952076.388846:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465498240 00000100:00100000:2.0:1783952076.388854:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465498240 00000100:00100000:2.0:1783952076.389533:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:2.0:1783952076.389546:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465498240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952076.389577:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952076.389743:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465498368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952076.389840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952076.389878:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465498368 00000100:00100000:3.0:1783952076.389883:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465498368 00000100:00100000:2.0:1783952076.390216:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465498240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 673us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952076.390235:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00080000:2.0:1783952076.390263:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952076.390760:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:3.0:1783952076.390768:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465498368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783952076.390792:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952076.390832:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465498368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952076.390839:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00080000:3.0:1783952076.390854:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952076.390888:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465498368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952076.391490:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1466b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465498240:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783952077.345870:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952078.368885:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952078.944859:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465498496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952078.945218:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465498624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952078.945419:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465498880:0@lo:400:kworker.0 00000100:00100000:1.0:1783952078.945469:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465498752:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.951411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952078.951476:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465499136:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.951515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952078.951540:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465499648:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.951565:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952078.951584:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465500160:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.953987:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952078.954072:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783952078.954086:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465499008:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.954144:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952078.954164:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465499520:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.954191:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952078.954216:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465500032:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.954238:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952078.954284:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465499136 00000100:00100000:2.0:1783952078.954292:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465499136 00000100:00100000:2.0:1783952078.954365:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465499008 00000100:00100000:2.0:1783952078.954369:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465499008 00000100:00100000:2.0:1783952078.954392:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1783952078.954401:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465499136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.954476:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465499136:12345-0@lo:400:kworker.0 Request processed in 76us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952078.954484:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1783952078.954501:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1783952078.954507:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465499008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.954534:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465499008:12345-0@lo:400:kworker.0 Request processed in 28us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952078.954539:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1783952078.954563:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465499648 00000100:00100000:2.0:1783952078.954566:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465499648 00000100:00100000:2.0:1783952078.954612:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465500160 00000100:00100000:2.0:1783952078.954616:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465500160 00000100:00100000:2.0:1783952078.957061:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465499520 00000100:00100000:2.0:1783952078.957074:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465499520 00000100:00100000:2.0:1783952078.957100:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465500032 00000100:00100000:2.0:1783952078.957103:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465500032 00000100:00100000:2.0:1783952078.957129:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:2.0:1783952078.957139:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465499648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.957224:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465499648:12345-0@lo:400:kworker.0 Request processed in 87us (5657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952078.957231:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000100:00100000:2.0:1783952078.957248:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:2.0:1783952078.957254:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465500160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.957283:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465500160:12345-0@lo:400:kworker.0 Request processed in 29us (3305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952078.957288:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000100:00100000:2.0:1783952078.957299:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766 00000100:00100000:2.0:1783952078.957331:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465499520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.957363:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465499520:12345-0@lo:400:kworker.0 Request processed in 34us (3172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952078.957369:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766 00000100:00100000:2.0:1783952078.957379:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767 00000100:00100000:2.0:1783952078.957385:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465500032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.957408:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465500032:12345-0@lo:400:kworker.0 Request processed in 24us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952078.957414:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767 00000100:00080000:2.0:1783952078.957439:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952078.957443:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952078.957446:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952078.957449:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952078.957506:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465499008:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.957517:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465499520:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.957526:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968954 gen 2 00000100:00100000:2.0:1783952078.957543:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465500032:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.957555:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465499136:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.957565:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465499648:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.957574:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968955 gen 2 00000100:00100000:2.0:1783952078.957583:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465500160:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.957753:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465498624 00000100:00100000:2.0:1783952078.957758:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465498624 00000100:00100000:2.0:1783952078.957787:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:2.0:1783952078.957798:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465498624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783952078.957825:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783952078.958002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952078.958030:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465498880 00000100:00100000:0.0:1783952078.958034:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465498880 00000100:00100000:0.0:1783952078.958069:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1783952078.958076:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465498880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952078.958103:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465498880:12345-0@lo:400:kworker.0 Request processed in 29us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952078.958109:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00080000:0.0:1783952078.958122:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952078.958139:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465498880:0@lo:400:kworker.0 00000100:00100000:0.0:1783952078.958149:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465499392:0@lo:400:kworker.0 00000100:00100000:0.0:1783952078.958176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952078.958195:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465499392 00000100:00100000:0.0:1783952078.958199:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465499392 00000100:00100000:0.0:1783952078.958221:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1783952078.958226:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465499392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952078.958253:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465499392:12345-0@lo:400:kworker.0 Request processed in 27us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952078.958258:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1783952078.958282:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465499392:0@lo:400:kworker.0 00000100:00100000:0.0:1783952078.958289:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465499904:0@lo:400:kworker.0 00000100:00100000:0.0:1783952078.958338:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952078.958361:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465499904 00000100:00100000:0.0:1783952078.958364:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465499904 00000100:00100000:0.0:1783952078.958385:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:0.0:1783952078.958392:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465499904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952078.958422:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465499904:12345-0@lo:400:kworker.0 Request processed in 31us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952078.958428:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:0.0:1783952078.958453:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465499904:0@lo:400:kworker.0 00000100:00100000:1.0:1783952078.958575:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952078.958630:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465499264:0@lo:400:kworker.0 00000100:00100000:1.0:1783952078.958656:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952078.958678:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465499264 00000100:00100000:1.0:1783952078.958682:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465499264 00000100:00100000:1.0:1783952078.958716:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1783952078.958722:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465499264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952078.958753:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465499264:12345-0@lo:400:kworker.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952078.958767:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00080000:1.0:1783952078.958786:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952078.958804:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465499264:0@lo:400:kworker.0 00000100:00100000:1.0:1783952078.958811:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465499776:0@lo:400:kworker.0 00000100:00100000:1.0:1783952078.958835:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952078.958869:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465499776 00000100:00100000:1.0:1783952078.958873:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465499776 00000100:00100000:1.0:1783952078.958902:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1783952078.958909:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465499776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952078.958939:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465499776:12345-0@lo:400:kworker.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952078.958945:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1783952078.958967:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465499776:0@lo:400:kworker.0 00000100:00100000:1.0:1783952078.958974:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465500288:0@lo:400:kworker.0 00000100:00100000:1.0:1783952078.958996:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952078.959015:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465500288 00000100:00100000:1.0:1783952078.959018:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465500288 00000100:00100000:1.0:1783952078.959040:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1783952078.959045:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465500288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952078.959075:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465500288:12345-0@lo:400:kworker.0 Request processed in 30us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952078.959081:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1783952078.959103:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465500288:0@lo:400:kworker.0 00000100:00100000:3.0:1783952078.960604:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465498752 00000100:00100000:3.0:1783952078.960615:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465498752 00000100:00100000:3.0:1783952078.960668:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783952078.960677:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465498752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952078.960743:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465498752:12345-0@lo:400:kworker.0 Request processed in 67us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952078.960750:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783952078.960798:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952078.961370:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465498496 00000100:00100000:3.0:1783952078.961375:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465498496 00000100:00100000:3.0:1783952078.961408:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:3.0:1783952078.961414:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465498496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783952078.961444:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1783952078.961541:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465498496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952078.961547:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:3.0:1783952078.961678:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465498496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783952078.964882:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14f0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465498752:0@lo:400:kworker.0 00000100:00100000:2.0:1783952078.972257:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465498624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 14448us (20843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952078.972273:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1783952078.976464:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465498624:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783952079.397497:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952079.457671:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465500416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952079.457753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952079.458169:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952079.458181:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465500544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952079.458217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952079.458252:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465500416 00000100:00100000:3.0:1783952079.458259:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465500416 00000100:00100000:3.0:1783952079.458313:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465500544 00000100:00100000:3.0:1783952079.458317:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465500544 00000100:00100000:3.0:1783952079.458334:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:3.0:1783952079.458341:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465500416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783952079.458386:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952079.458430:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465500416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952079.458437:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:3.0:1783952079.458453:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1783952079.458458:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465500544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952079.458473:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952079.458502:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465500544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952079.458508:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1783952079.458549:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465500544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952079.460526:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465500416:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1783952080.049581:0:91629:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:0.0:1783952080.372200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952080.372249:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952080.372282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952080.372319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952080.372337:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447739008 00000100:00100000:0.0:1783952080.372345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952080.372347:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447739008 00000100:00100000:0.0:1783952080.372367:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447738752 00000100:00100000:0.0:1783952080.372370:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447738752 00000100:00100000:0.0:1783952080.372402:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447738624 00000100:00100000:0.0:1783952080.372405:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447738624 00000100:00100000:0.0:1783952080.372429:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1281 00000100:00100000:0.0:1783952080.372439:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447738752:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952080.372469:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447738880 00000100:00100000:3.0:1783952080.372473:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447738880 00000100:00100000:3.0:1783952080.372495:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2768 00000100:00100000:3.0:1783952080.372501:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447739008:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952080.372515:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447738752:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952080.372522:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1281 00000100:00100000:3.0:1783952080.372527:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447739008:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952080.372532:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2768 00000100:00100000:3.0:1783952080.372547:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2769 00000100:00100000:0.0:1783952080.372547:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1282 00000100:00100000:3.0:1783952080.372554:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447738880:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952080.372554:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:2398:x1870605447738624:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952080.372576:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447738880:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 23us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952080.372582:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2769 00000100:00100000:1.0:1783952080.372620:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447738496 00000100:00100000:1.0:1783952080.372624:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447738496 00000100:00100000:1.0:1783952080.372665:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00100000:1.0:1783952080.372672:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447738496:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952080.376187:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+8:2398:x1870605447738624:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 3620us (3855us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952080.376202:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1282 00000100:00100000:1.0:1783952080.379526:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447738496:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 6839us (7321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952080.379553:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00080000:1.0:1783952080.379647:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952080.379654:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783952080.379657:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952080.379659:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783952080.417352:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952081.440825:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952081.508801:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465500672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952081.508903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952081.508982:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465500672 00000100:00100000:3.0:1783952081.508993:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465500672 00000100:00100000:3.0:1783952081.509067:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:3.0:1783952081.509079:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465500672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783952081.509123:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952081.509180:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465500672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952081.509189:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00100000:3.0:1783952081.509397:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465500672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952081.509676:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783952081.509690:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1466b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465500800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952081.509729:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952081.509763:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465500800 00000100:00100000:2.0:1783952081.509768:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465500800 00000100:00100000:2.0:1783952081.509801:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:2.0:1783952081.509809:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465500800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952081.509830:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952081.509864:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465500800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952081.509871:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00100000:2.0:1783952081.509901:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1466b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465500800:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783952081.513512:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952081.513526:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1783952082.123239:0:91678:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1783952082.465438:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952083.489079:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952083.731830:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952083.731950:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447739136 00000100:00100000:1.0:1783952083.731960:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447739136 00000100:00100000:1.0:1783952083.732052:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1281 00000100:00100000:1.0:1783952083.732063:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:70329:x1870605447739136:12345-192.168.202.48@tcp:41:lfs.0 00000100:00080000:2.0:1783952083.732074:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1783952083.732105:0:66237:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:1.0:1783952083.732182:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:70329:x1870605447739136:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 121us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952083.732189:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1281 00000100:00100000:2.0:1783952083.734064:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952083.734160:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447739264 00000100:00100000:1.0:1783952083.734179:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447739264 00000100:00100000:1.0:1783952083.734269:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1282 00000100:00100000:1.0:1783952083.734280:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:70329:x1870605447739264:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:1.0:1783952083.734315:0:67035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00080000:2.0:1783952083.734501:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952083.734676:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+6:70329:x1870605447739264:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 387us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952083.734684:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1282 00000100:00100000:2.0:1783952083.764876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952083.764962:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447739392 00000100:00100000:3.0:1783952083.764972:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447739392 00000100:00100000:3.0:1783952083.765049:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2163 00000100:00100000:3.0:1783952083.765059:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+7:70329:x1870605447739392:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783952083.765094:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783952083.765215:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952083.765299:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+7:70329:x1870605447739392:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 241us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952083.765307:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2163 00000100:00100000:0.0:1783952083.785897:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952083.786193:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447739520 00000100:00100000:2.0:1783952083.786203:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447739520 00000100:00100000:2.0:1783952083.786296:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2164 00000100:00100000:2.0:1783952083.786320:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:70329:x1870605447739520:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:2.0:1783952083.786354:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952083.786426:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:458183b2-4c6d-478c-9fed-a955779e6611+6:70329:x1870605447739520:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 108us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952083.786434:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2164 00000100:00080000:1.0:1783952083.787114:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952083.852716:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952083.852876:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447739776 00000100:00100000:2.0:1783952083.852885:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447739776 00000100:00100000:2.0:1783952083.852949:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1283 00000100:00100000:2.0:1783952083.852960:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:70345:x1870605447739776:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783952083.852982:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952083.853006:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2eb expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853080:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853093:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853105:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853119:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb5480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853126:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb5480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853132:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb5480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853226:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853233:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853254:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853269:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853275:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952083.853280:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853287:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853299:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:2.0:1783952083.853302:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952083.853306:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853312:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853326:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb5480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853332:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb5480 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853345:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb5480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853351:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952083.853354:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb5480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853361:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb5480 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853369:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b151a72000) 00010000:00010000:2.0:1783952083.853372:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952083.853375:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb5480 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853380:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb5480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853414:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5472 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2eb expref: 9 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853425:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:2.0:1783952083.853428:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783952083.853431:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2eb expref: 9 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.853440:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ac00, rc 0) 00000100:00100000:2.0:1783952083.853509:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:70345:x1870605447739776:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 551us (802us total) trans 0 rc 301/301 00000100:00100000:2.0:1783952083.853525:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1283 00000100:00100000:0.0:1783952083.867877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952083.871499:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447739904 00000100:00100000:1.0:1783952083.871516:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447739904 00000100:00100000:1.0:1783952083.871609:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1284 00000100:00100000:1.0:1783952083.871620:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:70345:x1870605447739904:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:1.0:1783952083.871848:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.871866:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.871878:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.871891:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb548e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.871898:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb548e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.871904:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb548e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.871998:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872008:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872014:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952083.872057:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1783952083.872061:0:66237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783952083.872074:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872086:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872092:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872098:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872104:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872109:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952083.872113:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872120:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872139:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:1.0:1783952083.872142:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952083.872146:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872152:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb5487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872165:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb548e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872171:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb548e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872176:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb548e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872182:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952083.872184:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb548e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872189:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb548e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872195:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b14531c400) 00010000:00010000:1.0:1783952083.872198:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952083.872201:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb548e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872205:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb548e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.872228:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.875361:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.875378:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.875385:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aec00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952083.875390:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.875400:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.875417:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d805e00) 00010000:00010000:1.0:1783952083.875420:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952083.875424:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.875431:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb5495 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952083.875544:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+8:70345:x1870605447739904:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 3921us (7671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952083.875553:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1284 00000100:00100000:3.0:1783952083.912321:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952083.912485:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447740160 00000100:00100000:2.0:1783952083.912495:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447740160 00000100:00100000:2.0:1783952083.912552:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1285 00000100:00100000:2.0:1783952083.912562:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:70348:x1870605447740160:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783952083.912582:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952083.912639:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb549c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2f2 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912720:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb54a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912734:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb54a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912745:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb54a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912759:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb54aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912766:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb54aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912773:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb54aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912843:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb54a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912868:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb54a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912875:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb54a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912881:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952083.912885:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb54a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912892:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb54a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912904:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:2.0:1783952083.912907:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952083.912911:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb54a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912917:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb54a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912929:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb54aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912935:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb54aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912941:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb54aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912945:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86be00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952083.912954:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb54aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912972:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb54aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912980:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b151a72000) 00010000:00010000:2.0:1783952083.912982:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952083.912985:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb54aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.912990:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb54aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.913018:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb549c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2f2 expref: 9 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.913028:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:2.0:1783952083.913030:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783952083.913033:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb549c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2f2 expref: 9 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952083.913041:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a800, rc 0) 00000100:00100000:2.0:1783952083.913092:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:70348:x1870605447740160:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 532us (781us total) trans 0 rc 301/301 00000100:00100000:2.0:1783952083.913099:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1285 00000100:00100000:2.0:1783952083.925556:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952083.925703:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447740288 00000100:00100000:1.0:1783952083.925714:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447740288 00000100:00100000:1.0:1783952083.925777:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1286 00000100:00100000:1.0:1783952083.925801:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:70348:x1870605447740288:12345-192.168.202.48@tcp:34:lfs.0 00010000:00010000:1.0:1783952083.925876:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.925893:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.925905:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.925920:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb54b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.925926:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb54b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.925932:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb54b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926013:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926022:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926028:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952083.926065:0:68591:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1783952083.926070:0:68591:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783952083.926081:0:68591:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926105:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926111:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926117:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926123:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926130:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aec00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952083.926134:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926140:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926151:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:1.0:1783952083.926154:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952083.926158:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926164:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aec00/0x22c73c7857bb54b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926176:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb54b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926181:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb54b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926193:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb54b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926197:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952083.926200:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb54b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926206:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb54b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926213:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b14531c400) 00010000:00010000:1.0:1783952083.926215:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952083.926217:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb54b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926222:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb54b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926236:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926241:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926247:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926250:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952083.926253:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926282:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926289:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d805e00) 00010000:00010000:1.0:1783952083.926292:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952083.926295:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952083.926301:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af400/0x22c73c7857bb54bf lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952083.926377:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:70348:x1870605447740288:12345-192.168.202.48@tcp:34:lfs.0 Request processed in 578us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952083.926386:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1286 00000100:00100000:0.0:1783952083.951878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952083.952922:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447740544 00000100:00100000:3.0:1783952083.952934:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447740544 00000100:00100000:3.0:1783952083.953012:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1287 00000100:00100000:3.0:1783952083.953023:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+8:70353:x1870605447740544:12345-192.168.202.48@tcp:101:md5sum.0 00010000:00010000:3.0:1783952083.953043:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952083.953078:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb54c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a2f9 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953146:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953160:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953171:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953186:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb54d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953193:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb54d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953199:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb54d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953321:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb54db lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953329:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb54db lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953336:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb54db lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952083.953346:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00010000:00010000:3.0:1783952083.953449:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953467:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953474:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953481:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953487:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952083.953491:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953499:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953510:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:3.0:1783952083.953513:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952083.953518:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953525:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb54cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953539:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb54d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953545:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb54d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953550:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb54d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953561:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952083.953565:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb54d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953571:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb54d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953579:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff97b146f44e00) 00010000:00010000:3.0:1783952083.953581:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952083.953584:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb54d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953646:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb54d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953710:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb54c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2f9 expref: 11 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953725:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb54db lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2f9 expref: 10 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952083.953732:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d805e00) 00010000:00010000:3.0:1783952083.953735:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952083.953737:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23200, rc 0) 00000100:00100000:3.0:1783952083.953804:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:70353:x1870605447740544:12345-192.168.202.48@tcp:101:md5sum.0 Request processed in 783us (1935us total) trans 115964116993 rc 0/0 00000100:00100000:3.0:1783952083.953812:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1287 00000100:00100000:3.0:1783952083.966088:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952083.968990:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447740672 00000100:00100000:1.0:1783952083.969006:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447740672 00002000:00100000:1.0:1783952083.969065:0:24879:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff97b16e9b4380 x1870605447740672/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:344/0 lens 488/0 e 0 to 0 dl 1783952094 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952083.969076:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16e9b4380 with x1870605447740672 ext(0->32767) 00002000:00010000:1.0:1783952083.969082:0:24879:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16e9b4380 00000100:00100000:1.0:1783952083.969112:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1005 00000100:00100000:1.0:1783952083.969121:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447740672:12345-192.168.202.48@tcp:3:md5sum.0 00000100:00100000:1.0:1783952083.972666:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447740672:12345-192.168.202.48@tcp:3:md5sum.0 Request processed in 3536us (6577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952083.972679:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1005 00002000:00100000:1.0:1783952083.972692:0:24879:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x722:0x0] (0->32767) req@ffff97b16e9b4380 x1870605447740672/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:344/0 lens 488/440 e 0 to 0 dl 1783952094 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952083.972716:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16e9b4380 with x1870605447740672 ext(0->32767) 00002000:00010000:1.0:1783952083.972722:0:24879:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16e9b4380 00000100:00100000:0.0:1783952083.983446:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952083.983497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952083.983974:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447740800 00000100:00100000:2.0:1783952083.983985:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447740800 00002000:00100000:2.0:1783952083.984033:0:24883:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff97b04920d880 x1870605447740800/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:344/0 lens 488/0 e 0 to 0 dl 1783952094 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952083.984057:0:24883:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b04920d880 with x1870605447740800 ext(32768->1048575) 00002000:00010000:2.0:1783952083.984063:0:24883:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b04920d880 00000100:00100000:2.0:1783952083.984096:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447740928 00000100:00100000:2.0:1783952083.984099:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447740928 00002000:00100000:2.0:1783952083.984117:0:24883:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff97b147743800 x1870605447740928/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:344/0 lens 488/0 e 0 to 0 dl 1783952094 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952083.984124:0:24883:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147743800 with x1870605447740928 ext(1048576->2097151) 00002000:00010000:2.0:1783952083.984127:0:24883:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97b147743800 00000100:00100000:2.0:1783952083.984154:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1006 00000100:00100000:2.0:1783952083.984163:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447740800:12345-192.168.202.48@tcp:3:md5sum.0 00000100:00100000:3.0:1783952083.984494:0:24880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1007 00000100:00100000:3.0:1783952083.984505:0:24880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447740928:12345-192.168.202.48@tcp:3:md5sum.0 00000100:00100000:2.0:1783952083.995064:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04920d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447740800:12345-192.168.202.48@tcp:3:md5sum.0 Request processed in 10891us (11618us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952083.995079:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1006 00002000:00100000:2.0:1783952083.995092:0:24883:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x722:0x0] (32768->1048575) req@ffff97b04920d880 x1870605447740800/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:344/0 lens 488/440 e 0 to 0 dl 1783952094 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952083.995102:0:24883:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b04920d880 with x1870605447740800 ext(32768->1048575) 00002000:00010000:2.0:1783952083.995108:0:24883:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b04920d880 00000100:00100000:2.0:1783952084.022894:0:24880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:458183b2-4c6d-478c-9fed-a955779e6611+6:2401:x1870605447740928:12345-192.168.202.48@tcp:3:md5sum.0 Request processed in 38380us (39385us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1783952084.022908:0:24880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1007 00002000:00100000:2.0:1783952084.022921:0:24880:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x722:0x0] (1048576->2097151) req@ffff97b147743800 x1870605447740928/t0(0) o3->458183b2-4c6d-478c-9fed-a955779e6611@192.168.202.48@tcp:344/0 lens 488/440 e 0 to 0 dl 1783952094 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952084.022962:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147743800 with x1870605447740928 ext(1048576->2097151) 00002000:00010000:2.0:1783952084.022970:0:24880:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97b147743800 00000100:00100000:3.0:1783952084.040288:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952084.042104:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447741184 00000100:00100000:0.0:1783952084.042119:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447741184 00000100:00100000:0.0:1783952084.042214:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 230 00000100:00100000:0.0:1783952084.042226:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:70353:x1870605447741184:12345-192.168.202.48@tcp:35:md5sum.0 00000001:00080000:0.0:1783952084.042500:0:66239:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 115964116994 00000100:00100000:0.0:1783952084.043019:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:458183b2-4c6d-478c-9fed-a955779e6611+12:70353:x1870605447741184:12345-192.168.202.48@tcp:35:md5sum.0 Request processed in 793us (2737us total) trans 115964116995 rc 0/0 00000100:00100000:0.0:1783952084.043027:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 230 00000020:00080000:0.0:1783952084.043032:0:66239:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783952084.066006:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465500928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783952084.066085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952084.066467:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465500928 00000100:00100000:0.0:1783952084.066476:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465500928 00000100:00100000:0.0:1783952084.066549:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1783952084.066558:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465500928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783952084.066615:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783952084.066682:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465500928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952084.066705:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1783952084.066754:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465500928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952084.067614:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465501440:0@lo:400:kworker.0 00000100:00100000:1.0:1783952084.067667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952084.067689:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465501952:0@lo:400:kworker.0 00000100:00100000:1.0:1783952084.067714:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952084.067732:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465502464:0@lo:400:kworker.0 00000100:00100000:1.0:1783952084.067752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952084.067770:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783952084.067775:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465501312:0@lo:400:kworker.0 00000100:00100000:1.0:1783952084.067795:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952084.067809:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465501824:0@lo:400:kworker.0 00000100:00100000:1.0:1783952084.067840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952084.067853:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465502336:0@lo:400:kworker.0 00000100:00100000:1.0:1783952084.067871:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952084.067897:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465501952 00000100:00100000:1.0:1783952084.067902:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465501952 00000100:00100000:1.0:1783952084.067936:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465501824 00000100:00100000:1.0:1783952084.067938:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465501824 00000100:00100000:1.0:1783952084.067952:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465502336 00000100:00100000:1.0:1783952084.068203:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465502336 00000100:00100000:1.0:1783952084.068238:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00100000:1.0:1783952084.068246:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465501952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952084.068303:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465501952:12345-0@lo:400:kworker.0 Request processed in 58us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952084.068324:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00100000:1.0:1783952084.068340:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00100000:1.0:1783952084.068347:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465501824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952084.068466:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465501824:12345-0@lo:400:kworker.0 Request processed in 119us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952084.068472:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00100000:1.0:1783952084.068485:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772 00000100:00100000:1.0:1783952084.068491:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465502336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952084.068570:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465502336:12345-0@lo:400:kworker.0 Request processed in 80us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952084.068577:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772 00000100:00080000:1.0:1783952084.068631:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952084.068635:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952084.068738:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465501184:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.068772:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952084.068794:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465501696:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.068817:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952084.068847:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465502208:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.068868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952084.068889:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783952084.068896:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465501056:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.068921:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952084.068947:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465501568:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.068981:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952084.068998:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465502080:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069019:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952084.069048:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465501056 00000100:00100000:2.0:1783952084.069053:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465501056 00000100:00100000:2.0:1783952084.069081:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783952084.069088:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465501056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069122:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465501056:12345-0@lo:400:kworker.0 Request processed in 34us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952084.069140:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783952084.069170:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465501440 00000100:00100000:2.0:1783952084.069174:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465501440 00000100:00100000:2.0:1783952084.069195:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465502464 00000100:00100000:2.0:1783952084.069198:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465502464 00000100:00100000:2.0:1783952084.069208:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465501312 00000100:00100000:2.0:1783952084.069211:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465501312 00000100:00100000:2.0:1783952084.069223:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465501184 00000100:00100000:2.0:1783952084.069225:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465501184 00000100:00100000:2.0:1783952084.069236:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465501568 00000100:00100000:2.0:1783952084.069238:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465501568 00000100:00100000:2.0:1783952084.069249:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465502080 00000100:00100000:2.0:1783952084.069252:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465502080 00000100:00100000:2.0:1783952084.069276:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:2.0:1783952084.069282:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465501440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069314:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465501440:12345-0@lo:400:kworker.0 Request processed in 32us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952084.069320:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:2.0:1783952084.069332:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1783952084.069339:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465502464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069366:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465502464:12345-0@lo:400:kworker.0 Request processed in 28us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952084.069372:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1783952084.069384:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1783952084.069400:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465501312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069427:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465501312:12345-0@lo:400:kworker.0 Request processed in 39us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952084.069433:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1783952084.069452:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:2.0:1783952084.069458:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465501184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069486:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465501184:12345-0@lo:400:kworker.0 Request processed in 28us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952084.069491:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:2.0:1783952084.069504:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:2.0:1783952084.069526:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465501568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069554:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465501568:12345-0@lo:400:kworker.0 Request processed in 31us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952084.069560:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:2.0:1783952084.069571:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1783952084.069577:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465502080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069648:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465502080:12345-0@lo:400:kworker.0 Request processed in 60us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952084.069654:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1783952084.069688:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465501056:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069699:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465501568:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069708:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465502080:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069717:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465501184:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069800:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465501312:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069812:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465501824:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069823:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465502336:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069847:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465501440:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069858:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465501952:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069873:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465502464:0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069912:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465502208 00000100:00100000:2.0:1783952084.069916:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465502208 00000100:00100000:2.0:1783952084.069945:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773 00000100:00100000:2.0:1783952084.069951:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465502208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952084.069988:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465502208:12345-0@lo:400:kworker.0 Request processed in 37us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952084.069995:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773 00000100:00100000:2.0:1783952084.070023:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465502208:0@lo:400:kworker.0 00000100:00080000:1.0:1783952084.070600:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952084.070603:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952084.070606:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952084.071004:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465501696 00000100:00100000:3.0:1783952084.071011:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465501696 00000100:00100000:3.0:1783952084.071060:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:3.0:1783952084.071069:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1466b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465501696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952084.071135:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1466b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465501696:12345-0@lo:400:kworker.0 Request processed in 67us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952084.071141:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00100000:3.0:1783952084.071180:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465501696:0@lo:400:kworker.0 00000100:00100000:3.0:1783952084.075531:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952084.075556:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465502592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952084.075662:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952084.076153:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465502592 00000100:00100000:1.0:1783952084.076161:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465502592 00000100:00100000:1.0:1783952084.076206:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:1.0:1783952084.076215:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465502592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783952084.076275:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:1.0:1783952084.076337:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465502592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952084.076345:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:3.0:1783952084.076705:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465502592:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783952084.512848:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952084.576934:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783952084.576972:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465502720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952084.577063:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952084.577191:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465502720 00000100:00100000:0.0:1783952084.577200:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465502720 00000100:00100000:0.0:1783952084.577289:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:0.0:1783952084.577299:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465502720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783952084.577324:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952084.577370:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465502720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952084.577377:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00100000:1.0:1783952084.577667:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465502720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952084.577814:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952084.578125:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465502848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952084.578312:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952084.578412:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465502848 00000100:00100000:3.0:1783952084.578418:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465502848 00000100:00100000:3.0:1783952084.578491:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:3.0:1783952084.578499:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465502848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952084.578515:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952084.578563:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465502848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952084.578571:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:1.0:1783952084.578638:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465502848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952085.489741:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952085.489783:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952085.489810:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952085.489833:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952085.489856:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952085.489882:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447741312 00000100:00100000:1.0:1783952085.489892:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447741312 00000100:00100000:1.0:1783952085.489952:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:1.0:1783952085.489962:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447741312:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952085.490032:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2400:x1870605447741312:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952085.490038:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:2.0:1783952085.490471:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447741440 00000100:00100000:2.0:1783952085.490476:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447741440 00000100:00100000:2.0:1783952085.490529:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447741568 00000100:00100000:2.0:1783952085.490532:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447741568 00000100:00100000:2.0:1783952085.490556:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1289 00000100:00100000:2.0:1783952085.490564:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+12:2400:x1870605447741440:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952085.490644:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+12:2400:x1870605447741440:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 81us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952085.490651:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1289 00000100:00100000:2.0:1783952085.490671:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1290 00000100:00100000:2.0:1783952085.490677:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447741568:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952085.490704:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447741568:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952085.490726:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1290 00000100:00100000:2.0:1783952085.490747:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447741696 00000100:00100000:2.0:1783952085.490751:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447741696 00000100:00100000:2.0:1783952085.490776:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447741824 00000100:00100000:2.0:1783952085.490779:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447741824 00000100:00100000:2.0:1783952085.490800:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2774 00000100:00100000:2.0:1783952085.490806:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447741696:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952085.490834:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:458183b2-4c6d-478c-9fed-a955779e6611+7:2400:x1870605447741696:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952085.490840:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2774 00000100:00100000:2.0:1783952085.490853:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2775 00000100:00100000:2.0:1783952085.490859:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447741824:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952085.490883:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:2400:x1870605447741824:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952085.490888:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2775 00000100:00080000:1.0:1783952085.491684:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952085.491690:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952085.491694:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952085.491696:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783952085.548497:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952086.560825:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952086.625118:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465502976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952086.625191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952086.625456:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465502976 00000100:00100000:2.0:1783952086.625464:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465502976 00000100:00100000:2.0:1783952086.625541:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:2.0:1783952086.625552:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465502976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952086.625585:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783952086.625757:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952086.625985:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465502976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 434us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952086.625992:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:1.0:1783952086.626078:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465502976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952086.626343:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465503104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952086.626390:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952086.626544:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465503104 00000100:00100000:3.0:1783952086.626550:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465503104 00000100:00100000:3.0:1783952086.626636:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:3.0:1783952086.626645:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465503104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783952086.626668:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952086.626712:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465503104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952086.626719:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00100000:3.0:1783952086.626751:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465503104:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783952086.627120:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783952087.586904:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952088.609912:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952089.185006:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465503232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952089.185098:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.185371:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465503360:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.185409:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.185444:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465503872:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.185469:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.185488:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465504384:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.185509:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.185528:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783952089.185534:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465503488:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.185556:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.185571:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465504000:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.185626:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.185644:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465504512:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.185665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.185693:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465503872 00000100:00100000:2.0:1783952089.185700:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465503872 00000100:00100000:2.0:1783952089.185748:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465503488 00000100:00100000:2.0:1783952089.185751:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465503488 00000100:00100000:2.0:1783952089.185773:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1783952089.185780:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465503872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.185830:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465503872:12345-0@lo:400:kworker.0 Request processed in 50us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.185837:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1783952089.185853:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1783952089.185858:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465503488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.185897:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465503488:12345-0@lo:400:kworker.0 Request processed in 39us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.185904:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1783952089.185935:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465503232 00000100:00100000:2.0:1783952089.185939:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465503232 00000100:00100000:2.0:1783952089.185960:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465504384 00000100:00100000:2.0:1783952089.185963:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465504384 00000100:00100000:2.0:1783952089.185981:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:2.0:1783952089.185986:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465503232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952089.186013:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1783952089.186049:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465503232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.186055:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000100:00100000:2.0:1783952089.186066:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:2.0:1783952089.186072:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465504384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186099:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465504384:12345-0@lo:400:kworker.0 Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.186105:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:2.0:1783952089.186123:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465504000 00000100:00100000:2.0:1783952089.186127:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465504000 00000100:00100000:2.0:1783952089.186149:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465504512 00000100:00100000:2.0:1783952089.186152:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465504512 00000100:00100000:2.0:1783952089.186169:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776 00000100:00100000:2.0:1783952089.186175:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465504000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186204:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465504000:12345-0@lo:400:kworker.0 Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.186220:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776 00000100:00100000:2.0:1783952089.186240:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:2.0:1783952089.186246:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465504512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186278:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465504512:12345-0@lo:400:kworker.0 Request processed in 32us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.186284:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00100000:2.0:1783952089.186317:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465503744:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186342:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.186359:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465504256:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186379:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.186395:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465504768:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186415:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.186450:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465503232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952089.186467:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783952089.186472:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465503616:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186494:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.186510:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465504128:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186531:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.186547:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465504640:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186567:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952089.186614:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465503744 00000100:00100000:2.0:1783952089.186618:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465503744 00000100:00100000:2.0:1783952089.186643:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465504256 00000100:00100000:2.0:1783952089.186646:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465504256 00000100:00100000:2.0:1783952089.186657:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465504768 00000100:00100000:2.0:1783952089.186659:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465504768 00000100:00100000:2.0:1783952089.186668:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465503616 00000100:00100000:2.0:1783952089.186676:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465503616 00000100:00100000:2.0:1783952089.186696:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1783952089.186701:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465503744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186737:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465503744:12345-0@lo:400:kworker.0 Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.186743:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1783952089.186755:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:2.0:1783952089.186761:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465504256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186787:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465504256:12345-0@lo:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.186793:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:2.0:1783952089.186804:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1783952089.186809:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465504768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186836:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465504768:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.186841:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1783952089.186852:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1783952089.186857:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465503616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186879:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465503616:12345-0@lo:400:kworker.0 Request processed in 23us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.186884:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1783952089.186903:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465504128 00000100:00100000:2.0:1783952089.186905:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465504128 00000100:00100000:2.0:1783952089.186924:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465504640 00000100:00100000:2.0:1783952089.186927:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465504640 00000100:00100000:2.0:1783952089.186940:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:2.0:1783952089.186945:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465504128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.186982:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465504128:12345-0@lo:400:kworker.0 Request processed in 35us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.186988:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:2.0:1783952089.186999:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:2.0:1783952089.187004:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465504640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187029:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465504640:12345-0@lo:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952089.187035:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00100000:2.0:1783952089.187072:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465503488:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187082:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465504000:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187091:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465504512:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187100:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465503872:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187108:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465504384:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187145:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465503616:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187153:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465504128:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187161:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465504640:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187169:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465503744:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187177:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465504256:0@lo:400:kworker.0 00000100:00100000:2.0:1783952089.187186:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465504768:0@lo:400:kworker.0 00000100:00100000:3.0:1783952089.187367:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465503360 00000100:00100000:3.0:1783952089.187372:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465503360 00000100:00100000:3.0:1783952089.187406:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783952089.187413:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465503360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952089.187453:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465503360:12345-0@lo:400:kworker.0 Request processed in 41us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952089.187458:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783952089.187496:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465503360:0@lo:400:kworker.0 00000100:00080000:1.0:1783952089.187578:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952089.187583:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952089.187615:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783952089.187618:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952089.188103:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465504896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952089.188140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952089.188233:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465504896 00000100:00100000:0.0:1783952089.188239:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465504896 00000100:00100000:0.0:1783952089.188279:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:0.0:1783952089.188288:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465504896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783952089.188315:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445523456 avail 1299283968 00000100:00100000:0.0:1783952089.188366:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465504896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952089.188372:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:3.0:1783952089.188442:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465504896:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783952089.634558:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952089.697156:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465505152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952089.697266:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952089.697375:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465505152 00000100:00100000:3.0:1783952089.697384:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465505152 00000100:00100000:3.0:1783952089.697443:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:3.0:1783952089.697453:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465505152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952089.697484:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952089.697538:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465505152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952089.697557:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:3.0:1783952089.697629:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465505152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952089.697737:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465505024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952089.697772:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952089.697857:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465505024 00000100:00100000:0.0:1783952089.697861:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465505024 00000100:00100000:0.0:1783952089.697902:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:0.0:1783952089.697909:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465505024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783952089.697927:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952089.697967:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465505024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952089.697973:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00100000:2.0:1783952089.698062:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465505024:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1783952090.218796:0:91045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00000100:00100000:1.0:1783952090.610542:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952090.610677:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447741952 00000100:00100000:1.0:1783952090.610681:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952090.610687:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447741952 00000100:00100000:1.0:1783952090.610712:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952090.610732:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952090.610736:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:0.0:1783952090.610745:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447741952:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952090.610756:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952090.610775:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447742208 00000100:00100000:1.0:1783952090.610779:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447742208 00000100:00100000:1.0:1783952090.610815:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447742080 00000100:00100000:1.0:1783952090.610819:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447742080 00000100:00100000:0.0:1783952090.610837:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2398:x1870605447741952:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952090.610841:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1297 00000100:00100000:0.0:1783952090.610844:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:1.0:1783952090.610847:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447742208:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952090.610878:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447742208:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952090.610884:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1297 00000100:00100000:1.0:1783952090.610896:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1298 00000100:00100000:1.0:1783952090.610902:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:2398:x1870605447742080:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952090.610927:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:2398:x1870605447742080:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952090.610933:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1298 00000100:00100000:1.0:1783952090.610964:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447742464 00000100:00100000:1.0:1783952090.610968:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447742464 00000100:00100000:1.0:1783952090.610994:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447742336 00000100:00100000:1.0:1783952090.610997:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447742336 00000100:00100000:1.0:1783952090.611015:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2780 00000100:00100000:1.0:1783952090.611021:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447742464:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952090.611048:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:458183b2-4c6d-478c-9fed-a955779e6611+6:2398:x1870605447742464:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952090.611054:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2780 00000100:00100000:1.0:1783952090.611065:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2781 00000100:00100000:1.0:1783952090.611071:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447742336:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952090.611095:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:458183b2-4c6d-478c-9fed-a955779e6611+7:2398:x1870605447742336:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952090.611102:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2781 00000100:00080000:1.0:1783952090.611123:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952090.611126:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952090.611129:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783952090.611131:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783952090.664431:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952091.684479:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952091.744854:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952091.744880:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465505280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952091.744949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952091.745050:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465505280 00000100:00100000:3.0:1783952091.745060:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465505280 00000100:00100000:3.0:1783952091.745135:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:3.0:1783952091.745145:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465505280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783952091.745179:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952091.745238:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465505280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952091.745245:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00100000:3.0:1783952091.745307:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465505280:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783952091.745373:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952091.745686:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465505408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952091.745720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952091.745801:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465505408 00000100:00100000:0.0:1783952091.745806:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465505408 00000100:00100000:0.0:1783952091.745847:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1783952091.745855:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465505408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952091.745874:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952091.745909:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465505408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952091.745916:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00080000:1.0:1783952091.746042:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952091.746067:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465505408:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783952092.710539:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783952093.431844:0:91873:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 10:14:52 (1783952092) 00000100:00100000:1.0:1783952093.560727:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952093.561208:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447742720 00000100:00100000:2.0:1783952093.561229:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447742720 00000100:00100000:2.0:1783952093.561299:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1288 00000100:00100000:2.0:1783952093.561309:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+6:70930:x1870605447742720:12345-192.168.202.48@tcp:36:mkdir.0 00000100:00100000:2.0:1783952093.561427:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:68591:1870605465505536:0@lo:900:mdt00_004.0 00000100:00100000:2.0:1783952093.561482:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952093.561510:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952093.561529:0:66261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465505536 00000100:00100000:2.0:1783952093.561533:0:66261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465505536 00000100:00100000:2.0:1783952093.561562:0:66261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783952093.561568:0:66261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1434ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:68591:x1870605465505536:12345-0@lo:900:mdt00_004.0 00000100:00100000:2.0:1783952093.561646:0:66261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1434ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:68591:x1870605465505536:12345-0@lo:900:mdt00_004.0 Request processed in 78us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952093.561654:0:66261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783952093.561736:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:68591:1870605465505536:0@lo:900:mdt00_004.0 00000100:00100000:2.0:1783952093.561793:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465505664:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783952093.561823:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952093.561838:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42b40 going to sleep for 11 seconds 00000100:00080000:1.0:1783952093.562107:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952093.562121:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465505664 00000100:00100000:1.0:1783952093.562125:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465505664 00000100:00100000:1.0:1783952093.562179:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:1.0:1783952093.562193:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:68591:x1870605465505664:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.562264:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:68591:x1870605465505664:12345-0@lo:1000:mdt00_004.0 Request processed in 73us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.562271:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:1.0:1783952093.562296:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465505664:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.562352:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465505792:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.562379:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952093.562394:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952093.562407:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465505792 00000100:00100000:1.0:1783952093.562410:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465505792 00000100:00100000:1.0:1783952093.562432:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1783952093.562438:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:68591:x1870605465505792:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.562497:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:68591:x1870605465505792:12345-0@lo:1000:mdt00_004.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.562502:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1783952093.562526:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465505792:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.562558:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465505920:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.562609:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952093.562621:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952093.562630:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465505920 00000100:00100000:1.0:1783952093.562633:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465505920 00000100:00100000:1.0:1783952093.562653:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1783952093.562659:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:68591:x1870605465505920:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.562718:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:68591:x1870605465505920:12345-0@lo:1000:mdt00_004.0 Request processed in 59us (109us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783952093.562733:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1783952093.562761:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465505920:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1783952093.562809:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.562818:0:68591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.562829:0:68591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952093.562840:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506048:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1783952093.562867:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952093.562891:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952093.563320:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465506048 00000100:00100000:2.0:1783952093.563324:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465506048 00000100:00100000:2.0:1783952093.563359:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:2.0:1783952093.563366:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:68591:x1870605465506048:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1783952093.563382:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952093.563398:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb54f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb54e9 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.563423:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2e4 expref: 8 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.563434:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb54f0 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb54e9 expref: 7 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.563457:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2e4 expref: 8 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.563469:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2e4 expref: 8 pid: 83761 timeout: 3908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952093.563481:0:8444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8444:1870605465506176:192.168.202.48@tcp:104: 00000100:00100000:2.0:1783952093.563538:0:8444:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1472d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952093.573373:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952093.573665:0:8444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8444:1870605465506176:192.168.202.48@tcp:104: 00010000:00010000:2.0:1783952093.573696:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb54f0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb54e9 expref: 7 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.573710:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:2.0:1783952093.573713:0:8444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952093.573716:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb54f0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb54e9 expref: 7 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.573740:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86aa00, rc 0) 00000100:00100000:2.0:1783952093.573803:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68591:x1870605465506048:12345-0@lo:101:mdt00_004.0 Request processed in 10436us (10934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952093.573812:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:1.0:1783952093.573909:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447742848 00000100:00100000:1.0:1783952093.573916:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447742848 00010000:00010000:1.0:1783952093.573967:0:22092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2e4 expref: 9 pid: 83761 timeout: 3908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952093.573999:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2550 00000100:00100000:1.0:1783952093.574008:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:458183b2-4c6d-478c-9fed-a955779e6611+9:2400:x1870605447742848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783952093.574024:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952093.574031:0:22092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2e4 expref: 9 pid: 83761 timeout: 3908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574042:0:22092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2e4 expref: 9 pid: 83761 timeout: 3908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574081:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd600/0x22c73c7857bb546b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2e4 expref: 9 pid: 83761 timeout: 3908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574094:0:22092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:1.0:1783952093.574098:0:22092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb54f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb54e9 expref: 6 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574107:0:22092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb54f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22c73c7857bb54e9 expref: 6 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574114:0:22092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb54f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22c73c7857bb54e9 expref: 6 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574160:0:22092:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb54f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb54e9 expref: 6 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952093.574182:0:22092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:22092:1870605465506304:0@lo:105: 00000100:00100000:1.0:1783952093.574363:0:22092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952093.574399:0:22092:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952093.574419:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465506304 00000100:00100000:1.0:1783952093.574422:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465506304 00000100:00100000:1.0:1783952093.574450:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1783952093.574457:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:22092:x1870605465506304:12345-0@lo:105: 00010000:00010000:1.0:1783952093.574469:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574477:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574491:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574498:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574504:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574512:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.574524:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff97b1762aee00) 00000100:00100000:1.0:1783952093.574560:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:22092:x1870605465506304:12345-0@lo:105: Request processed in 103us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.574567:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1783952093.574622:0:22092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:22092:1870605465506304:0@lo:105: 00010000:00010000:1.0:1783952093.574632:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952093.574665:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:2400:x1870605447742848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 659us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.574671:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2550 00000100:00080000:2.0:1783952093.574982:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952093.575666:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506048:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1783952093.575686:0:68591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783952093.575709:0:68591:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783952093.575750:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.575757:0:68591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.575766:0:68591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952093.575793:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506432:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1783952093.575837:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952093.575868:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783952093.577544:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465506432 00000100:00100000:1.0:1783952093.577554:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465506432 00000100:00100000:1.0:1783952093.577636:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:1.0:1783952093.577645:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:68591:x1870605465506432:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1783952093.577664:0:23862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952093.577695:0:23862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af000/0x22c73c7857bb54fe lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb54f7 expref: -99 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.577722:0:23862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af000/0x22c73c7857bb54fe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb54f7 expref: 8 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.577735:0:23862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af000/0x22c73c7857bb54fe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb54f7 expref: 8 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.577744:0:23862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff97b14531c500) 00010000:00010000:1.0:1783952093.577747:0:23862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952093.577751:0:23862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af000, rc 0) 00000100:00100000:1.0:1783952093.577809:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68591:x1870605465506432:12345-0@lo:101:mdt00_004.0 Request processed in 166us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.577815:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:3.0:1783952093.579518:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506432:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1783952093.579546:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.579559:0:68591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783952093.579582:0:68591:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1783952093.579658:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506560:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.579714:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952093.579753:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1783952093.579759:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465506560 00000100:00100000:1.0:1783952093.579766:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465506560 00000100:00100000:1.0:1783952093.579814:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:1.0:1783952093.579823:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68591:x1870605465506560:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.579918:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68591:x1870605465506560:12345-0@lo:1000:mdt00_004.0 Request processed in 97us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.579924:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:3.0:1783952093.580048:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506560:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.580085:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506688:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.580108:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952093.580132:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1783952093.580477:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465506688 00000100:00100000:1.0:1783952093.580483:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465506688 00000100:00100000:1.0:1783952093.580522:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:1.0:1783952093.580528:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68591:x1870605465506688:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.580641:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68591:x1870605465506688:12345-0@lo:1000:mdt00_004.0 Request processed in 113us (531us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783952093.580661:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000100:00100000:1.0:1783952093.580698:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506688:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.580773:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506816:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952093.580802:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952093.580816:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7300 going to sleep for 11 seconds 00000100:00100000:1.0:1783952093.580828:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465506816 00000100:00100000:1.0:1783952093.580832:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465506816 00000100:00100000:1.0:1783952093.580854:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:1.0:1783952093.580860:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68591:x1870605465506816:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.581317:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506816:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.581383:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506944:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.581412:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952093.581428:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952093.581442:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465506944 00000100:00100000:3.0:1783952093.581445:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465506944 00000100:00100000:3.0:1783952093.581475:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1783952093.581481:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68591:x1870605465506944:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.581530:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68591:x1870605465506944:12345-0@lo:1000:mdt00_004.0 Request processed in 49us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952093.581536:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1783952093.581559:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465506944:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.581619:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465507072:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.581642:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952093.581656:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952093.581666:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465507072 00000100:00100000:3.0:1783952093.581670:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465507072 00000100:00100000:3.0:1783952093.581688:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:3.0:1783952093.581695:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68591:x1870605465507072:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.581755:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68591:x1870605465507072:12345-0@lo:1000:mdt00_004.0 Request processed in 61us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952093.581762:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:3.0:1783952093.581786:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465507072:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.581824:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465507200:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.581848:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952093.581862:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952093.581886:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465507200 00000100:00100000:3.0:1783952093.581890:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465507200 00000100:00100000:3.0:1783952093.581906:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:3.0:1783952093.581912:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68591:x1870605465507200:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952093.581970:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:68591:x1870605465507200:12345-0@lo:1000:mdt00_004.0 Request processed in 57us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952093.581983:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:3.0:1783952093.582011:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:68591:1870605465507200:0@lo:1000:mdt00_004.0 00000040:00080000:3.0:1783952093.582827:0:68591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].3, 1000 off38072 00000100:00100000:1.0:1783952093.582985:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:68591:x1870605465506816:12345-0@lo:1000:mdt00_004.0 Request processed in 2122us (2180us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783952093.582993:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000040:00080000:3.0:1783952093.583676:0:68591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x6:0x0].2, 1152 off36272 00000004:00080000:3.0:1783952093.583685:0:68591:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97b1742c7900 with version 12 00000004:00080000:2.0:1783952093.584005:0:75700:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97b1748af6c0 version 12 rpc_version 12 00000020:00100000:2.0:1783952093.584037:0:75700:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783952093.584046:0:75700:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97b16e9b7800 x1870605465507456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952093.584068:0:75700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465507456:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783952093.584123:0:75700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952093.584748:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1472d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952093.585018:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465507456 00000100:00100000:3.0:1783952093.585026:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465507456 00000100:00100000:3.0:1783952093.585079:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:3.0:1783952093.585087:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75700:x1870605465507456:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783952093.595458:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75700:x1870605465507456:12345-0@lo:1000:osp_up0-1.0 Request processed in 10362us (11325us total) trans 115964116996 rc 0/0 00000100:00100000:3.0:1783952093.595475:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:2.0:1783952093.599805:0:75700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465507456:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783952093.599998:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.600016:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.600029:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952093.600049:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095466c9e reply state 00000000d4a31eb6 transno 77309411438 ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.600060:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.600067:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:3.0:1783952093.600079:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952093.600083:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783952093.600090:0:68591:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00000004:00080000:3.0:1783952093.600102:0:68591:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783952093.600112:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.600120:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.600127:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.600285:0:68591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783952093.600293:0:68591:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783952093.600299:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.600307:0:68591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.600379:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952093.600393:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.600400:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aee00 already unused, calling callback (ffffffffc19c9ed0) 00010000:00010000:0.0:1783952093.600405:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952093.600413:0:6506:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952093.600423:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:458183b2-4c6d-478c-9fed-a955779e6611+8:70930:x1870605447742720:12345-192.168.202.48@tcp:36:mkdir.0 Request processed in 39113us (39704us total) trans 77309411438 rc 0/0 00000100:00100000:3.0:1783952093.600431:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1288 00010000:00010000:0.0:1783952093.600444:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.600450:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952093.600470:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.600478:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b1762aee00/0x22c73c7857bb54e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb54f0 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.600494:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952093.600496:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952093.600497:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952093.600511:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465507584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952093.600560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952093.604916:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465507584 00000100:00100000:2.0:1783952093.604932:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465507584 00000100:00100000:2.0:1783952093.604998:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1783952093.605008:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1870605465507584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952093.605024:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952093.605050:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb54f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb54e9 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.605069:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b15f403a00) 00010000:00010000:2.0:1783952093.605080:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952093.605160:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3645:x1870605465507584:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (4599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952093.605191:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1783952093.606502:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465507584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952093.626161:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952093.626236:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447742976 00000100:00100000:1.0:1783952093.626246:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447742976 00000100:00100000:1.0:1783952093.626309:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1289 00000100:00100000:1.0:1783952093.626320:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+8:70935:x1870605447742976:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1783952093.626341:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952093.626367:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afe00/0x22c73c7857bb550c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a300 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.626434:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5513 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.626449:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5513 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.626460:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5513 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952093.626517:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783952093.626520:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783952093.626539:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5513 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.626563:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afe00/0x22c73c7857bb550c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a300 expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.626577:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5513 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a300 expref: 9 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.626608:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531cf00) 00010000:00010000:1.0:1783952093.626612:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783952093.626615:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762aea00, rc 0) 00000100:00100000:1.0:1783952093.626673:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:70935:x1870605447742976:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 356us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.626680:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1289 00000100:00100000:3.0:1783952093.642840:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952093.643132:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447743104 00000100:00100000:1.0:1783952093.643143:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447743104 00000100:00100000:1.0:1783952093.643217:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1290 00000100:00100000:1.0:1783952093.643227:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+9:70935:x1870605447743104:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1783952093.643247:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952093.643266:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afe00/0x22c73c7857bb551a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a307 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.643324:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.643347:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.643357:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.643367:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.643376:0:66237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af000/0x22c73c7857bb54fe lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb54f7 expref: 7 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.643383:0:66237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.643414:0:66237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af000/0x22c73c7857bb54fe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb54f7 expref: 7 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952093.643428:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050d2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66237:1870605465507712:0@lo:104: 00000100:00100000:1.0:1783952093.643478:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952093.643519:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952093.643692:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465507712 00000100:00100000:3.0:1783952093.643697:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465507712 00000100:00100000:3.0:1783952093.643742:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783952093.643749:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66237:x1870605465507712:12345-0@lo:104: 00010000:00010000:3.0:1783952093.643762:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.643813:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783952093.643820:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66237:x1870605465507712:12345-0@lo:104: Request processed in 72us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952093.643826:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00010000:3.0:1783952093.643845:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783952093.643847:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050d2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66237:1870605465507712:0@lo:104: 00010000:00010000:3.0:1783952093.643851:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.643859:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ae00 already unused, calling callback (ffffffffc19c9ed0) 00010000:00010000:3.0:1783952093.643865:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.643865:0:66237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952093.643874:0:15262:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.643904:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.643910:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952093.643939:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.643947:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b18216ae00/0x22c73c7857bb54f7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb54fe expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952093.643967:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465507840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952093.643976:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952093.643978:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952093.643980:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952093.643995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952093.644077:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465507840 00000100:00100000:3.0:1783952093.644082:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465507840 00010000:00010000:3.0:1783952093.644097:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af000/0x22c73c7857bb54fe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22c73c7857bb54f7 expref: 8 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952093.644128:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1783952093.644135:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3642:x1870605465507840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952093.644143:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1783952093.647206:0:91045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116996 is committed 00010000:00010000:1.0:1783952093.647963:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af000/0x22c73c7857bb54fe lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb54f7 expref: 7 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.647997:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff97b14531c500) 00010000:00010000:1.0:1783952093.648002:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648011:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648019:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648055:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952093.648074:0:66237:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.648081:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952093.648134:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465507840:12345-0@lo:103:ldlm_bl.0 Request processed in 3998us (4136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.648143:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1783952093.648229:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66237:1870605465507968:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783952093.648270:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952093.648295:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952093.648489:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465507968 00000100:00100000:1.0:1783952093.648496:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465507968 00000100:00100000:1.0:1783952093.648538:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:1.0:1783952093.648546:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66237:x1870605465507968:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783952093.648634:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66237:x1870605465507968:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.648641:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:1.0:1783952093.648681:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465507840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952093.648713:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66237:1870605465507968:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783952093.648760:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb552f lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648771:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb552f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648787:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb552f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952093.648812:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb552f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648824:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648830:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648836:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648842:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648848:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aee00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952093.648853:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.648860:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649613:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531cf00) 00010000:00010000:1.0:1783952093.649619:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952093.649625:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649633:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb5521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649654:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649661:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649668:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649673:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952093.649676:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649683:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649692:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff97b14531c500) 00010000:00010000:1.0:1783952093.649695:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952093.649698:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649704:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb5528 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649747:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afe00/0x22c73c7857bb551a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a307 expref: 11 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649763:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb552f lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a307 expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.649782:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b174267e00) 00010000:00010000:1.0:1783952093.649785:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783952093.649788:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762afc00, rc 0) 00000100:00100000:1.0:1783952093.649847:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+10:70935:x1870605447743104:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6621us (7015us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.649854:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1290 00000100:00100000:0.0:1783952093.688507:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952093.689622:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447743232 00000100:00100000:3.0:1783952093.689634:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447743232 00000100:00100000:3.0:1783952093.689702:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1291 00000100:00100000:3.0:1783952093.689711:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+8:70935:x1870605447743232:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952093.689735:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952093.689754:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5536 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a30e expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.689830:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b000/0x22c73c7857bb553d lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.689844:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b000/0x22c73c7857bb553d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.689855:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b000/0x22c73c7857bb553d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952093.689899:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00000004:00200000:3.0:1783952093.689903:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783952093.689939:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5536 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a30e expref: 10 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.689970:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b000/0x22c73c7857bb553d lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a30e expref: 9 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.689978:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:3.0:1783952093.689981:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1783952093.689984:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b000, rc 0) 00000100:00100000:3.0:1783952093.690048:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+9:70935:x1870605447743232:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 339us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952093.690056:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1291 00000100:00100000:1.0:1783952093.725630:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952093.725665:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447743360 00000100:00100000:1.0:1783952093.725674:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447743360 00000100:00100000:1.0:1783952093.725731:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1292 00000100:00100000:1.0:1783952093.725742:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:70935:x1870605447743360:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1783952093.725760:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952093.725777:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afe00/0x22c73c7857bb5544 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a315 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725846:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb554b lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725858:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb554b lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725867:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb554b lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725880:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb5552 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725887:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb5552 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725901:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb5552 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725946:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb554b lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725951:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb554b lrc: 2/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725955:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb554b lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725959:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952093.725962:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb554b lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725967:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb554b lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725975:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:1.0:1783952093.725977:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952093.725980:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb554b lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725983:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb554b lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725992:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb5552 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.725996:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb5552 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.726004:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb5552 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.726007:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aee00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952093.726009:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb5552 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.726012:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb5552 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.726016:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xf7117594 (ffff97b174267500) 00010000:00010000:1.0:1783952093.726018:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952093.726019:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb5552 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.726022:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb5552 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.726047:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afe00/0x22c73c7857bb5544 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a315 expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.726054:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:1.0:1783952093.726055:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952093.726057:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afe00/0x22c73c7857bb5544 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a315 expref: 10 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.726063:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762afe00, rc 0) 00000100:00100000:1.0:1783952093.726109:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+9:70935:x1870605447743360:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 370us (488us total) trans 0 rc 301/301 00000100:00100000:1.0:1783952093.726121:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1292 00010000:00010000:1.0:1783952093.733982:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952093.734968:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952093.735044:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447743488 00000100:00100000:2.0:1783952093.735053:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447743488 00000100:00100000:2.0:1783952093.735111:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1293 00000100:00100000:2.0:1783952093.735121:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+9:70935:x1870605447743488:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783952093.735141:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952093.735507:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5559 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a31c expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735622:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735636:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735648:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735664:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a800/0x22c73c7857bb5567 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735671:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a800/0x22c73c7857bb5567 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735677:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a800/0x22c73c7857bb5567 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735723:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735730:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735748:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735754:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735760:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ac00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952093.735764:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735772:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735785:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:2.0:1783952093.735788:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952093.735792:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735797:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5560 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735810:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a800/0x22c73c7857bb5567 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735815:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a800/0x22c73c7857bb5567 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735820:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a800/0x22c73c7857bb5567 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735824:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952093.735833:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a800/0x22c73c7857bb5567 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735838:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a800/0x22c73c7857bb5567 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735847:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xf7117594 (ffff97b151a72800) 00010000:00010000:2.0:1783952093.735849:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952093.735852:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a800/0x22c73c7857bb5567 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735858:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a800/0x22c73c7857bb5567 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735893:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5559 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a31c expref: 10 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735904:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:2.0:1783952093.735906:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952093.735910:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5559 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a31c expref: 10 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.735919:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ba00, rc 0) 00000100:00100000:2.0:1783952093.735984:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:458183b2-4c6d-478c-9fed-a955779e6611+9:70935:x1870605447743488:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 864us (1022us total) trans 0 rc 301/301 00000100:00100000:2.0:1783952093.735992:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1293 00000100:00100000:1.0:1783952093.739108:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952093.739176:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447743616 00000100:00100000:3.0:1783952093.739186:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447743616 00000100:00100000:3.0:1783952093.739246:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1294 00000100:00100000:3.0:1783952093.739256:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+9:70935:x1870605447743616:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952093.739304:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952093.739326:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b200/0x22c73c7857bb556e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a323 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.739393:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5575 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.739404:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5575 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.739412:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5575 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952093.739446:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00000004:00200000:3.0:1783952093.739449:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952093.739463:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5575 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.739481:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b200/0x22c73c7857bb556e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a323 expref: 11 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.739498:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5575 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a323 expref: 10 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.739504:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:3.0:1783952093.739505:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783952093.739508:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216ae00, rc 0) 00000100:00100000:3.0:1783952093.739556:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:70935:x1870605447743616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 302us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952093.739563:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1294 00000100:00100000:1.0:1783952093.749477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952093.749668:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447743872 00000100:00100000:2.0:1783952093.749681:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447743872 00000100:00100000:2.0:1783952093.749744:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1295 00000100:00100000:2.0:1783952093.749755:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+10:70935:x1870605447743872:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783952093.749795:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952093.749820:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb557c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a32a expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952093.749938:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1783952093.750037:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb557c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a32a expref: 12 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.750049:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b151a72800) 00010000:00010000:2.0:1783952093.750051:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783952093.750055:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb557c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a32a expref: 12 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952093.750068:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ba00, rc 0) 00000100:00100000:2.0:1783952093.750127:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:458183b2-4c6d-478c-9fed-a955779e6611+11:70935:x1870605447743872:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 375us (660us total) trans 77309411439 rc 301/301 00000100:00100000:2.0:1783952093.750134:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1295 00000100:00100000:0.0:1783952093.754848:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952093.754961:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447744128 00000100:00100000:1.0:1783952093.754973:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447744128 00000100:00100000:1.0:1783952093.755032:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1296 00000100:00100000:1.0:1783952093.755042:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+11:70935:x1870605447744128:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:1.0:1783952093.755106:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952093.755136:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5575 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a323 expref: 11 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.755163:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:1.0:1783952093.755183:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952093.755360:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.755375:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.755386:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.755401:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.755408:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.755428:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756240:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756253:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756261:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952093.756275:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000010730632 reply state 00000000e4ab8e10 transno 77309411440 ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756286:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756293:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b174267f00) 00010000:00010000:1.0:1783952093.756295:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952093.756298:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783952093.756303:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1783952093.756312:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756319:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756325:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756332:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756346:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aee00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952093.756350:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756358:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756367:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:1.0:1783952093.756369:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952093.756374:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756379:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aee00/0x22c73c7857bb558a lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952093.756389:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000010730632 reply state 00000000e4ab8e10 transno 77309411440 ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756397:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.756403:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xf7117594 (ffff97b174267500) 00010000:00010000:1.0:1783952093.756405:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952093.756407:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783952093.756552:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:458183b2-4c6d-478c-9fed-a955779e6611+12:70935:x1870605447744128:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 1509us (1711us total) trans 77309411440 rc 0/0 00000100:00100000:1.0:1783952093.756562:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1296 00000100:00100000:1.0:1783952093.764362:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952093.766481:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447744384 00000100:00100000:2.0:1783952093.766492:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447744384 00000100:00100000:2.0:1783952093.766543:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 231 00000100:00100000:2.0:1783952093.766553:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:458183b2-4c6d-478c-9fed-a955779e6611+12:70935:x1870605447744384:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1783952093.766806:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:458183b2-4c6d-478c-9fed-a955779e6611+13:70935:x1870605447744384:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 252us (2453us total) trans 77309411441 rc 0/0 00000100:00100000:2.0:1783952093.766814:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 231 00000100:00100000:0.0:1783952093.818515:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952093.818562:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952093.818661:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952093.818692:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952093.818811:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447744512 00000100:00100000:3.0:1783952093.818821:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447744512 00000100:00100000:3.0:1783952093.818893:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447745024 00000100:00100000:3.0:1783952093.818896:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447745024 00000100:00100000:3.0:1783952093.818919:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447744896 00000100:00100000:3.0:1783952093.818921:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447744896 00000100:00100000:3.0:1783952093.818944:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 713 00000100:00100000:3.0:1783952093.818953:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e66faa19-2cbc-412c-8aef-9c55427739f8+12:2401:x1870605447744512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783952093.818968:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952093.818987:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb5250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2cf expref: 12 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.819003:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952093.819059:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e66faa19-2cbc-412c-8aef-9c55427739f8+11:2401:x1870605447744512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 107us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952093.819067:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 713 00000100:00100000:3.0:1783952093.819085:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 714 00000100:00100000:3.0:1783952093.819090:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e66faa19-2cbc-412c-8aef-9c55427739f8+10:2401:x1870605447745024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783952093.819099:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952093.819108:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb5257 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2d6 expref: 10 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.819116:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952093.819131:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e66faa19-2cbc-412c-8aef-9c55427739f8+9:2401:x1870605447745024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 41us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952093.819136:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 714 00000100:00100000:3.0:1783952093.819147:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 715 00000100:00100000:3.0:1783952093.819165:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1472bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e66faa19-2cbc-412c-8aef-9c55427739f8+8:2401:x1870605447744896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783952093.819198:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952093.819207:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbca00/0x22c73c7857bb5249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2c8 expref: 8 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.819216:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952093.819235:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1472bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e66faa19-2cbc-412c-8aef-9c55427739f8+7:2401:x1870605447744896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 71us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952093.819241:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 715 00000100:00100000:1.0:1783952093.820480:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447744768 00000100:00100000:1.0:1783952093.820490:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447744768 00000100:00100000:1.0:1783952093.820581:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4933 00000100:00100000:1.0:1783952093.820625:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:458183b2-4c6d-478c-9fed-a955779e6611+6:2397:x1870605447744768:12345-192.168.202.48@tcp:9:umount.0 00000020:00000080:1.0:1783952093.820655:0:26199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4e7c 00000020:00010000:1.0:1783952093.820663:0:26199:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b142e2a800: total 0 00000100:00080000:1.0:1783952093.820668:0:26199:0:(import.c:65:import_set_state_nolock()) ffff97b150d63000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783952093.820723:0:26199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968955 00000100:00100000:1.0:1783952093.820893:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:458183b2-4c6d-478c-9fed-a955779e6611+4:2397:x1870605447744768:12345-192.168.202.48@tcp:9:umount.0 Request processed in 303us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.820900:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4933 00000020:00010000:1.0:1783952093.820925:0:6506:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b142e2a800: total 0 00010000:00010000:1.0:1783952093.820949:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b142e2a800, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1783952093.820978:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1783952093.820981:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb atime from disk: 0 -> 1783952032 00002000:00010000:1.0:1783952093.820984:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x722:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1783952093.821004:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016714077/0x22c73c7857bb4fc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2a5 expref: 3 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.821028:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b142e2a800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783952093.821040:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952093.821042:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952093.821044:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783952093.821200:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783952093.821699:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952093.833802:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952093.833907:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447745408 00000100:00100000:2.0:1783952093.833930:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447745408 00000100:00100000:2.0:1783952093.834011:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4934 00000100:00100000:2.0:1783952093.834021:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+7:2397:x1870605447745408:12345-192.168.202.48@tcp:9:umount.0 00000020:00000080:2.0:1783952093.834054:0:26196:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb4e75 00000020:00010000:2.0:1783952093.834061:0:26196:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b04965f000: total 0 00000100:00080000:2.0:1783952093.834065:0:26196:0:(import.c:65:import_set_state_nolock()) ffff97b04965f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783952093.834118:0:26196:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968954 00000100:00100000:2.0:1783952093.834309:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:458183b2-4c6d-478c-9fed-a955779e6611+5:2397:x1870605447745408:12345-192.168.202.48@tcp:9:umount.0 Request processed in 289us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952093.834318:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4934 00000020:00010000:1.0:1783952093.834652:0:6505:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b04965f000: total 0 00010000:00010000:1.0:1783952093.834656:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952093.834698:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b04965f000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1783952093.834748:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c1ee931/0x22c73c7857bb4fcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2ac expref: 4 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.834803:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000319e619f/0x22c73c7857bb4fbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a29e expref: 3 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.834817:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b04965f000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1783952093.834829:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952093.834832:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952093.834833:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783952093.834842:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783952093.834897:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952093.849035:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952093.849119:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447745920 00000100:00100000:3.0:1783952093.849129:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447745920 00000100:00100000:3.0:1783952093.849217:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1297 00000100:00100000:3.0:1783952093.849229:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+10:2397:x1870605447745920:12345-192.168.202.48@tcp:39:umount.0 00000020:00000080:3.0:1783952093.849282:0:66236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb50c8 00000020:00010000:3.0:1783952093.849299:0:66236:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b17484a000: total 0 00000100:00080000:3.0:1783952093.849305:0:66236:0:(import.c:65:import_set_state_nolock()) ffff97b176bca000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783952093.849330:0:66236:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116996 00000100:00100000:3.0:1783952093.849496:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:458183b2-4c6d-478c-9fed-a955779e6611+8:2397:x1870605447745920:12345-192.168.202.48@tcp:39:umount.0 Request processed in 270us (470us total) trans 115964116997 rc 0/0 00000100:00100000:3.0:1783952093.849503:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1297 00000020:00010000:3.0:1783952093.849537:0:7459:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b17484a000: total 0 00010000:00010000:3.0:1783952093.849615:0:7459:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b17484a000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1783952093.849651:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b174267e00) 00010000:00010000:3.0:1783952093.849654:0:7459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783952093.849662:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb552f lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a307 expref: 7 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.849687:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d805e00) 00010000:00010000:3.0:1783952093.849704:0:7459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1783952093.849709:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb52b2 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a297 expref: 6 pid: 91079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.849726:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff97b04d805e00) 00010000:00010000:3.0:1783952093.849728:0:7459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952093.849732:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb54db lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2f9 expref: 5 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.849747:0:7459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14531cf00) 00010000:00010000:3.0:1783952093.849750:0:7459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783952093.849754:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5513 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a300 expref: 4 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.849768:0:7459:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b17484a000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1783952093.849784:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952093.849786:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952093.849788:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952093.849948:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952093.864229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952093.864338:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447746176 00000100:00100000:1.0:1783952093.864347:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447746176 00000100:00100000:1.0:1783952093.864409:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1298 00000100:00100000:1.0:1783952093.864419:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+13:2397:x1870605447746176:12345-192.168.202.48@tcp:39:umount.0 00000020:00000080:1.0:1783952093.864461:0:67035:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bafe18 00000020:00010000:1.0:1783952093.864476:0:67035:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b1762c0000: total 0 00000100:00080000:1.0:1783952093.864480:0:67035:0:(import.c:65:import_set_state_nolock()) ffff97b174697800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783952093.864532:0:67035:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411441 00000100:00100000:1.0:1783952093.864722:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:458183b2-4c6d-478c-9fed-a955779e6611+11:2397:x1870605447746176:12345-192.168.202.48@tcp:39:umount.0 Request processed in 304us (502us total) trans 77309411442 rc 0/0 00000100:00100000:1.0:1783952093.864731:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1298 00010000:00010000:1.0:1783952093.864765:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864775:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864802:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864808:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952093.864813:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864820:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864835:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xf7117594 (ffff97b174267500) 00010000:00010000:1.0:1783952093.864837:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952093.864842:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864849:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5591 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864882:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864889:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864894:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864899:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afa00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952093.864902:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864920:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864929:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b174267f00) 00010000:00010000:1.0:1783952093.864931:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952093.864934:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.864939:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762afa00/0x22c73c7857bb5598 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1783952093.864982:0:15262:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b1762c0000: total 0 00010000:00010000:1.0:1783952093.865029:0:15262:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b1762c0000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783952093.865052:0:15262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:1.0:1783952093.865055:0:15262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783952093.865061:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b000/0x22c73c7857bb553d lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a30e expref: 9 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.865072:0:15262:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b1762c0000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783952093.865084:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952093.865086:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952093.865088:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952093.865409:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.865418:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.865424:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.865429:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952093.865432:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.865438:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.865447:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44800) 00010000:00010000:0.0:1783952093.865450:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952093.865453:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952093.865459:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a800/0x22c73c7857bb5505 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952093.865566:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952093.925476:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952093.925570:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447746432 00000100:00100000:1.0:1783952093.925581:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447746432 00000100:00100000:1.0:1783952093.925670:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:1.0:1783952093.925681:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e66faa19-2cbc-412c-8aef-9c55427739f8+7:2397:x1870605447746432:12345-192.168.202.48@tcp:251:umount.0 00000020:00000080:1.0:1783952093.925727:0:91057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5242 00000020:00010000:1.0:1783952093.925734:0:91057:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b174b16800: total 0 00000100:00080000:1.0:1783952093.925738:0:91057:0:(import.c:65:import_set_state_nolock()) ffff97b174b12000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783952093.925818:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e66faa19-2cbc-412c-8aef-9c55427739f8+3:2397:x1870605447746432:12345-192.168.202.48@tcp:251:umount.0 Request processed in 139us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952093.925825:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 81 00000020:00010000:1.0:1783952093.925906:0:6506:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b174b16800: total 0 00010000:00010000:1.0:1783952093.925954:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b174b16800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783952093.925990:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb525e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a2dd expref: 2 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952093.926003:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b174b16800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1783952093.926015:0:6506:0:(genops.c:906:class_export_put()) final put ffff97b174b16800/e66faa19-2cbc-412c-8aef-9c55427739f8 00010000:00010000:1.0:1783952093.926025:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952093.926027:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952093.926029:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783952093.926299:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b16800/e66faa19-2cbc-412c-8aef-9c55427739f8 for MGS 00000020:00000080:2.0:1783952093.926341:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b174b12000 for MGS 00010000:00010000:0.0:1783952093.926711:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952094.305002:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952094.305024:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465508096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952094.305098:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952094.305195:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465508096 00000100:00100000:1.0:1783952094.305202:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465508096 00000100:00100000:1.0:1783952094.305271:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1783952094.305279:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465508096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783952094.305315:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00000100:00100000:1.0:1783952094.305366:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1870605465508096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952094.305372:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1783952094.305411:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116996 gen 3 00000004:00080000:1.0:1783952094.305416:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116996 committed transno 115964116996 00000100:00100000:1.0:1783952094.305446:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465508096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952094.305755:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465508224:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.305789:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.305814:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465508736:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.305838:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.305856:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465509248:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.305874:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.305891:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783952094.305895:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465508352:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.305913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.305928:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465508864:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.305964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.305980:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465509376:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.305998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.306023:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465508608:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306044:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.306061:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465509120:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306081:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.306094:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465509632:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306110:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.306127:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783952094.306132:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465508480:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306151:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.306178:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465508992:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306200:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.306214:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465509504:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.306253:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465508224 00000100:00100000:2.0:1783952094.306257:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465508224 00000100:00100000:2.0:1783952094.306289:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783952094.306296:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465508224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306332:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465508224:12345-0@lo:400:kworker.0 Request processed in 36us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.306338:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783952094.306364:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465508736 00000100:00100000:2.0:1783952094.306367:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465508736 00000100:00100000:2.0:1783952094.306405:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465508352 00000100:00100000:2.0:1783952094.306408:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465508352 00000100:00100000:2.0:1783952094.306421:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465508608 00000100:00100000:2.0:1783952094.306423:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465508608 00000100:00100000:2.0:1783952094.306432:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465509120 00000100:00100000:2.0:1783952094.306434:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465509120 00000100:00100000:2.0:1783952094.306441:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465509632 00000100:00100000:2.0:1783952094.306443:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465509632 00000100:00100000:2.0:1783952094.306451:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465508480 00000100:00100000:2.0:1783952094.306454:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465508480 00000100:00100000:2.0:1783952094.306467:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:2.0:1783952094.306472:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465508736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306506:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465508736:12345-0@lo:400:kworker.0 Request processed in 34us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.306512:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:2.0:1783952094.306526:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:2.0:1783952094.306531:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465508352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306557:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465508352:12345-0@lo:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.306563:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:2.0:1783952094.306574:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1783952094.306580:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465508608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306632:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465508608:12345-0@lo:400:kworker.0 Request processed in 53us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.306638:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1783952094.306650:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1783952094.306655:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465509120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306683:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465509120:12345-0@lo:400:kworker.0 Request processed in 29us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.306696:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1783952094.306709:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:2.0:1783952094.306714:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465509632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306741:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465509632:12345-0@lo:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.306745:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:2.0:1783952094.306754:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:2.0:1783952094.306759:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465508480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306783:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465508480:12345-0@lo:400:kworker.0 Request processed in 24us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.306788:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:2.0:1783952094.306809:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465509248 00000100:00100000:2.0:1783952094.306813:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465509248 00000100:00100000:2.0:1783952094.306835:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1783952094.306841:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465509248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.306868:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465509248:12345-0@lo:400:kworker.0 Request processed in 28us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.306874:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1783952094.306897:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465508864 00000100:00100000:2.0:1783952094.306900:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465508864 00000100:00100000:2.0:1783952094.306925:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465509376 00000100:00100000:2.0:1783952094.306927:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465509376 00000100:00100000:2.0:1783952094.306942:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465508992 00000100:00100000:2.0:1783952094.306945:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465508992 00000100:00100000:2.0:1783952094.306960:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465509504 00000100:00100000:2.0:1783952094.306963:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465509504 00000100:00100000:2.0:1783952094.306979:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:2.0:1783952094.306991:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465508864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307024:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465508864:12345-0@lo:400:kworker.0 Request processed in 33us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.307029:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000100:00100000:2.0:1783952094.307041:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783 00000100:00100000:2.0:1783952094.307047:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465509376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307072:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465509376:12345-0@lo:400:kworker.0 Request processed in 26us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.307077:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783 00000100:00100000:2.0:1783952094.307087:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2784 00000100:00100000:2.0:1783952094.307092:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465508992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307117:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465508992:12345-0@lo:400:kworker.0 Request processed in 26us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.307123:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2784 00000100:00100000:2.0:1783952094.307133:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785 00000100:00100000:2.0:1783952094.307138:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465509504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307175:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465509504:12345-0@lo:400:kworker.0 Request processed in 25us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.307181:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785 00000100:00080000:2.0:1783952094.307223:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952094.307228:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952094.307230:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783952094.307232:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952094.307270:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465508480:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307280:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465508992:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307301:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465509504:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307310:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465508608:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307318:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465509120:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307327:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465509632:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307362:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465508352:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307371:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465508864:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307380:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465509376:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307387:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465508224:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307396:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465508736:0@lo:400:kworker.0 00000100:00100000:2.0:1783952094.307404:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465509248:0@lo:400:kworker.0 00000100:00100000:1.0:1783952094.307536:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952094.307547:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465509760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952094.307580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952094.307639:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465509760 00000100:00100000:1.0:1783952094.307644:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465509760 00000100:00100000:1.0:1783952094.307670:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:1.0:1783952094.307677:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465509760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783952094.307699:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445515264 avail 1299275776 00000100:00100000:1.0:1783952094.307733:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465509760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952094.307738:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:1.0:1783952094.307769:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465509760:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783952094.760762:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952094.818104:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952094.818127:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465509888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952094.818201:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952094.818261:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465509888 00000100:00100000:0.0:1783952094.818268:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465509888 00000100:00100000:0.0:1783952094.818312:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:0.0:1783952094.818320:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465509888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783952094.818349:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952094.818392:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465509888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952094.818399:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00100000:0.0:1783952094.818448:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465509888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952094.821768:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465510016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952094.821834:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952094.821886:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465510016 00000100:00100000:2.0:1783952094.821893:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465510016 00000100:00100000:2.0:1783952094.821934:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:2.0:1783952094.821941:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465510016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783952094.821973:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952094.822014:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465510016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952094.822020:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:2.0:1783952094.822064:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465510016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952095.150281:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952095.154997:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447746560 00000100:00100000:2.0:1783952095.155011:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447746560 00000100:00100000:0.0:1783952095.155464:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:0.0:1783952095.155475:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2397:x1870605447746560:12345-192.168.202.48@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783952095.155509:0:91055:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp t0 exp 0000000000000000 cur 3810 last 0 00000020:00000080:0.0:1783952095.155539:0:91055:0:(genops.c:1406:class_connect()) connect: client e617e28a-7c0f-459e-8765-f628898cec50, cookie 0x22c73c7857bb559f 00000100:00080000:0.0:1783952095.155629:0:91055:0:(import.c:65:import_set_state_nolock()) ffff97b0410d9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783952095.155705:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+5:2397:x1870605447746560:12345-192.168.202.48@tcp:250:mount.lustre.0 Request processed in 229us (5432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.155712:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:2.0:1783952095.185165:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952095.185344:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447746688 00000100:00100000:3.0:1783952095.185354:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447746688 00000100:00100000:3.0:1783952095.185411:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 84 00000100:00100000:3.0:1783952095.185422:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+5:70961:x1870605447746688:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783952095.185439:0:91052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952095.185458:0:91052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216b200/0x22c73c7857bb55a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a33f expref: -99 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952095.185487:0:91052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216b200/0x22c73c7857bb55a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a33f expref: 6 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952095.185517:0:91052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216b200/0x22c73c7857bb55a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a33f expref: 6 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952095.185527:0:91052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b200, rc 0) 00000100:00100000:3.0:1783952095.185691:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+6:70961:x1870605447746688:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 270us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952095.185698:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 84 00000100:00100000:2.0:1783952095.196879:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.196998:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447746816 00000100:00100000:0.0:1783952095.197009:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447746816 00000100:00100000:0.0:1783952095.197072:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:0.0:1783952095.197082:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+6:70961:x1870605447746816:12345-192.168.202.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783952095.197240:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+6:70961:x1870605447746816:12345-192.168.202.48@tcp:501:mount.lustre.0 Request processed in 159us (370us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783952095.197250:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 85 00000100:00100000:1.0:1783952095.206066:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.206186:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447746944 00000100:00100000:0.0:1783952095.206197:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447746944 00000100:00100000:0.0:1783952095.206256:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 86 00000100:00100000:0.0:1783952095.206265:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+6:70961:x1870605447746944:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783952095.206282:0:91055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952095.206301:0:91055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb55ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a346 expref: -99 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952095.206328:0:91055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb55ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a346 expref: 7 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952095.206338:0:91055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb55ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a346 expref: 7 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952095.206346:0:91055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbdc00, rc 0) 00000100:00100000:0.0:1783952095.206414:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+7:70961:x1870605447746944:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 149us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.206421:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 86 00000100:00100000:2.0:1783952095.217305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952095.217505:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447747072 00000100:00100000:1.0:1783952095.217517:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447747072 00000100:00100000:1.0:1783952095.217577:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 87 00000100:00100000:1.0:1783952095.217622:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+7:70961:x1870605447747072:12345-192.168.202.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783952095.217780:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+8:70961:x1870605447747072:12345-192.168.202.48@tcp:501:mount.lustre.0 Request processed in 195us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952095.217788:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 87 00000100:00100000:1.0:1783952095.223258:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952095.223809:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447747200 00000100:00100000:3.0:1783952095.223904:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447747200 00000100:00100000:3.0:1783952095.224180:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 88 00000100:00100000:3.0:1783952095.224193:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+8:70961:x1870605447747200:12345-192.168.202.48@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783952095.224742:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+8:70961:x1870605447747200:12345-192.168.202.48@tcp:503:mount.lustre.0 Request processed in 550us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952095.224755:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 88 00000100:00100000:2.0:1783952095.234886:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.235538:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447747328 00000100:00100000:0.0:1783952095.235556:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447747328 00000100:00100000:0.0:1783952095.235868:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 89 00000100:00100000:0.0:1783952095.235897:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+8:70980:x1870605447747328:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783952095.237097:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+8:70980:x1870605447747328:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 1211us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.237296:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 89 00000100:00100000:2.0:1783952095.282215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.283083:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447747456 00000100:00100000:0.0:1783952095.283127:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447747456 00000100:00100000:0.0:1783952095.283240:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 90 00000100:00100000:0.0:1783952095.283252:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+8:70980:x1870605447747456:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783952095.283481:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+8:70980:x1870605447747456:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 229us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.283490:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 90 00000100:00100000:1.0:1783952095.303185:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.303518:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447747584 00000100:00100000:0.0:1783952095.303533:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447747584 00000100:00100000:0.0:1783952095.303662:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 91 00000100:00100000:0.0:1783952095.303674:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+8:70980:x1870605447747584:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783952095.303886:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+8:70980:x1870605447747584:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 214us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.303894:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 91 00000100:00100000:2.0:1783952095.338266:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.338517:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447747712 00000100:00100000:0.0:1783952095.338531:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447747712 00000100:00100000:0.0:1783952095.338647:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 92 00000100:00100000:0.0:1783952095.338659:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+8:70961:x1870605447747712:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783952095.338683:0:91049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952095.338707:0:91049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb55b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a377 expref: -99 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952095.338747:0:91049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb55b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a377 expref: 9 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952095.338783:0:91049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb55b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a377 expref: 9 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952095.338795:0:91049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc200, rc 0) 00000100:00100000:0.0:1783952095.338876:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:70961:x1870605447747712:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 219us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.338884:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 92 00000100:00100000:2.0:1783952095.367861:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952095.367970:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447747840 00000100:00100000:3.0:1783952095.368048:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447747840 00000100:00100000:3.0:1783952095.368198:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 93 00000100:00100000:3.0:1783952095.368211:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+9:70961:x1870605447747840:12345-192.168.202.48@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783952095.368250:0:91057:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783952095.368284:0:91057:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783952095.368289:0:91057:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783952095.368293:0:91057:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783952095.368296:0:91057:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1783952095.368298:0:91057:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:0.0:1783952095.382480:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+9:70961:x1870605447747840:12345-192.168.202.48@tcp:256:mount.lustre.0 Request processed in 13337us (13699us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.382504:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 93 00000100:00100000:3.0:1783952095.388165:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952095.388380:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447747968 00000100:00100000:1.0:1783952095.388394:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447747968 00000100:00100000:1.0:1783952095.388519:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 94 00000100:00100000:1.0:1783952095.388532:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+9:70961:x1870605447747968:12345-192.168.202.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783952095.388555:0:91052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952095.388642:0:91052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb55bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a37e expref: -99 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952095.388684:0:91052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb55bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a37e expref: 10 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952095.388711:0:91052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb55bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a37e expref: 10 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952095.388723:0:91052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762ae800, rc 0) 00000100:00100000:1.0:1783952095.388803:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+10:70961:x1870605447747968:12345-192.168.202.48@tcp:101:mount.lustre.0 Request processed in 266us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952095.388811:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 94 00000100:00100000:2.0:1783952095.393691:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.393857:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447748096 00000100:00100000:0.0:1783952095.393870:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447748096 00000100:00100000:0.0:1783952095.393943:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 95 00000100:00100000:0.0:1783952095.393955:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:70961:x1870605447748096:12345-192.168.202.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783952095.394191:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:70961:x1870605447748096:12345-192.168.202.48@tcp:501:mount.lustre.0 Request processed in 238us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.394200:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 95 00000100:00100000:2.0:1783952095.397293:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.397467:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447748224 00000100:00100000:0.0:1783952095.397480:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447748224 00000100:00100000:0.0:1783952095.397718:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 96 00000100:00100000:0.0:1783952095.397742:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+10:70961:x1870605447748224:12345-192.168.202.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783952095.398074:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+10:70961:x1870605447748224:12345-192.168.202.48@tcp:503:mount.lustre.0 Request processed in 346us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.398083:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 96 00000100:00100000:3.0:1783952095.404904:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952095.405437:0:91052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447748352 00000100:00100000:1.0:1783952095.405452:0:91052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447748352 00000100:00100000:1.0:1783952095.405529:0:91052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 97 00000100:00100000:1.0:1783952095.405543:0:91052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+10:70985:x1870605447748352:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783952095.405796:0:91052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+10:70985:x1870605447748352:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 256us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952095.405806:0:91052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 97 00000100:00100000:3.0:1783952095.416397:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952095.416642:0:91055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447748480 00000100:00100000:2.0:1783952095.416656:0:91055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447748480 00000100:00100000:2.0:1783952095.416721:0:91055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 98 00000100:00100000:2.0:1783952095.416732:0:91055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:70985:x1870605447748480:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783952095.416958:0:91055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:70985:x1870605447748480:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 226us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952095.416967:0:91055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 98 00000100:00100000:2.0:1783952095.429802:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952095.429863:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952095.430672:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447748608 00000100:00100000:1.0:1783952095.430687:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447748608 00000100:00100000:1.0:1783952095.430784:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447748864 00000100:00100000:1.0:1783952095.430788:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447748864 00000100:00100000:1.0:1783952095.430843:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1299 00000100:00100000:0.0:1783952095.431032:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1300 00000100:00100000:0.0:1783952095.431051:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048422450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870605447748864:12345-192.168.202.48@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783952095.431512:0:66238:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp t0 exp 0000000000000000 cur 3810 last 0 00000020:00000080:0.0:1783952095.431609:0:66238:0:(genops.c:1406:class_connect()) connect: client d33551be-a709-4ba2-a74c-f4d7b53c6817, cookie 0x22c73c7857bb55c2 00000004:00100000:0.0:1783952095.431648:0:66238:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783952095.431814:0:66238:0:(import.c:65:import_set_state_nolock()) ffff97b0410de800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952095.432347:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447748608:12345-192.168.202.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783952095.432374:0:66237:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp t0 exp 0000000000000000 cur 3810 last 0 00000020:00000080:1.0:1783952095.432420:0:66237:0:(genops.c:1406:class_connect()) connect: client d33551be-a709-4ba2-a74c-f4d7b53c6817, cookie 0x22c73c7857bb55c9 00000004:00100000:1.0:1783952095.432457:0:66237:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1783952095.434053:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048422450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447748864:12345-192.168.202.48@tcp:38:mount.lustre.0 Request processed in 2990us (4177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.434070:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1300 00000100:00080000:1.0:1783952095.434512:0:66237:0:(import.c:65:import_set_state_nolock()) ffff97b04965a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952095.434577:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447748608:12345-192.168.202.48@tcp:38:mount.lustre.0 Request processed in 3722us (4788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952095.434606:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1299 00000100:00100000:3.0:1783952095.451353:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952095.451633:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447748736 00000100:00100000:2.0:1783952095.451647:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447748736 00000100:00100000:2.0:1783952095.451757:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1301 00000100:00100000:2.0:1783952095.451770:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:0:x1870605447748736:12345-192.168.202.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783952095.451825:0:67035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1783952095.452070:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:0:x1870605447748736:12345-192.168.202.48@tcp:41:mount.lustre.0 Request processed in 303us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952095.452097:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1301 00000100:00080000:1.0:1783952095.452420:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952095.455768:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952095.456077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952095.456127:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447749120 00000100:00100000:3.0:1783952095.456150:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447749120 00000100:00100000:0.0:1783952095.456176:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447748992 00000100:00100000:0.0:1783952095.456183:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447748992 00000100:00100000:3.0:1783952095.456245:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1302 00000100:00100000:3.0:1783952095.456258:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:70961:x1870605447749120:12345-192.168.202.48@tcp:41:mount.lustre.0 00000100:00080000:1.0:1783952095.456298:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1783952095.456311:0:68591:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445236736 avail 1298997248 00000100:00100000:3.0:1783952095.456408:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:70961:x1870605447749120:12345-192.168.202.48@tcp:41:mount.lustre.0 Request processed in 153us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.460821:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1303 00000100:00100000:0.0:1783952095.461727:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:0:x1870605447748992:12345-192.168.202.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783952095.461795:0:66236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:0.0:1783952095.462793:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:0:x1870605447748992:12345-192.168.202.48@tcp:41:mount.lustre.0 Request processed in 1948us (6709us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952095.462809:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1303 00000100:00100000:3.0:1783952095.472431:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1302 00000100:00100000:2.0:1783952095.479169:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952095.479394:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447749248 00000100:00100000:3.0:1783952095.479406:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447749248 00000100:00100000:3.0:1783952095.479482:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1304 00000100:00100000:3.0:1783952095.479494:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:70961:x1870605447749248:12345-192.168.202.48@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783952095.479660:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:70961:x1870605447749248:12345-192.168.202.48@tcp:40:mount.lustre.0 Request processed in 168us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952095.479668:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1304 00000100:00100000:0.0:1783952095.495556:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.495638:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.495670:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952095.495721:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952095.495913:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447749376 00000100:00100000:2.0:1783952095.495928:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447749376 00000100:00100000:2.0:1783952095.495988:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447749504 00000100:00100000:2.0:1783952095.495992:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447749504 00000100:00100000:2.0:1783952095.496015:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4935 00000100:00100000:2.0:1783952095.496025:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1870605447749376:12345-192.168.202.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783952095.496072:0:8435:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp t0 exp 0000000000000000 cur 3810 last 0 00000020:00000080:2.0:1783952095.496114:0:8435:0:(genops.c:1406:class_connect()) connect: client d33551be-a709-4ba2-a74c-f4d7b53c6817, cookie 0x22c73c7857bb55d0 00002000:00100000:2.0:1783952095.496130:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d33551be-a709-4ba2-a74c-f4d7b53c6817/ffff97b146944000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783952095.496145:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783952095.496267:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783952095.496304:0:8435:0:(import.c:65:import_set_state_nolock()) ffff97b146945800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783952095.496393:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447749376:12345-192.168.202.48@tcp:8:mount.lustre.0 Request processed in 367us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952095.496402:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4935 00000100:00100000:2.0:1783952095.496424:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4936 00000100:00100000:2.0:1783952095.496429:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1870605447749504:12345-192.168.202.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783952095.496446:0:8435:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp t0 exp 0000000000000000 cur 3810 last 0 00000020:00000080:2.0:1783952095.496464:0:8435:0:(genops.c:1406:class_connect()) connect: client d33551be-a709-4ba2-a74c-f4d7b53c6817, cookie 0x22c73c7857bb55d7 00002000:00100000:2.0:1783952095.496469:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d33551be-a709-4ba2-a74c-f4d7b53c6817/ffff97b146940000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783952095.496494:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783952095.496555:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783952095.496573:0:8435:0:(import.c:65:import_set_state_nolock()) ffff97b1476fe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783952095.496630:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447749504:12345-192.168.202.48@tcp:8:mount.lustre.0 Request processed in 199us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952095.496637:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4936 00000100:00100000:2.0:1783952095.496659:0:66261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447749632 00000100:00100000:2.0:1783952095.496663:0:66261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447749632 00000100:00100000:3.0:1783952095.496893:0:91057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447749760 00000100:00100000:3.0:1783952095.496899:0:91057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447749760 00000100:00100000:3.0:1783952095.496935:0:91057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 99 00000100:00100000:3.0:1783952095.496943:0:91057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447749760:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952095.496990:0:91057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447749760:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 48us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952095.496997:0:91057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 99 00000100:00100000:2.0:1783952095.497620:0:66261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:2.0:1783952095.497632:0:66261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:70961:x1870605447749632:12345-192.168.202.48@tcp:900:mount.lustre.0 00000100:00100000:2.0:1783952095.497685:0:66261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:70961:x1870605447749632:12345-192.168.202.48@tcp:900:mount.lustre.0 Request processed in 56us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952095.497692:0:66261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12 00000100:00100000:0.0:1783952095.501743:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952095.502142:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447749888 00000100:00100000:2.0:1783952095.502164:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447749888 00000100:00100000:2.0:1783952095.502238:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 232 00000100:00100000:2.0:1783952095.502249:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:70961:x1870605447749888:12345-192.168.202.48@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783952095.502413:0:66241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783952095.502529:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:70961:x1870605447749888:12345-192.168.202.48@tcp:33:mount.lustre.0 Request processed in 282us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952095.502538:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 232 00010000:00010000:3.0:1783952095.776833:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952096.808307:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952096.866544:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465510144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952096.866703:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952096.866987:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465510144 00000100:00100000:3.0:1783952096.867017:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465510144 00000100:00100000:3.0:1783952096.867094:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:3.0:1783952096.867114:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465510144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783952096.867165:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952096.867263:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465510144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952096.867271:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00080000:1.0:1783952096.867341:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952096.869514:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465510144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952096.871725:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465510272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952096.871828:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952096.873969:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465510272 00000100:00100000:3.0:1783952096.873987:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465510272 00000100:00100000:3.0:1783952096.874093:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:3.0:1783952096.874108:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465510272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783952096.874197:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783952096.874336:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952096.889971:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465510272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 15853us (18128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952096.889991:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:1.0:1783952096.901913:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465510272:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783952097.825630:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952097.839732:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952097.839887:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447750016 00000100:00100000:0.0:1783952097.839901:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447750016 00000100:00100000:0.0:1783952097.840018:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1305 00000100:00100000:0.0:1783952097.840050:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71028:x1870605447750016:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1783952097.840078:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952097.840792:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb55de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3af expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952097.840892:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb55e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952097.840910:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb55e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952097.840925:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb55e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952097.841014:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783952097.841019:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783952097.841046:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb55e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952097.841078:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc800/0x22c73c7857bb55de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 8 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952097.841290:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb55e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 7 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952097.841301:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176dcf000) 00010000:00010000:0.0:1783952097.841304:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783952097.841309:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd800, rc 0) 00000100:00080000:2.0:1783952097.841555:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952097.841675:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71028:x1870605447750016:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1625us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952097.841704:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1305 00000100:00100000:3.0:1783952097.856264:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952097.856440:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447750144 00000100:00100000:2.0:1783952097.856452:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447750144 00000100:00100000:2.0:1783952097.856524:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1306 00000100:00100000:2.0:1783952097.856535:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71028:x1870605447750144:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:2.0:1783952097.856635:0:66238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1783952097.856738:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71028:x1870605447750144:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 205us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952097.856746:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1306 00000100:00100000:0.0:1783952097.864925:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952097.865257:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447750272 00000100:00100000:3.0:1783952097.865272:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447750272 00000100:00100000:3.0:1783952097.865385:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1307 00000100:00100000:3.0:1783952097.865398:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71028:x1870605447750272:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:3.0:1783952097.865464:0:83761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00080000:2.0:1783952097.865634:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952097.865792:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71028:x1870605447750272:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 396us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952097.865800:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1307 00000100:00100000:0.0:1783952097.870900:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952097.874973:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447750400 00000100:00100000:2.0:1783952097.874996:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447750400 00000100:00100000:2.0:1783952097.875128:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2177 00000100:00100000:2.0:1783952097.875150:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71028:x1870605447750400:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:2.0:1783952097.875189:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952097.875304:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71028:x1870605447750400:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 157us (4419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952097.875313:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2177 00000100:00080000:1.0:1783952097.875422:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952097.878717:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952097.878827:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447750528 00000100:00100000:3.0:1783952097.878897:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447750528 00000100:00100000:3.0:1783952097.879038:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2178 00000100:00100000:3.0:1783952097.879186:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71028:x1870605447750528:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783952097.879224:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952097.879431:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71028:x1870605447750528:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 250us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952097.879439:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2178 00000100:00080000:1.0:1783952097.879739:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783952098.849844:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783952098.924549:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000001:00100000:0.0:1783952098.924571:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00080000:0.0:1783952098.924584:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411442 is committed 00000020:00000080:0.0:1783952098.924641:0:75694:0:(genops.c:906:class_export_put()) final put ffff97b1762c0000/458183b2-4c6d-478c-9fed-a955779e6611 00000020:00080000:0.0:1783952098.924669:0:75694:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff97b1742c70c0 refcount 2 committed 0 result 0 batchid 73014444091 00000020:00080000:0.0:1783952098.924674:0:75694:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97b1428fc500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff97b1742c7900 00000020:00080000:0.0:1783952098.924678:0:75694:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x6:0x0].2 00000020:00080000:0.0:1783952098.924682:0:75694:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97b1428fc200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97b14f0cca00 00000020:00080000:0.0:1783952098.924685:0:75694:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].3 00000020:00080000:0.0:1783952098.924722:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444091 committed batchid 73014444090 00000020:00080000:0.0:1783952098.924818:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000020:00000080:1.0:1783952098.925142:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c0000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-MDT0001 00000020:00000080:1.0:1783952098.933559:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b174697800 for lustre-MDT0001 00000100:00100000:2.0:1783952099.379784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952099.379858:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447750656 00000100:00100000:2.0:1783952099.379872:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447750656 00000100:00100000:2.0:1783952099.379961:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1308 00000100:00100000:2.0:1783952099.379975:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447750656:12345-192.168.202.48@tcp:101:cp.0 00010000:00010000:2.0:1783952099.380024:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952099.380054:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b000/0x22c73c7857bb55ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3b6 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380173:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380192:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380208:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380226:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb55fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380232:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb55fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380239:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb55fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380316:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5601 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380324:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5601 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380330:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5601 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952099.380374:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5601 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380391:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380403:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380409:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380416:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380423:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952099.380429:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380437:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380453:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176dcf000) 00010000:00010000:2.0:1783952099.380456:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952099.380461:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380469:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb55f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380481:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb55fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380487:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb55fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380492:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb55fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380502:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86aa00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952099.380505:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb55fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380511:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb55fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380517:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff97b151a72800) 00010000:00010000:2.0:1783952099.380519:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952099.380521:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb55fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380526:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb55fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380559:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b000/0x22c73c7857bb55ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3b6 expref: 9 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380572:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5601 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3b6 expref: 8 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.380579:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b151a72b00) 00010000:00010000:2.0:1783952099.380581:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783952099.380583:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ba00, rc 0) 00000100:00100000:2.0:1783952099.380682:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71063:x1870605447750656:12345-192.168.202.48@tcp:101:cp.0 Request processed in 711us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.380690:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1308 00000100:00080000:2.0:1783952099.380721:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952099.391503:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952099.391962:0:66261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447750784 00000100:00100000:2.0:1783952099.391976:0:66261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447750784 00000100:00100000:2.0:1783952099.392080:0:66261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:2.0:1783952099.392093:0:66261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:71063:x1870605447750784:12345-192.168.202.48@tcp:900:cp.0 00000100:00100000:2.0:1783952099.392220:0:66261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:71063:x1870605447750784:12345-192.168.202.48@tcp:900:cp.0 Request processed in 128us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.392228:0:66261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00080000:0.0:1783952099.392507:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952099.402737:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952099.403571:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447750912 00000100:00100000:3.0:1783952099.403613:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447750912 00000100:00100000:3.0:1783952099.403692:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1309 00000100:00100000:3.0:1783952099.403720:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:71063:x1870605447750912:12345-192.168.202.48@tcp:101:cp.0 00010000:00010000:3.0:1783952099.403752:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952099.403783:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ac00/0x22c73c7857bb5608 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3bd expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.403879:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a600/0x22c73c7857bb560f lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.403896:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a600/0x22c73c7857bb560f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.403913:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a600/0x22c73c7857bb560f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952099.403973:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00000004:00200000:3.0:1783952099.403979:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783952099.404068:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ac00/0x22c73c7857bb5608 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3bd expref: 7 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.404092:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a600/0x22c73c7857bb560f lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3bd expref: 6 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.404133:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44400) 00010000:00010000:3.0:1783952099.404136:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1783952099.404140:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a600, rc 0) 00000100:00100000:3.0:1783952099.404238:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71063:x1870605447750912:12345-192.168.202.48@tcp:101:cp.0 Request processed in 536us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952099.404247:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1309 00000100:00100000:3.0:1783952099.417251:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952099.417380:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447751040 00000100:00100000:3.0:1783952099.417393:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447751040 00000100:00100000:3.0:1783952099.417783:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1310 00000100:00100000:3.0:1783952099.417799:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71063:x1870605447751040:12345-192.168.202.48@tcp:101:cp.0 00010000:00010000:3.0:1783952099.417829:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952099.417931:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b600/0x22c73c7857bb5616 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3c4 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.418023:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.421112:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.421160:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.421281:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216bc00/0x22c73c7857bb5624 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422302:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216bc00/0x22c73c7857bb5624 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422336:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216bc00/0x22c73c7857bb5624 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422489:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b400/0x22c73c7857bb562b lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422498:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b400/0x22c73c7857bb562b lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422505:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b400/0x22c73c7857bb562b lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952099.422559:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00000004:00200000:3.0:1783952099.422564:0:67035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952099.422606:0:67035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b400/0x22c73c7857bb562b lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422624:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422631:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422637:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422645:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422652:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952099.422656:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422671:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422686:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44400) 00010000:00010000:3.0:1783952099.422689:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952099.422693:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422700:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b800/0x22c73c7857bb561d lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422715:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216bc00/0x22c73c7857bb5624 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422721:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216bc00/0x22c73c7857bb5624 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422727:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216bc00/0x22c73c7857bb5624 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422732:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216bc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952099.422735:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216bc00/0x22c73c7857bb5624 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422742:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216bc00/0x22c73c7857bb5624 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422748:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xf7117594 (ffff97b146f44100) 00010000:00010000:3.0:1783952099.422751:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952099.422753:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216bc00/0x22c73c7857bb5624 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422768:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216bc00/0x22c73c7857bb5624 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422818:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b600/0x22c73c7857bb5616 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3c4 expref: 8 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422835:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b400/0x22c73c7857bb562b lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3c4 expref: 7 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952099.422843:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:3.0:1783952099.422845:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783952099.422848:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b400, rc 0) 00000100:00100000:3.0:1783952099.422951:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447751040:12345-192.168.202.48@tcp:101:cp.0 Request processed in 5155us (5779us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952099.422962:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1310 00000100:00100000:2.0:1783952099.424935:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952099.424964:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465510400:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.425067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952099.425140:0:91051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465510400 00000100:00100000:2.0:1783952099.425148:0:91051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465510400 00000100:00100000:2.0:1783952099.425204:0:91051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783952099.425215:0:91051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17462b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465510400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.425286:0:91051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17462b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465510400:12345-0@lo:400:kworker.0 Request processed in 72us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.425295:0:91051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783952099.425353:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465510400:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.425406:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783952099.425415:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465510528:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.425447:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952099.425477:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465510528 00000100:00100000:2.0:1783952099.425481:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465510528 00000100:00100000:2.0:1783952099.425525:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:2.0:1783952099.425533:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465510528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.425615:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465510528:12345-0@lo:400:kworker.0 Request processed in 83us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.425622:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00080000:2.0:1783952099.425644:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952099.425645:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465510528:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.425671:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952099.425679:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465510656:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.425706:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952099.425761:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465510784:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.425784:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952099.425809:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465510656 00000100:00100000:2.0:1783952099.425814:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465510784 00000100:00100000:0.0:1783952099.425814:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465510656 00000100:00100000:2.0:1783952099.425817:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465510784 00000100:00100000:2.0:1783952099.426197:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1783952099.426207:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465510784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.426306:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465510784:12345-0@lo:400:kworker.0 Request processed in 101us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.426313:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1783952099.426326:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1783952099.426332:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465510656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.426366:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465510656:12345-0@lo:400:kworker.0 Request processed in 34us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.426371:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:1.0:1783952099.426538:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14debb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465510912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952099.426578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952099.426631:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952099.426637:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14debbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465511040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783952099.426660:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952099.426687:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465510912 00000100:00100000:1.0:1783952099.426692:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465510912 00000100:00100000:1.0:1783952099.426723:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465511040 00000100:00100000:1.0:1783952099.426726:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465511040 00000100:00100000:1.0:1783952099.426747:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:1.0:1783952099.426752:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465510912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783952099.427431:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:1.0:1783952099.427510:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465510912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 755us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952099.427518:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:1.0:1783952099.427545:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:1.0:1783952099.427553:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465511040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783952099.427575:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445236736 avail 1298997248 00000100:00100000:1.0:1783952099.427637:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1870605465511040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952099.427644:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:1.0:1783952099.427700:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14debb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465510912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952099.427737:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14debbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465511040:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1783952099.438430:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952099.438444:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952099.438523:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465510656:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.438581:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465510784:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.438725:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952099.438739:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465511168:0@lo:400:kworker.0 00000100:00100000:3.0:1783952099.441342:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952099.443567:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952099.444023:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447751168 00000100:00100000:2.0:1783952099.444034:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447751168 00000100:00100000:2.0:1783952099.444096:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465511168 00000100:00100000:2.0:1783952099.444100:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465511168 00000100:00100000:2.0:1783952099.444147:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1783952099.444160:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465511168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.444246:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465511168:12345-0@lo:400:kworker.0 Request processed in 90us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.444253:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1783952099.444278:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1311 00000100:00100000:2.0:1783952099.444284:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447751168:12345-192.168.202.48@tcp:101:cp.0 00010000:00010000:2.0:1783952099.444302:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952099.444331:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86aa00/0x22c73c7857bb5632 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3cb expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444420:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952099.444430:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465511168:0@lo:400:kworker.0 00010000:00010000:2.0:1783952099.444439:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444452:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444468:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5640 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444492:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5640 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444500:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5640 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444565:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444574:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444580:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444628:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444634:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952099.444639:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444647:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444662:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:2.0:1783952099.444665:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952099.444670:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444677:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5639 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444700:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5640 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444706:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5640 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444713:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5640 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444719:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ac00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952099.444722:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5640 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444729:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5640 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444737:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xb1bed465 (ffff97b151a72800) 00010000:00010000:2.0:1783952099.444739:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952099.444742:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5640 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444748:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5640 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444785:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86aa00/0x22c73c7857bb5632 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3cb expref: 8 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444797:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:2.0:1783952099.444800:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952099.444809:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86aa00/0x22c73c7857bb5632 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3cb expref: 8 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.444818:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86aa00, rc 0) 00000100:00100000:2.0:1783952099.444875:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447751168:12345-192.168.202.48@tcp:101:cp.0 Request processed in 590us (3547us total) trans 0 rc 301/301 00000100:00100000:2.0:1783952099.444882:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1311 00000100:00080000:2.0:1783952099.444903:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952099.445143:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465511296:0@lo:400:kworker.0 00000100:00100000:3.0:1783952099.445174:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465511552:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.445190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952099.445206:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952099.445213:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465511808:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.445233:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952099.445255:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783952099.445260:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465511424:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.445282:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952099.445302:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465511936:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.445335:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465511296 00000100:00100000:2.0:1783952099.445340:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465511296 00000100:00100000:2.0:1783952099.445383:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786 00000100:00100000:2.0:1783952099.445390:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465511296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.445435:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465511296:12345-0@lo:400:kworker.0 Request processed in 46us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.445441:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786 00000100:00100000:2.0:1783952099.445451:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465511808 00000100:00100000:2.0:1783952099.445455:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465511808 00000100:00100000:2.0:1783952099.445478:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465511424 00000100:00100000:2.0:1783952099.445481:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465511424 00000100:00100000:2.0:1783952099.445515:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:2.0:1783952099.445520:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465511808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.445552:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465511808:12345-0@lo:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.445558:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:2.0:1783952099.445569:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:2.0:1783952099.445576:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465511424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.445628:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465511424:12345-0@lo:400:kworker.0 Request processed in 53us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.445634:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000100:00080000:2.0:1783952099.445663:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952099.445667:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952099.445848:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465511680:0@lo:400:kworker.0 00000100:00100000:1.0:1783952099.445883:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952099.445924:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465511680 00000100:00100000:1.0:1783952099.445928:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465511680 00000100:00100000:1.0:1783952099.445962:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:1.0:1783952099.445968:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465511680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952099.446003:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465511680:12345-0@lo:400:kworker.0 Request processed in 35us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952099.446009:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00100000:1.0:1783952099.446043:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465511680:0@lo:400:kworker.0 00000100:00100000:1.0:1783952099.446915:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952099.448929:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465511552 00000100:00100000:2.0:1783952099.448948:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465511552 00000100:00100000:2.0:1783952099.449034:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1783952099.449047:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465511552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.453541:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465511552:12345-0@lo:400:kworker.0 Request processed in 4482us (8319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.453560:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00080000:2.0:1783952099.453640:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952099.453815:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465511552:0@lo:400:kworker.0 00000100:00100000:1.0:1783952099.457845:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465511296:0@lo:400:kworker.0 00000100:00100000:1.0:1783952099.457877:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465511808:0@lo:400:kworker.0 00000100:00100000:1.0:1783952099.457912:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465511424:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.458210:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465511936 00000100:00100000:2.0:1783952099.458219:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465511936 00000100:00100000:2.0:1783952099.458283:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1783952099.458294:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465511936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.458397:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465511936:12345-0@lo:400:kworker.0 Request processed in 104us (11483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952099.458413:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1783952099.458488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952099.458518:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465511936:0@lo:400:kworker.0 00000100:00100000:2.0:1783952099.458535:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447751296 00000100:00100000:2.0:1783952099.458538:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447751296 00000100:00100000:2.0:1783952099.458564:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1312 00000100:00100000:2.0:1783952099.458570:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447751296:12345-192.168.202.48@tcp:101:cp.0 00010000:00010000:2.0:1783952099.458603:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952099.458631:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb5647 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3d2 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458712:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458730:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458744:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458759:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5655 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458765:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5655 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458770:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5655 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458836:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458843:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458849:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458856:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458861:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952099.458866:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458873:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458886:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:2.0:1783952099.458889:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952099.458894:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458900:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a200/0x22c73c7857bb564e lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458912:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5655 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458917:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5655 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458928:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5655 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458932:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ae00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952099.458935:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5655 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458942:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5655 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458948:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xb1bed465 (ffff97b151a72700) 00010000:00010000:2.0:1783952099.458951:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952099.458954:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5655 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458960:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5655 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.458996:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb5647 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3d2 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.459005:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:2.0:1783952099.459008:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952099.459011:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb5647 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3d2 expref: 8 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952099.459020:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86b800, rc 0) 00000100:00100000:2.0:1783952099.459080:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447751296:12345-192.168.202.48@tcp:101:cp.0 Request processed in 509us (594us total) trans 0 rc 301/301 00000100:00100000:2.0:1783952099.459098:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1312 00000100:00100000:0.0:1783952099.484500:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952099.484581:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447751424 00000100:00100000:1.0:1783952099.484617:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447751424 00000100:00100000:1.0:1783952099.484700:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13 00000100:00100000:1.0:1783952099.484717:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447751424:12345-192.168.202.48@tcp:700:cp.0 00000020:02000000:1.0:1783952099.484739:0:66257:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:1.0:1783952099.498215:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447751424:12345-192.168.202.48@tcp:700:cp.0 Request processed in 13486us (13711us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952099.498235:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13 00010000:00010000:3.0:1783952099.872816:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952099.937566:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952099.937619:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465512064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952099.937717:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952099.938219:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465512064 00000100:00100000:0.0:1783952099.938236:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465512064 00000100:00100000:0.0:1783952099.938309:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:0.0:1783952099.938321:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465512064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783952099.938373:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952099.938641:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465512064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 322us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952099.938650:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00100000:2.0:1783952099.938799:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465512192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952099.938848:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952099.938913:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465512064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952099.938989:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465512192 00000100:00100000:3.0:1783952099.938996:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465512192 00000100:00100000:3.0:1783952099.939054:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:3.0:1783952099.939063:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465512192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783952099.939091:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952099.939152:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465512192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952099.939170:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:3.0:1783952099.939232:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465512192:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1783952099.942422:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000001:00100000:0.0:1783952099.942440:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:0.0:1783952099.942444:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b04965f000/458183b2-4c6d-478c-9fed-a955779e6611 00000001:00100000:2.0:1783952099.943042:0:91045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000001:00100000:2.0:1783952099.943052:0:91045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000001:00080000:2.0:1783952099.943063:0:91045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116997 is committed 00000020:00000080:2.0:1783952099.943068:0:91045:0:(genops.c:906:class_export_put()) final put ffff97b17484a000/458183b2-4c6d-478c-9fed-a955779e6611 00000001:00100000:0.0:1783952099.953684:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000001:00100000:0.0:1783952099.953699:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:0.0:1783952099.953704:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b142e2a800/458183b2-4c6d-478c-9fed-a955779e6611 00000020:00000080:3.0:1783952099.965162:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965f000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-OST0000 00000020:00000080:3.0:1783952099.965259:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17484a000/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-MDT0000 00000020:00000080:3.0:1783952099.965326:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04965f800 for lustre-OST0000 00000020:00000080:3.0:1783952099.965332:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b176bca000 for lustre-MDT0000 00000020:00000080:1.0:1783952099.966110:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b142e2a800/458183b2-4c6d-478c-9fed-a955779e6611 for lustre-OST0001 00000020:00000080:1.0:1783952099.966181:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b150d63000 for lustre-OST0001 00000100:00100000:2.0:1783952100.846399:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952100.846461:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952100.846511:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952100.846547:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952100.846572:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952100.846655:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447751936 00000100:00100000:2.0:1783952100.846669:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447751936 00000100:00100000:2.0:1783952100.846750:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447752064 00000100:00100000:2.0:1783952100.846754:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447752064 00000100:00100000:2.0:1783952100.846781:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2790 00000100:00100000:2.0:1783952100.846792:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447751936:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952100.846884:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447751936:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 94us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952100.846892:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2790 00000100:00100000:2.0:1783952100.846913:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2791 00000100:00100000:2.0:1783952100.846920:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447752064:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952100.847225:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447751680 00000100:00100000:3.0:1783952100.847231:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447751680 00000100:00100000:3.0:1783952100.847270:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447751808 00000100:00100000:3.0:1783952100.847273:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447751808 00000100:00100000:3.0:1783952100.847298:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1311 00000100:00100000:3.0:1783952100.847306:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447751680:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952100.847341:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447751680:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 36us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952100.847348:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1311 00000100:00100000:3.0:1783952100.847362:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1312 00000100:00100000:3.0:1783952100.847368:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447751808:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952100.847394:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447751808:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952100.847400:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1312 00000100:00080000:3.0:1783952100.847446:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952100.847451:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952100.847671:0:91049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447751552 00000100:00100000:1.0:1783952100.847677:0:91049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447751552 00000100:00100000:1.0:1783952100.847715:0:91049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 101 00000100:00100000:1.0:1783952100.847723:0:91049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17462a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447751552:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952100.847752:0:91049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17462a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447751552:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952100.847759:0:91049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 101 00000100:00100000:2.0:1783952100.848897:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447752064:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 62us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952100.848914:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2791 00010000:00010000:1.0:1783952100.896900:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952101.924704:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952101.985147:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465512320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952101.985218:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952101.985284:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465512320 00000100:00100000:2.0:1783952101.985292:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465512320 00000100:00100000:2.0:1783952101.985346:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:2.0:1783952101.985356:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465512320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783952101.985388:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952101.985433:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465512320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952101.985440:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00080000:2.0:1783952101.985460:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952101.985495:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465512320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952101.987220:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465512448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952101.987287:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952101.987337:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465512448 00000100:00100000:0.0:1783952101.987344:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465512448 00000100:00100000:0.0:1783952101.987389:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:0.0:1783952101.987398:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465512448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952101.987427:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952101.987468:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465512448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952101.987477:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00080000:0.0:1783952101.987497:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952101.987527:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465512448:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783952102.967012:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783952103.092047:0:92068:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783952103.092119:0:92068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.092158:0:92068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.092166:0:92068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.092173:0:92068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.092203:0:92068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783952103.092209:0:92068:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783952103.092237:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783952103.092241:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783952103.092259:0:92068:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783952103.092286:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b144764000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783952103.093026:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465512576:0@lo:39:umount.0 00000100:00100000:2.0:1783952103.093112:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952103.093944:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952103.093955:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.093978:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783952103.093983:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.093993:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783952103.094000:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952103.094005:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783952103.094007:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783952103.094011:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783952103.094047:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.094053:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952103.094095:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.094104:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb515b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5162 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.094118:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952103.094120:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952103.094121:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952103.094129:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952103.094151:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465512704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952103.094195:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952103.094264:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465512704 00000100:00100000:1.0:1783952103.094271:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465512704 00000100:00100000:1.0:1783952103.094322:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1783952103.094331:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465512704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952103.094345:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952103.094361:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140030800/0x22c73c7857bb5162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb515b expref: 24 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.094373:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952103.094410:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3643:x1870605465512704:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952103.094417:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1783952103.094467:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465512704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952103.095906:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465512576 00000100:00100000:3.0:1783952103.095917:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465512576 00000100:00100000:3.0:1783952103.095977:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1783952103.095986:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465512576:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783952103.096013:0:83761:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb527a 00000100:00080000:3.0:1783952103.096020:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b164ceb800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783952103.096103:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1870605465512576:12345-0@lo:39:umount.0 Request processed in 119us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952103.096111:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000020:00000080:3.0:1783952103.096119:0:83761:0:(genops.c:906:class_export_put()) final put ffff97b164cea000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1783952103.097337:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b144764000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783952103.097807:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465512576:0@lo:39:umount.0 00010000:00010000:1.0:1783952103.098038:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783952103.098052:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b164cea000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783952103.098120:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b164ceb800 for lustre-MDT0000 00000100:00080000:3.0:1783952103.098227:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783952103.098231:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783952103.098261:0:92068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783952103.106473:0:92068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106494:0:92068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106501:0:92068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106508:0:92068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106524:0:92068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783952103.106530:0:92068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106537:0:92068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106544:0:92068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106550:0:92068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106569:0:92068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783952103.106576:0:92068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106583:0:92068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106623:0:92068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106630:0:92068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106642:0:92068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783952103.106647:0:92068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106654:0:92068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106661:0:92068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106667:0:92068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.106676:0:92068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1783952103.106679:0:92068:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1783952103.106716:0:92068:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783952103.106720:0:92068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1783952103.106724:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1783952103.106729:0:92068:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1783952103.110251:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783952103.110263:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110275:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71600 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783952103.110280:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110291:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783952103.110298:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952103.110324:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783952103.110328:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1783952103.110332:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1783952103.110374:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110380:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952103.110405:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110412:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db71600/0x22c73c7857bb507b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5082 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110437:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783952103.110441:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110446:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbce00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783952103.110449:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110456:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783952103.110462:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952103.110467:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783952103.110469:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783952103.110476:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783952103.110490:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110496:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952103.110517:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110524:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbce00/0x22c73c7857bb517e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5185 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110534:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783952103.110538:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110542:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031000 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783952103.110545:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110551:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783952103.110556:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952103.110560:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783952103.110563:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783952103.110565:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783952103.110577:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110583:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952103.110612:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110619:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb514d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5154 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110628:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952103.110631:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110637:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031a00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783952103.110640:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110647:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783952103.110653:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952103.110659:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783952103.110661:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783952103.110663:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783952103.110674:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110679:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952103.110683:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110690:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b140031a00/0x22c73c7857bb506d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5074 expref: -99 pid: 91044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.110708:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952103.110709:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952103.110711:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952103.110720:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952103.110738:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465512832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952103.110805:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952103.110849:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952103.110854:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465513216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952103.110870:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952103.110922:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465512960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952103.110940:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952103.110953:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783952103.110957:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465513088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952103.110974:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952103.111003:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465512832 00000100:00100000:1.0:1783952103.111010:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465512832 00000100:00100000:1.0:1783952103.111044:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1783952103.111051:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3643:x1870605465512832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952103.111063:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952103.111078:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1820cd200/0x22c73c7857bb5082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb507b expref: 23 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.111102:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952103.111136:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3643:x1870605465512832:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952103.111143:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1783952103.111166:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465513216 00000100:00100000:1.0:1783952103.111170:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465513216 00000100:00100000:1.0:1783952103.111189:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465512960 00000100:00100000:1.0:1783952103.111192:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465512960 00000100:00100000:1.0:1783952103.111203:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465513088 00000100:00100000:1.0:1783952103.111205:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465513088 00000100:00100000:1.0:1783952103.111218:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1783952103.111223:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465513216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952103.111229:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952103.111239:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140030600/0x22c73c7857bb5074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb506d expref: 24 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.111247:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952103.111267:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3643:x1870605465513216:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952103.111272:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1783952103.111284:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1783952103.111290:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3644:x1870605465512960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952103.111297:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952103.111304:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1820cd400/0x22c73c7857bb5185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb517e expref: 22 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.111312:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952103.111337:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3644:x1870605465512960:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952103.111343:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1783952103.111355:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1783952103.111360:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3644:x1870605465513088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952103.111375:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952103.111383:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb5154 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb514d expref: 20 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.111391:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952103.111410:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3644:x1870605465513088:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952103.111416:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1783952103.111459:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465513088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952103.111467:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465512960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952103.111491:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465513216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952103.111498:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465512832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952103.111509:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952103.111746:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1783952103.115532:0:92068:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1783952103.117070:0:92068:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1783952103.117092:0:92068:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b144577000 d33551be-a709-4ba2-a74c-f4d7b53c6817 192.168.202.48@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783952103.117100:0:92068:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b144761000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783952103.117116:0:92068:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b144767000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783952103.117121:0:92068:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b144573800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783952103.117125:0:92068:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b17704d000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 115964116996 stale:0 00000020:00080000:3.0:1783952103.117129:0:92068:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff97b048b599c0) has exports, disconnecting them 00000020:00080000:3.0:1783952103.117134:0:92068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.48@tcp (ffff97b144577000), last request at 1783952100 00000020:00000080:3.0:1783952103.117141:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb55c9 00000020:00010000:3.0:1783952103.117148:0:92068:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b144577000: total 0 00000100:00080000:3.0:1783952103.117152:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b04965a800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783952103.117174:0:92068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b144577000): rc 0 00000020:00080000:3.0:1783952103.117177:0:92068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b144761000), last request at 1783952068 00000020:00000080:3.0:1783952103.117180:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5273 00000100:00080000:3.0:1783952103.117184:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b144760000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783952103.117193:0:92068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b144761000): rc 0 00000020:00000080:3.0:1783952103.117196:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b144761000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783952103.117204:0:92068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b144767000), last request at 1783952099 00000020:00000080:3.0:1783952103.117207:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb526c 00000100:00080000:3.0:1783952103.117209:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b144764800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783952103.117217:0:92068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b144767000): rc 0 00000020:00000080:3.0:1783952103.117219:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b144767000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783952103.117222:0:92068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b144573800), last request at 1783952099 00000020:00000080:3.0:1783952103.117224:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5265 00000100:00080000:3.0:1783952103.117233:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b15036a000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1783952103.117608:0:7459:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b144577000: total 2 00010000:00010000:2.0:1783952103.117613:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952103.117674:0:7459:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b144577000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1783952103.117711:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5601 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3b6 expref: 3 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952103.117743:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb55e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 2 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952103.117757:0:7459:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b144577000, canceled 2 locks, left on hash table 0. 00000020:00080000:3.0:1783952103.118478:0:92068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b144573800): rc 0 00000020:00000080:3.0:1783952103.118481:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b144573800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783952103.118489:0:92068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b17704d000), last request at 1783952063 00000020:00000080:3.0:1783952103.118494:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb50cf 00000100:00080000:3.0:1783952103.118509:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b144763800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783952103.118519:0:92068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b17704d000): rc 0 00000020:00000080:3.0:1783952103.118520:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b17704d000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:3.0:1783952103.118528:0:92068:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa80a40d93ae0 00000100:00080000:3.0:1783952103.118548:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783952103.118551:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783952103.120841:0:92068:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783952103.120879:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b176be3000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:3.0:1783952103.126108:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144761000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783952103.126197:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144767000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783952103.126216:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144573800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783952103.126237:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17704d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783952103.126278:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144760000 for lustre-MDT0000 00000020:00000080:3.0:1783952103.126283:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144764800 for lustre-MDT0000 00000020:00000080:3.0:1783952103.126286:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b15036a000 for lustre-MDT0000 00000020:00000080:3.0:1783952103.126291:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144763800 for lustre-MDT0000 00010000:00010000:1.0:1783952103.129030:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952103.129039:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952103.129044:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952103.129732:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465513344:0@lo:39:umount.0 00000100:00100000:1.0:1783952103.129809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952103.133706:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465513344 00000100:00100000:3.0:1783952103.133720:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465513344 00000100:00100000:3.0:1783952103.133781:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:3.0:1783952103.133791:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465513344:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783952103.133825:0:8445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb510e 00000100:00080000:3.0:1783952103.133833:0:8445:0:(import.c:65:import_set_state_nolock()) ffff97b1469d3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783952103.133853:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411442 00000100:00100000:3.0:1783952103.134025:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3641:x1870605465513344:12345-0@lo:39:umount.0 Request processed in 234us (4215us total) trans 77309411443 rc 0/0 00000100:00100000:3.0:1783952103.134034:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00010000:00010000:1.0:1783952103.134180:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783952103.134398:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b176be3000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783952103.134518:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465513344:0@lo:39:umount.0 00000100:00080000:1.0:1783952103.142727:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783952103.142735:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968954 gen 3 00000004:00080000:1.0:1783952103.142756:0:92068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783952103.142812:0:92068:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783952103.142854:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b04661c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783952103.142869:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783952103.142872:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968955 gen 3 00000004:00080000:1.0:1783952103.142880:0:92068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783952103.142961:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465513472:0@lo:9:umount.0 00000100:00100000:1.0:1783952103.143023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783952103.143075:0:92068:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783952103.143094:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b1742bc000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783952103.143110:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465513600:0@lo:9:umount.0 00000100:00100000:1.0:1783952103.143130:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783952103.143185:0:92068:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b048b599c0) has no exports 00000100:00100000:0.0:1783952103.162109:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465513472 00000100:00100000:0.0:1783952103.162133:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465513472 00000100:00100000:0.0:1783952103.162233:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465513600 00000100:00080000:1.0:1783952103.163538:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952103.163578:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4937 00000100:00100000:1.0:1783952103.163623:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465513472:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783952103.163660:0:15187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb511c 00000100:00080000:1.0:1783952103.163671:0:15187:0:(import.c:65:import_set_state_nolock()) ffff97b174b17000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783952103.163729:0:15187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968954 00000100:00100000:1.0:1783952103.163923:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465513472:12345-0@lo:9:umount.0 Request processed in 333us (20897us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952103.163932:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4937 00010000:00010000:1.0:1783952103.163958:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783952103.163995:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b04661c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783952103.164009:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783952103.164011:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783952103.164015:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465513472:0@lo:9:umount.0 00000100:00100000:0.0:1783952103.165503:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465513600 00000100:00100000:0.0:1783952103.165580:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4938 00000100:00100000:0.0:1783952103.165606:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465513600:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783952103.165642:0:26206:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5146 00000100:00080000:0.0:1783952103.165651:0:26206:0:(import.c:65:import_set_state_nolock()) ffff97b1742be800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783952103.165691:0:26206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968955 00000100:00100000:0.0:1783952103.166044:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465513600:12345-0@lo:9:umount.0 Request processed in 454us (22910us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952103.166052:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4938 00000100:00080000:0.0:1783952103.166112:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1742bc000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783952103.166123:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783952103.166125:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783952103.166128:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465513600:0@lo:9:umount.0 00010000:00010000:0.0:1783952103.166150:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783952103.169911:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1783952103.171400:0:92068:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b048b599c0) has no exports 00000020:00000080:2.0:1783952103.208492:0:7459:0:(genops.c:906:class_export_put()) final put ffff97b144577000/d33551be-a709-4ba2-a74c-f4d7b53c6817 00000020:00000080:0.0:1783952103.208669:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144577000/d33551be-a709-4ba2-a74c-f4d7b53c6817 for lustre-MDT0000 00000020:00000080:0.0:1783952103.208725:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04965a800 for lustre-MDT0000 00010000:00010000:3.0:1783952103.208880:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952103.208884:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952103.208902:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783952103.337331:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb50e4 00000020:00000080:1.0:1783952103.337347:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b1762c5800/lustre-QMT0000_UUID 00000020:01000000:1.0:1783952103.337359:0:92068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783952103.337660:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783952103.337673:0:92068:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783952103.337677:0:92068:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff97b167c94d40) has no exports 00000020:00000080:2.0:1783952103.338020:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783952103.338753:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb50dd 00000020:00000080:3.0:1783952103.338762:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b1762c1000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783952103.338820:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783952103.338831:0:92068:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783952103.338834:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b046486800/lustre-QMT0000_UUID 00000020:00000080:3.0:1783952103.338836:0:92068:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046486800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783952103.338845:0:92068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1783952103.339108:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1762c1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783952103.339636:0:92068:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b1766a4480 - data ffff97b045d79438/ffff97b04aa59000 00000020:01000000:3.0:1783952103.339775:0:92068:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b174388660 - data ffff97b1608955e8/ffff97b14de3bc00 00000100:00080000:0.0:1783952103.512912:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783952103.512921:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783952103.512937:0:92068:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff97b16dd4c380 x1870605465513344/t77309411443(77309411443) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952113 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952103.512965:0:92068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783952103.517065:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783952103.517074:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968954 gen 4 00000004:00080000:0.0:1783952103.517138:0:92068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783952103.517141:0:92068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783952103.532727:0:91064:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783952103.532736:0:91064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:0.0:1783952103.532753:0:91064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:1.0:1783952103.536978:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783952103.536986:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968955 gen 4 00000004:00080000:1.0:1783952103.537010:0:92068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783952103.537013:0:92068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783952103.538751:0:91066:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783952103.538758:0:91066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:1.0:1783952103.538771:0:91066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:0.0:1783952103.540959:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb509e 00000020:00000080:0.0:1783952103.540981:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b04d9f0000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783952103.541497:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783952103.541730:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb50b3 00000020:00000080:0.0:1783952103.541736:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b04d9f1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783952103.541751:0:92068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783952103.541757:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952103.541767:0:92068:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783952103.541772:0:92068:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff97b048b58000) has no exports 00000004:01000000:0.0:1783952103.541940:0:92068:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783952103.541949:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5131 00000020:00000080:0.0:1783952103.541954:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b1742b8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783952103.541957:0:92068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783952103.541961:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952103.541969:0:92068:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783952103.541971:0:92068:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff97b1447b99c0) has no exports 00000020:00000080:0.0:1783952103.541977:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb512a 00000020:00000080:0.0:1783952103.541980:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b1742bf000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783952103.541988:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1783952103.541994:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1742b8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783952103.541998:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1742bf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783952103.543513:0:92068:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783952103.543520:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783952103.543524:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968955 gen 5 00000004:00080000:0.0:1783952103.543541:0:92068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783952103.543544:0:92068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783952103.543656:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952103.543667:0:92068:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783952103.543675:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5115 00000020:00000080:0.0:1783952103.543683:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b174b26000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783952103.551401:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1742bc000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783952103.551418:0:8:0:(genops.c:906:class_export_put()) final put ffff97b049659000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783952103.551422:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b049659000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783952103.551429:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783952103.552358:0:92068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783952103.552368:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952103.552382:0:92068:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783952103.552386:0:92068:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff97b0489bcd40) has no exports 00000020:00000080:0.0:1783952103.552393:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5107 00000020:00000080:0.0:1783952103.552400:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b046619800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783952103.552777:0:92068:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783952103.552792:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783952103.552796:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968954 gen 5 00000004:00080000:0.0:1783952103.552802:0:92068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783952103.552805:0:92068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783952103.552838:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952103.552846:0:92068:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783952103.552860:0:92068:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783952103.552866:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb50f9 00000020:00000080:0.0:1783952103.552870:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b174b22000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783952103.552874:0:92068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783952103.552877:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952103.552881:0:92068:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783952103.552883:0:92068:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff97b167c919c0) has no exports 00000020:00000080:0.0:1783952103.552887:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb50f2 00000020:00000080:0.0:1783952103.552889:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b176be0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783952103.553776:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b26000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783952103.553787:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046619800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783952103.553792:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04661c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783952103.553798:0:8:0:(genops.c:906:class_export_put()) final put ffff97b174b22800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783952103.553800:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b22800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783952103.553803:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952103.553879:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b22000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783952103.553884:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176be0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783952103.554845:0:92068:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1783952103.554851:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783952103.554855:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783952103.554861:0:92068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783952103.554914:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783952103.554926:0:92068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952103.554952:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783952103.554969:0:92068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952103.554973:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b04b214800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783952103.554976:0:92068:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04b214800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783952103.554982:0:92068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952103.555050:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb50ba 00000020:00000080:1.0:1783952103.555056:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b04d9f2800/lustre-MDD0000_UUID 00000020:01000000:1.0:1783952103.555073:0:92068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1783952103.555085:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783952103.555090:0:92068:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783952103.555093:0:92068:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff97b048b5cd40) has no exports 00000020:00000080:3.0:1783952103.555109:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b176be3000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783952103.555113:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783952103.555116:0:8:0:(genops.c:906:class_export_put()) final put ffff97b04965e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783952103.555116:0:92068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1783952103.555118:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783952103.555120:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb50c1 00000020:01000000:3.0:1783952103.555122:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952103.555123:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b04d9f5800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783952103.555134:0:92068:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b04b215800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783952103.555149:0:92068:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b04b215800 3 00000020:01000004:1.0:1783952103.555152:0:92068:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b04b215800 from lustre-MDT0000 00000020:00000080:3.0:1783952103.555175:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1783952103.555179:0:8:0:(genops.c:906:class_export_put()) final put ffff97b04d9f4800/lustre-MDD0000_UUID 00000020:00000080:3.0:1783952103.555181:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1783952103.555185:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1783952103.555210:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783952103.555500:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783952103.555507:0:92068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783952103.555510:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b04d9f1000/lustre-MDT0000_UUID 00000020:00000080:1.0:1783952103.555513:0:92068:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f1000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783952103.555520:0:92068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1783952103.555553:0:92068:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1783952103.555558:0:92068:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783952103.555561:0:92068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783952103.555563:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783952103.555566:0:92068:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783952103.555575:0:92068:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b0410da000 e617e28a-7c0f-459e-8765-f628898cec50 192.168.202.48@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783952103.555581:0:92068:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b0497f2000 75da5dc4-aa7e-42cf-a965-1b5f01232c6f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783952103.555604:0:92068:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff97b048b5b380) has exports, disconnecting them 00000020:00080000:1.0:1783952103.555609:0:92068:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.48@tcp (ffff97b0410da000), last request at 1783952095 00000020:00000080:1.0:1783952103.555630:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb559f 00000020:00010000:1.0:1783952103.555634:0:92068:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b0410da000: total 0 00000100:00080000:1.0:1783952103.555638:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b0410d9000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783952103.555653:0:92068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b0410da000): rc 0 00000020:00080000:1.0:1783952103.555656:0:92068:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97b0497f2000), last request at 1783952063 00000020:00000080:1.0:1783952103.555662:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb505f 00000020:00010000:1.0:1783952103.555664:0:92068:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b0497f2000: total 0 00000100:00080000:1.0:1783952103.555667:0:92068:0:(import.c:65:import_set_state_nolock()) ffff97b0497f6800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783952103.555675:0:92068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b0497f2000): rc 0 00000020:00080000:1.0:1783952103.555679:0:92068:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff97b048b5b380) has no exports 00000020:00010000:1.0:1783952103.555690:0:6505:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b0410da000: total 0 00010000:00010000:1.0:1783952103.555713:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b0410da000, canceled 0 locks, left on hash table 4. 00000020:00010000:3.0:1783952103.555731:0:6506:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b0497f2000: total 0 00010000:00010000:1.0:1783952103.555742:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb55b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a377 expref: 5 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555751:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b0497f2000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783952103.555759:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb55ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a346 expref: 4 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555766:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb51fc expref: 14 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.555772:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b200/0x22c73c7857bb55a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a33f expref: 3 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.555783:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb55bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a37e expref: 2 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.555792:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b0410da000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1783952103.555795:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71800/0x22c73c7857bb5193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb518c expref: 13 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555805:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db70800/0x22c73c7857bb5211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb520a expref: 12 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783952103.555809:0:6505:0:(genops.c:906:class_export_put()) final put ffff97b0410da000/e617e28a-7c0f-459e-8765-f628898cec50 00010000:00010000:3.0:1783952103.555815:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb521f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5218 expref: 11 pid: 91049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952103.555820:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952103.555822:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952103.555824:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952103.555825:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140031600/0x22c73c7857bb51af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb51a8 expref: 10 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555834:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140030400/0x22c73c7857bb522d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5226 expref: 9 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555846:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140030000/0x22c73c7857bb51bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb51b6 expref: 8 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555856:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140030200/0x22c73c7857bb51a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb519a expref: 7 pid: 91051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555867:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71c00/0x22c73c7857bb51d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb51d2 expref: 6 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555876:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86b600/0x22c73c7857bb523b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5234 expref: 5 pid: 91055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555885:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db70600/0x22c73c7857bb51cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb51c4 expref: 4 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952103.555887:0:91052:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97b144783600:91052] 2 exiting: rc = 0 00010000:00010000:3.0:1783952103.555905:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86a400/0x22c73c7857bb51f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb51ee expref: 3 pid: 91057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555916:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71a00/0x22c73c7857bb51e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb51e0 expref: 2 pid: 91052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952103.555924:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b0497f2000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1783952103.555936:0:6506:0:(genops.c:906:class_export_put()) final put ffff97b0497f2000/75da5dc4-aa7e-42cf-a965-1b5f01232c6f 00010000:00010000:3.0:1783952103.555940:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952103.555941:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952103.555943:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783952103.555948:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0410da000/e617e28a-7c0f-459e-8765-f628898cec50 for MGS 00000020:00000080:3.0:1783952103.555965:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0497f2000/75da5dc4-aa7e-42cf-a965-1b5f01232c6f for MGS 00000020:00000080:3.0:1783952103.555977:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b0410d9000 for MGS 00000020:00000080:3.0:1783952103.555981:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b0497f6800 for MGS 00000100:00100000:1.0:1783952103.555984:0:91049:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97b144782400:91049] 0 exiting: rc = 1 00000100:00100000:1.0:1783952103.556038:0:91057:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff97b049896e00:91057] 4 exiting: rc = 0 00000100:00100000:2.0:1783952103.560419:0:91051:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97b144783400:91051] 1 exiting: rc = 0 00000100:00100000:2.0:1783952103.560551:0:91055:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff97b049897c00:91055] 3 exiting: rc = 0 00000100:00100000:1.0:1783952103.565527:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565540:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565547:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565553:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565559:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565566:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565571:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565577:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565583:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565604:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565611:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565618:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565623:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565629:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565635:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565641:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565646:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565652:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565658:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565664:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565670:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565676:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565681:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565688:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565693:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565698:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565704:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565709:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565714:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565719:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565724:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565730:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565736:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565760:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565766:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565772:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565778:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565784:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565790:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565795:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565800:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565805:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565810:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565816:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565822:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565829:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565834:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565840:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565845:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565851:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565855:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565860:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565866:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565872:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565878:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565884:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565889:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565895:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565900:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565904:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565910:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565916:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565921:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783952103.565926:0:92068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1783952103.573781:0:92068:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b1766a4660 - data ffff97b181cb1438/ffff97b049a2b800 00000020:01000000:1.0:1783952103.573930:0:92068:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b048ef5900 - data ffff97b1657aa6c0/ffff97b17735d800 00000020:00000080:1.0:1783952103.574393:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5058 00000020:00000080:1.0:1783952103.574413:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b0497f5000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783952103.574433:0:92068:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b04b215800 from MGS, refs=2 00000020:01000004:1.0:1783952103.574436:0:92068:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b04b215800 2 00000020:01000004:1.0:1783952103.574440:0:92068:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b04b215800 from MGS 00000020:00000080:1.0:1783952103.574461:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783952103.574469:0:92068:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783952103.574471:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b0497f2800/MGS 00000020:00000080:1.0:1783952103.574474:0:92068:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0497f2800/MGS for MGS 00000020:01000000:1.0:1783952103.574481:0:92068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783952103.574551:0:92068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783952103.574554:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783952103.574565:0:92068:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783952103.574571:0:92068:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97b144763000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783952103.574576:0:92068:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff97b1447bcd40) has exports, disconnecting them 00000020:00080000:1.0:1783952103.574581:0:92068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97b144763000), last request at 1783952063 00000020:00000080:1.0:1783952103.574585:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5170 00000020:00080000:1.0:1783952103.574614:0:92068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b144763000): rc 0 00000020:00000080:1.0:1783952103.574618:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b144763000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783952103.575245:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0497f5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783952103.575258:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144763000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783952103.619660:0:92068:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783952103.619669:0:92068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783952103.619674:0:92068:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783952103.619680:0:92068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783952103.619715:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144764000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783952103.619868:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783952103.619882:0:92068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783952103.619887:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b0497f3800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783952103.619890:0:92068:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0497f3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783952103.619896:0:92068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783952103.619979:0:92068:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b04b215800 1 00000020:00000080:3.0:1783952103.619985:0:92068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb504a 00000020:00000080:3.0:1783952103.619991:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b0497f7000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1783952103.619999:0:92068:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783952103.620006:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0497f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783952103.620014:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783952103.620020:0:92068:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783952103.620023:0:92068:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff97b14545b380) has no exports 00000020:00000080:2.0:1783952103.775225:0:92068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783952103.775241:0:92068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783952103.775247:0:92068:0:(genops.c:906:class_export_put()) final put ffff97b04b214000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783952103.775252:0:92068:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04b214000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783952103.775264:0:92068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783952103.775393:0:92068:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97b04b217800 00000020:02000400:2.0:1783952103.775773:0:92068:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1783952103.969038:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952104.544933:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465513984:0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.545003:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952104.545040:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465514496:0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.545063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952104.545099:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783952104.545105:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465513856:0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.545125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952104.545140:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465514368:0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.545163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952104.545195:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465513984 00000100:00100000:0.0:1783952104.545203:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465513984 00000100:00100000:0.0:1783952104.545257:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465513856 00000100:00100000:0.0:1783952104.545260:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465513856 00000100:00100000:0.0:1783952104.545280:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1783952104.545304:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465513984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.545355:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465513984:12345-0@lo:400:kworker.0 Request processed in 54us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952104.545362:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1783952104.545382:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1783952104.545386:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1870605465513856:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783952104.545392:0:67035:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783952104.545416:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1870605465513856:12345-0@lo:400:kworker.0 Request processed in 28us (290us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783952104.545421:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1783952104.545439:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465514496 00000100:00100000:0.0:1783952104.545443:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465514496 00000100:00100000:0.0:1783952104.545468:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:0.0:1783952104.545474:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465514496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.545503:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465514496:12345-0@lo:400:kworker.0 Request processed in 29us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952104.545510:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00100000:0.0:1783952104.545529:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465514368 00000100:00100000:0.0:1783952104.545532:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465514368 00000100:00100000:0.0:1783952104.545553:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:0.0:1783952104.545557:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1870605465514368:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783952104.545562:0:8444:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783952104.545583:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1870605465514368:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783952104.545624:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00080000:0.0:1783952104.545639:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952104.545644:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952104.545754:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783952104.545759:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783952104.545762:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783952104.545767:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952104.545770:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3783 00000100:00080000:0.0:1783952104.545776:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952104.545800:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049d73480 x1870605465514880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952104.545818:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465513856:0@lo:400:kworker.0 00000100:00080000:0.0:1783952104.545830:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783952104.545833:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783952104.545836:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783952104.545840:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952104.545843:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3783 00000100:00080000:0.0:1783952104.545847:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952104.545858:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049d72300 x1870605465515008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952104.545868:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465514368:0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.545883:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465513984:0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.545892:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465514496:0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.545930:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465514880:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783952104.545957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952104.545981:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465515008:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783952104.546000:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952104.546024:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465514880 00000100:00100000:0.0:1783952104.546028:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465514880 00000100:00100000:0.0:1783952104.546048:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:0.0:1783952104.546053:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465514880:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1783952104.546082:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952104.546112:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465514880:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 58us (154us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952104.546120:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:0.0:1783952104.546135:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465515008 00000100:00100000:0.0:1783952104.546139:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465515008 00000100:00100000:0.0:1783952104.546155:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:0.0:1783952104.546159:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465515008:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1783952104.546170:0:8445:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952104.546194:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465515008:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 33us (193us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952104.546200:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00080000:0.0:1783952104.546224:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952104.546228:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952104.546232:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465514880:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1783952104.546239:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952104.546242:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952104.546245:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465515008:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783952104.546458:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465514112:0@lo:400:kworker.0 00000100:00100000:2.0:1783952104.546489:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952104.546516:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465514624:0@lo:400:kworker.0 00000100:00100000:2.0:1783952104.546537:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952104.546555:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783952104.546561:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465513728:0@lo:400:kworker.0 00000400:00000100:2.0:1783952104.546579:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465513728 offset 0 length 224: 4 00000100:00100000:2.0:1783952104.546625:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465514240:0@lo:400:kworker.0 00000100:00100000:2.0:1783952104.546647:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952104.546671:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465514752:0@lo:400:kworker.0 00000100:00100000:2.0:1783952104.546693:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952104.546762:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465514624 00000100:00100000:0.0:1783952104.546828:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465514624 00000100:00100000:0.0:1783952104.548798:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:0.0:1783952104.548813:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465514624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.548898:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465514624:12345-0@lo:400:kworker.0 Request processed in 90us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952104.548905:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:0.0:1783952104.548930:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465514112 00000100:00100000:0.0:1783952104.548936:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465514112 00000100:00100000:0.0:1783952104.548958:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465514240 00000100:00100000:0.0:1783952104.548960:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465514240 00000100:00100000:1.0:1783952104.551354:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465514624:0@lo:400:kworker.0 00000100:00100000:1.0:1783952104.551389:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465514752 00000100:00100000:1.0:1783952104.551396:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465514752 00000100:00100000:1.0:1783952104.551431:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1783952104.551438:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1870605465514112:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783952104.551447:0:66238:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783952104.551509:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1870605465514112:12345-0@lo:400:kworker.0 Request processed in 70us (5019us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783952104.551516:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1783952104.551531:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1783952104.551536:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1870605465514752:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783952104.551551:0:66238:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783952104.551573:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1870605465514752:12345-0@lo:400:kworker.0 Request processed in 36us (4879us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783952104.551578:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00080000:1.0:1783952104.551635:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783952104.551640:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783952104.551644:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783952104.551650:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952104.551654:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3783 00000100:00080000:1.0:1783952104.551660:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952104.551687:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1dc00 x1870605465515136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952104.551709:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465514752:0@lo:400:kworker.0 00000100:00080000:1.0:1783952104.551722:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783952104.551725:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783952104.551729:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783952104.551731:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952104.551734:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3783 00000100:00080000:1.0:1783952104.551738:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952104.551751:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1e300 x1870605465515264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952104.551761:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465514112:0@lo:400:kworker.0 00000100:00080000:2.0:1783952104.555241:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952104.557948:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952104.558122:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1783952104.558136:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465514240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.558239:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465514240:12345-0@lo:400:kworker.0 Request processed in 108us (11591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952104.558247:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1783952104.558300:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465514240:0@lo:400:kworker.0 00000100:00100000:0.0:1783952104.558337:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465515136:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783952104.558375:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952104.558398:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465515264:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783952104.558420:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952104.558446:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465515136 00000100:00100000:0.0:1783952104.558452:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465515136 00000100:00100000:0.0:1783952104.558469:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465515264 00000100:00100000:0.0:1783952104.558472:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465515264 00000100:00100000:0.0:1783952104.558484:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:0.0:1783952104.558489:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465515136:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1783952104.558509:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952104.558556:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465515136:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 65us (180us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952104.558562:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:0.0:1783952104.558574:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1783952104.558578:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465515264:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1783952104.558612:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952104.558637:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465515264:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 57us (216us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952104.558643:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00080000:0.0:1783952104.558671:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952104.558676:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952104.558678:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465515136:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1783952104.558686:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952104.558689:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952104.558691:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465515264:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1783952104.995907:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783952105.063613:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783952105.063636:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411443 is committed 00000020:00000080:1.0:1783952105.063642:0:75694:0:(genops.c:906:class_export_put()) final put ffff97b047991800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1783952105.063655:0:75694:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444091 batchid updated 00000020:00000080:0.0:1783952105.063727:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b047991800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783952105.063785:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1469d3800 for lustre-MDT0001 00000020:00080000:2.0:1783952105.063839:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444091 00000004:00080000:2.0:1783952105.063902:0:75714:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97b049cdf540 with version 13 00000020:00080000:2.0:1783952105.063919:0:75714:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444091 cancel update log [0x2000090a1:0x6:0x0].2: rc = 0 00000020:00080000:2.0:1783952105.064000:0:75714:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444091 cancel update log [0x2400088d0:0x2:0x0].3: rc = 0 00000020:00080000:2.0:1783952105.064009:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444091 00000004:00080000:0.0:1783952105.064052:0:75700:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97b1748af6c0 version 13 rpc_version 13 00000020:00100000:0.0:1783952105.064095:0:75700:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783952105.064106:0:75700:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97b049d70e00 x1870605465515520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952105.064129:0:75700:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff97b049d70e00 x1870605465515520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952105.064138:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:0.0:1783952105.969922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952105.969980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:0.0:1783952105.970002:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447752192 offset 0 length 224: 4 00000100:00100000:0.0:1783952105.970019:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952105.970043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952105.970081:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447752576 00000100:00100000:0.0:1783952105.970091:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447752576 00000100:00100000:0.0:1783952105.970144:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447752704 00000100:00100000:0.0:1783952105.970147:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447752704 00000100:00100000:0.0:1783952105.970356:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2794 00000100:00100000:0.0:1783952105.970367:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447752576:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952105.970452:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447752576:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 86us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952105.970460:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2794 00000100:00100000:0.0:1783952105.970477:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2795 00000100:00100000:0.0:1783952105.970484:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447752704:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952105.970508:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447752704:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952105.970515:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2795 00000100:00100000:0.0:1783952105.970533:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447752320 00000100:00100000:0.0:1783952105.970536:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447752320 00000100:00100000:0.0:1783952105.970556:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447752448 00000100:00100000:0.0:1783952105.970559:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447752448 00000100:00100000:0.0:1783952105.970579:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1315 00000100:00100000:0.0:1783952105.970610:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447752448:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952105.970639:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447752448:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 53us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952105.970655:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1315 00000100:00100000:0.0:1783952105.970669:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1320 00000100:00100000:0.0:1783952105.970674:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870605447752320:12345-192.168.202.48@tcp:400:kworker.0 00000020:00080000:0.0:1783952105.970680:0:83761:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.48@tcp 00000100:00100000:0.0:1783952105.970702:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870605447752320:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (790us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783952105.970708:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1320 00000100:00080000:3.0:1783952105.972686:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952105.972694:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952105.972697:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952105.982944:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952105.983028:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447752832 00000100:00100000:1.0:1783952105.983039:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447752832 00000100:00100000:1.0:1783952105.983095:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1321 00000100:00100000:1.0:1783952105.983103:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447752832:12345-192.168.202.48@tcp:38:ptlrpcd_01_00.0 00010000:00020000:1.0:1783952105.983126:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952105.983347:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447752832:12345-192.168.202.48@tcp:38:ptlrpcd_01_00.0 Request processed in 242us (412us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952105.983355:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1321 00010000:00010000:0.0:1783952106.016854:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952106.082778:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00010000:00010000:3.0:1783952107.042479:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952107.104726:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:3.0:1783952107.104935:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465515648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952107.105005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952107.105142:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465515648 00000100:00100000:2.0:1783952107.105160:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465515648 00000100:00100000:2.0:1783952107.105226:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:2.0:1783952107.105236:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465515648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952107.105266:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952107.105312:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465515648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952107.105320:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00100000:2.0:1783952107.105380:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465515648:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783952107.105673:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952107.105977:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465515776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952107.106016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952107.106098:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465515776 00000100:00100000:0.0:1783952107.106104:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465515776 00000100:00100000:0.0:1783952107.106160:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:0.0:1783952107.106168:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465515776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952107.106188:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952107.106226:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465515776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952107.106231:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00080000:3.0:1783952107.106340:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952107.106416:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465515776:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783952108.064943:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952108.128675:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00010000:00010000:2.0:1783952109.089893:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952109.155800:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000001:00100000:1.0:1783952109.158528:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783952109.158536:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b174b12800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783952109.167036:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783952109.167046:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b1742be000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783952109.167139:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1742be000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783952109.167186:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1742be800 for lustre-OST0001 00000020:00000080:0.0:1783952109.167840:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b12800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783952109.167877:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b174b17000 for lustre-OST0000 00000100:00080000:3.0:1783952109.666114:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952109.666121:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952109.666125:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952109.666132:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3819 00000100:00080000:3.0:1783952109.666138:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783952109.666146:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952109.666171:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd4ed80 x1870605465516032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952109.666256:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465516032:0@lo:38:kworker.0 00000100:00100000:2.0:1783952109.666325:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783952109.666385:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952109.666388:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952109.666390:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952109.666394:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3819 00000100:00080000:3.0:1783952109.666396:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783952109.666400:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952109.666412:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd4f100 x1870605465516288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952109.666466:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465515904:0@lo:400:kworker.0 00000400:00000100:0.0:1783952109.666493:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465515904 offset 0 length 224: 4 00000100:00100000:0.0:1783952109.666525:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952109.666540:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465516160:0@lo:400:kworker.0 00000100:00100000:0.0:1783952109.666564:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952109.666622:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465516032 00000100:00100000:0.0:1783952109.666630:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465516032 00000100:00100000:0.0:1783952109.666662:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465516160 00000100:00100000:0.0:1783952109.666665:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465516160 00000100:00100000:0.0:1783952109.666705:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:0.0:1783952109.666715:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465516160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952109.666767:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465516160:12345-0@lo:400:kworker.0 Request processed in 54us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952109.666774:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:0.0:1783952109.666792:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1783952109.666797:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465516032:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952109.666826:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1783952109.668329:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952109.668395:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465516160:0@lo:400:kworker.0 00000100:00100000:2.0:1783952109.672662:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465516288:0@lo:38:kworker.0 00000100:00100000:2.0:1783952109.672744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952109.672877:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465516288 00000100:00100000:1.0:1783952109.672886:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465516288 00000100:00100000:1.0:1783952109.672942:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:1.0:1783952109.672957:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465516288:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952109.672980:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952109.673032:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465516288:12345-0@lo:38:kworker.0 Request processed in 65us (278us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952109.673056:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00080000:3.0:1783952109.677083:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952109.677090:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952109.677094:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952109.677102:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3819 00000100:00080000:3.0:1783952109.677107:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783952109.677114:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952109.677137:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd4e300 x1870605465516544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952109.677174:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952109.677177:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952109.677179:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952109.677183:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3819 00000100:00080000:3.0:1783952109.677185:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783952109.677189:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952109.677200:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd4d880 x1870605465516928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952109.677247:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952109.677266:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465516800:0@lo:400:kworker.0 00000100:00100000:3.0:1783952109.677331:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952109.677385:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465516672:0@lo:400:kworker.0 00000100:00100000:3.0:1783952109.677409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952109.677427:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952109.677434:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465516416:0@lo:400:kworker.0 00000100:00100000:3.0:1783952109.677459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952109.677488:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465516800 00000100:00100000:3.0:1783952109.677495:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465516800 00000100:00100000:3.0:1783952109.677547:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465516672 00000100:00100000:3.0:1783952109.677550:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465516672 00000100:00100000:3.0:1783952109.677573:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796 00000100:00100000:3.0:1783952109.677582:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465516800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952109.677652:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465516800:12345-0@lo:400:kworker.0 Request processed in 70us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952109.677660:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796 00000100:00100000:3.0:1783952109.677674:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:3.0:1783952109.677681:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465516672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952109.677712:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465516672:12345-0@lo:400:kworker.0 Request processed in 31us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952109.677719:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00100000:3.0:1783952109.677742:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465516416 00000100:00100000:3.0:1783952109.677746:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465516416 00000100:00100000:3.0:1783952109.677773:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1783952109.677778:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465516416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952109.677829:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465516416:12345-0@lo:400:kworker.0 Request processed in 51us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952109.677835:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00080000:3.0:1783952109.677854:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952109.677858:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952109.677860:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952109.677889:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465516800:0@lo:400:kworker.0 00000100:00100000:3.0:1783952109.677920:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465516416:0@lo:400:kworker.0 00000100:00100000:3.0:1783952109.677928:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465516672:0@lo:400:kworker.0 00000100:00100000:0.0:1783952109.685435:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465516032:12345-0@lo:38:kworker.0 Request processed in 18625us (19098us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952109.685451:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00080000:2.0:1783952109.689285:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952109.689300:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952109.689306:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465516032:0@lo:38:kworker.0 00000100:00100000:2.0:1783952109.689364:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465516544:0@lo:38:kworker.0 00000100:00100000:2.0:1783952109.689431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952109.689472:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465516928:0@lo:38:kworker.0 00000100:00100000:2.0:1783952109.689498:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783952109.689583:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952109.689607:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952109.689611:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465516288:0@lo:38:kworker.0 00000100:00100000:0.0:1783952109.692109:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465516544 00000100:00100000:0.0:1783952109.692127:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465516544 00000100:00100000:0.0:1783952109.692191:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:0.0:1783952109.692200:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465516544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952109.692226:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952109.692325:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465516544:12345-0@lo:38:kworker.0 Request processed in 124us (2893us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952109.692332:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00080000:3.0:1783952109.692436:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952109.692442:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952109.692446:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465516544:0@lo:38:kworker.0 00000100:00100000:1.0:1783952109.695785:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465516928 00000100:00100000:1.0:1783952109.695800:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465516928 00000100:00100000:1.0:1783952109.695863:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1783952109.695872:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465516928:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952109.695896:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952109.696095:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465516928:12345-0@lo:38:kworker.0 Request processed in 222us (6595us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952109.696102:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00080000:3.0:1783952109.704081:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952109.704094:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952109.704099:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465516928:0@lo:38:kworker.0 00010000:00010000:0.0:1783952110.117506:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952110.176940:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:0.0:1783952111.089193:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:0.0:1783952111.089252:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447752960 offset 0 length 224: 4 00000100:00100000:1.0:1783952111.089427:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447753088 00000100:00100000:1.0:1783952111.089437:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447753088 00000100:00100000:1.0:1783952111.089491:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1325 00000100:00100000:1.0:1783952111.089500:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447753088:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:1.0:1783952111.089523:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952111.089619:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447753088:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 88us (421us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952111.089626:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1325 00000100:00100000:2.0:1783952111.090030:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952111.090163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952111.090247:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952111.093427:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447753216 00000100:00100000:1.0:1783952111.093444:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447753216 00000100:00100000:1.0:1783952111.093541:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1318 00000100:00080000:0.0:1783952111.093545:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952111.093554:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447753216:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952111.093662:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447753216:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 112us (3499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952111.093671:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1318 00000100:00100000:3.0:1783952111.095168:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447753344 00000100:00100000:3.0:1783952111.095179:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447753344 00000100:00100000:3.0:1783952111.095251:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447753472 00000100:00100000:3.0:1783952111.095255:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447753472 00000100:00100000:3.0:1783952111.095284:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2798 00000100:00100000:3.0:1783952111.095293:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447753344:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952111.095355:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447753344:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 63us (5326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952111.095362:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2798 00000100:00100000:3.0:1783952111.095391:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2799 00000100:00100000:3.0:1783952111.095397:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447753472:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952111.095423:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447753472:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952111.095428:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2799 00000100:00080000:1.0:1783952111.095604:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952111.095614:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783952111.137273:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952111.200728:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00010000:00010000:0.0:1783952112.160861:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952112.224793:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:1.0:1783952112.224969:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465517184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952112.225052:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783952112.225054:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952112.225072:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465517056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952112.225114:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952112.225154:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465517184 00000100:00100000:1.0:1783952112.225162:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465517184 00000100:00100000:1.0:1783952112.225226:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465517056 00000100:00100000:1.0:1783952112.225229:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465517056 00000100:00100000:1.0:1783952112.225249:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:1.0:1783952112.225258:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465517184:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952112.225272:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:3.0:1783952112.225285:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465517056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952112.225289:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1783952112.225307:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952112.225338:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465517184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952112.225346:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00100000:3.0:1783952112.225362:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465517056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952112.225371:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:1.0:1783952112.225391:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465517184:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783952112.225461:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952112.225465:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952112.225487:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465517056:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783952113.190561:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952113.248721:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00010000:00010000:0.0:1783952114.208880:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952114.272738:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00080000:0.0:1783952114.784860:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952114.784868:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952114.784872:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952114.784880:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3824 00000100:00080000:0.0:1783952114.784886:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783952114.784893:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952114.784917:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b144916d80 x1870605465517440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952114.784966:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952114.784970:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952114.784972:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952114.784985:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3824 00000100:00080000:0.0:1783952114.784988:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783952114.784992:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952114.785000:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783952114.785020:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465517568:0@lo:400:kworker.0 00000100:00100000:0.0:1783952114.785091:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952114.785146:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b144915c00 x1870605465517696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952114.785167:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952114.785171:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952114.785185:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952114.785189:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3824 00000100:00080000:0.0:1783952114.785191:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783952114.785195:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952114.785205:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465517824:0@lo:400:kworker.0 00000100:00100000:0.0:1783952114.785227:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952114.785257:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465517568 00000100:00100000:0.0:1783952114.785263:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465517568 00000100:00100000:0.0:1783952114.785306:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465517824 00000100:00100000:0.0:1783952114.785308:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465517824 00000100:00100000:0.0:1783952114.785329:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1783952114.785336:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465517568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952114.785386:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465517568:12345-0@lo:400:kworker.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952114.785714:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1783952114.785783:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783952114.785795:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465517312:0@lo:400:kworker.0 00000400:00000100:1.0:1783952114.785822:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465517312 offset 0 length 224: 4 00000100:00100000:2.0:1783952114.785912:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465517440:0@lo:38:kworker.0 00000100:00100000:2.0:1783952114.785943:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952114.785967:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465517696:0@lo:38:kworker.0 00000100:00100000:2.0:1783952114.785999:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783952114.786035:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952114.786046:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465517440 00000100:00100000:2.0:1783952114.786050:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465517440 00000100:00100000:3.0:1783952114.788834:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1783952114.788869:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465517824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952114.788967:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465517824:12345-0@lo:400:kworker.0 Request processed in 119us (3737us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952114.788989:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1783952114.789023:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465517696 00000100:00100000:3.0:1783952114.789031:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465517696 00000100:00100000:3.0:1783952114.789058:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1783952114.789063:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465517696:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952114.789084:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952114.789130:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465517696:12345-0@lo:38:kworker.0 Request processed in 64us (3129us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952114.789151:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00080000:3.0:1783952114.789239:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952114.789245:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952114.789249:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465517696:0@lo:38:kworker.0 00000100:00100000:3.0:1783952114.789303:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465517824:0@lo:400:kworker.0 00000100:00100000:3.0:1783952114.789315:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465517568:0@lo:400:kworker.0 00000100:00100000:3.0:1783952114.789362:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd4d880 x1870605465517952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952114.789464:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465517952:0@lo:38:kworker.0 00000100:00100000:3.0:1783952114.789501:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952114.789556:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952114.789563:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465518080:0@lo:400:kworker.0 00000100:00100000:3.0:1783952114.789613:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783952114.789647:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952114.789651:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952114.789653:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952114.789657:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3824 00000100:00080000:3.0:1783952114.789661:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783952114.789666:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952114.789673:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465518208:0@lo:400:kworker.0 00000100:00100000:1.0:1783952114.790844:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465517952 00000100:00100000:1.0:1783952114.790858:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465517952 00000100:00100000:1.0:1783952114.790897:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:1.0:1783952114.790903:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465517952:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952114.790923:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952114.790996:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465517952:12345-0@lo:38:kworker.0 Request processed in 92us (1494us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952114.791004:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00080000:1.0:1783952114.791071:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952114.791089:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783952114.791093:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465517952:0@lo:38:kworker.0 00000100:00100000:3.0:1783952114.791194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952114.791252:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd4f100 x1870605465518336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952114.791308:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465518080 00000100:00100000:3.0:1783952114.791313:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465518080 00000100:00100000:3.0:1783952114.791360:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465518208 00000100:00100000:3.0:1783952114.791363:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465518208 00000100:00100000:3.0:1783952114.791382:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800 00000100:00100000:3.0:1783952114.791389:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465518080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952114.797028:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465518080:12345-0@lo:400:kworker.0 Request processed in 5628us (7428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952114.797042:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800 00000100:00100000:3.0:1783952114.797077:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:3.0:1783952114.797090:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465518208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952114.797124:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465518208:12345-0@lo:400:kworker.0 Request processed in 39us (5930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952114.797129:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:3.0:1783952114.797180:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465518208:0@lo:400:kworker.0 00000100:00100000:3.0:1783952114.797193:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465518080:0@lo:400:kworker.0 00000100:00080000:3.0:1783952114.797243:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952114.797248:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952114.797451:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465518336:0@lo:38:kworker.0 00000100:00100000:0.0:1783952114.797493:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952114.799245:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465518336 00000100:00100000:3.0:1783952114.799263:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465518336 00000100:00100000:3.0:1783952114.799313:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1783952114.799322:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465517440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952114.799345:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952114.799427:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465517440:12345-0@lo:38:kworker.0 Request processed in 104us (13481us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952114.799451:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1783952114.799468:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1783952114.799472:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465518336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952114.799482:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952114.799508:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465518336:12345-0@lo:38:kworker.0 Request processed in 34us (2014us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952114.799513:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00080000:0.0:1783952114.805098:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952114.805111:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952114.805117:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465518336:0@lo:38:kworker.0 00000100:00080000:0.0:1783952114.805132:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952114.805135:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952114.805139:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465517440:0@lo:38:kworker.0 00010000:00010000:1.0:1783952115.236809:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952115.297761:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000400:00000100:0.0:1783952115.696731:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447753600 offset 0 length 224: 4 00000100:00100000:0.0:1783952115.696790:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952115.696851:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952115.697028:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952115.697077:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952115.697119:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447753728 00000100:00100000:0.0:1783952115.697131:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447753728 00000100:00100000:0.0:1783952115.697181:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447753856 00000100:00100000:0.0:1783952115.697184:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447753856 00000100:00100000:3.0:1783952115.697246:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1329 00000100:00100000:3.0:1783952115.697257:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447753728:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783952115.697290:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952115.697385:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447753728:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 121us (350us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952115.697394:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1329 00000100:00100000:0.0:1783952115.698231:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1321 00000100:00100000:0.0:1783952115.698243:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2397:x1870605447753856:12345-192.168.202.48@tcp:38:kworker.0 00010000:02000400:0.0:1783952115.698272:0:68591:0:(ldlm_lib.c:964:target_handle_reconnect()) lustre-MDT0001: Client d33551be-a709-4ba2-a74c-f4d7b53c6817 (at 192.168.202.48@tcp) reconnecting 00000100:00080000:3.0:1783952115.698386:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783952115.704314:0:68591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp t0 exp ffff97b0410df000 cur 3830 last 1783952115 00000100:00100000:2.0:1783952115.704325:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447754112 00000100:00100000:2.0:1783952115.704337:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447754112 00000004:00100000:0.0:1783952115.704353:0:68591:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli 192.168.202.48@tcp supports cksum type f7, return f7 00000100:00100000:1.0:1783952115.704371:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447753984 00000100:00100000:1.0:1783952115.704376:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447753984 00000100:00080000:0.0:1783952115.704395:0:68591:0:(import.c:65:import_set_state_nolock()) ffff97b0410de800 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1783952115.704405:0:68591:0:(import.c:65:import_set_state_nolock()) ffff97b0410de800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783952115.704453:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2802 00000100:00100000:2.0:1783952115.704465:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447754112:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952115.704528:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2803 00000100:00100000:1.0:1783952115.704537:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447753984:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952115.704581:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2397:x1870605447753856:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 6339us (7500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952115.704614:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1321 00000100:00100000:2.0:1783952115.704731:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447754112:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 267us (7939us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952115.704739:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2802 00000100:00080000:3.0:1783952115.712154:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952115.712163:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952115.712560:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447753984:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 7954us (15638us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952115.712574:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2803 00000100:00100000:0.0:1783952115.712723:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952115.716632:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447751424 00000100:00100000:1.0:1783952115.716648:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447751424 00000100:00100000:1.0:1783952115.717203:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:1.0:1783952115.717215:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447751424:12345-192.168.202.48@tcp:700:cp.0 00000100:00080000:1.0:1783952115.717288:0:66257:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff97b14de1c700 x1870605465518464/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952115.717299:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:0.0:1783952116.256889:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952116.320730:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:1.0:1783952116.774153:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:2.0:1783952117.282725:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952117.345138:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:0.0:1783952117.345459:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465518592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952117.345609:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952117.345648:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952117.345654:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465518720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952117.345809:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952117.347313:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465518592 00000100:00100000:1.0:1783952117.347323:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465518592 00000100:00100000:1.0:1783952117.347391:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465518720 00000100:00100000:1.0:1783952117.347394:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465518720 00000100:00100000:1.0:1783952117.347411:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:1.0:1783952117.347419:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465518592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952117.347451:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952117.347513:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465518592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952117.347533:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00100000:1.0:1783952117.347547:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:1.0:1783952117.347553:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465518720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952117.347570:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952117.347609:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465518720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952117.347615:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:1.0:1783952117.347652:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465518720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952117.347676:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465518592:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783952117.348098:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952117.348103:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952117.792694:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:1.0:1783952118.304938:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952118.377605:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:1.0:1783952118.816789:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:1.0:1783952119.328944:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952119.403863:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:1.0:1783952119.841162:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00000100:00080000:0.0:1783952119.906374:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952119.906381:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952119.906385:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952119.906393:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3829 00000100:00080000:0.0:1783952119.906399:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783952119.906405:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952119.906427:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac6300 x1870605465518976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952119.906453:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952119.906457:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952119.906459:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952119.906462:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3829 00000100:00080000:0.0:1783952119.906465:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783952119.906468:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952119.906478:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac5500 x1870605465519232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952119.906504:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952119.906508:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952119.906510:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952119.906513:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3829 00000100:00080000:0.0:1783952119.906517:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783952119.906520:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952119.906532:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac4700 x1870605465519488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952119.906552:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952119.906563:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952119.906565:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952119.906568:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3829 00000100:00080000:0.0:1783952119.906571:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783952119.906575:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952119.906611:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac4a80 x1870605465519872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952119.906797:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465518976:0@lo:38:kworker.0 00000100:00100000:0.0:1783952119.906863:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952119.906896:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465519232:0@lo:38:kworker.0 00000100:00100000:0.0:1783952119.906919:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952119.906949:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465519488:0@lo:38:kworker.0 00000100:00100000:0.0:1783952119.906975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952119.906992:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465519872:0@lo:38:kworker.0 00000100:00100000:0.0:1783952119.907013:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952119.907050:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465519360:0@lo:400:kworker.0 00000100:00100000:0.0:1783952119.907075:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952119.907094:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952119.907100:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465519616:0@lo:400:kworker.0 00000100:00100000:0.0:1783952119.907122:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952119.907153:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465518976 00000100:00100000:0.0:1783952119.907159:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465518976 00000100:00100000:0.0:1783952119.907188:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465519232 00000100:00100000:0.0:1783952119.907191:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465519232 00000100:00100000:3.0:1783952119.907316:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465519104:0@lo:400:kworker.0 00000100:00100000:3.0:1783952119.907346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952119.907360:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783952119.907366:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465518848:0@lo:400:kworker.0 00000400:00000100:3.0:1783952119.907385:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465518848 offset 0 length 224: 4 00000100:00100000:3.0:1783952119.907405:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465519744:0@lo:400:kworker.0 00000100:00100000:3.0:1783952119.907439:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952119.907825:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465519872 00000100:00100000:0.0:1783952119.907829:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465519872 00000100:00100000:0.0:1783952119.907851:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465519360 00000100:00100000:0.0:1783952119.907853:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465519360 00000100:00100000:0.0:1783952119.907881:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465519104 00000100:00100000:0.0:1783952119.907884:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465519104 00000100:00100000:0.0:1783952119.907899:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1783952119.907907:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465519360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952119.907969:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465519360:12345-0@lo:400:kworker.0 Request processed in 62us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952119.907976:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1783952119.907993:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1783952119.907999:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465519104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952119.908031:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465519104:12345-0@lo:400:kworker.0 Request processed in 32us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952119.908037:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1783952119.908049:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1783952119.908053:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465518976:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952119.908070:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952119.908101:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465518976:12345-0@lo:38:kworker.0 Request processed in 47us (1238us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952119.908107:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1783952119.908120:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1783952119.908124:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465519232:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952119.908133:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952119.908156:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465519232:12345-0@lo:38:kworker.0 Request processed in 31us (1237us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952119.908162:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1783952119.908180:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1783952119.908184:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465519872:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952119.908193:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952119.909853:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465519872:12345-0@lo:38:kworker.0 Request processed in 1661us (2833us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952119.909866:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1783952119.909883:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465519616 00000100:00100000:1.0:1783952119.909890:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465519616 00000100:00100000:0.0:1783952119.909891:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465519744 00000100:00100000:0.0:1783952119.909894:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465519744 00000100:00100000:1.0:1783952119.910128:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:1.0:1783952119.910345:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465519616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952119.910723:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465519616:12345-0@lo:400:kworker.0 Request processed in 381us (3598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952119.910824:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00000100:00100000:0.0:1783952119.910830:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:0.0:1783952119.910839:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465519744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952119.910862:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465519488 00000100:00100000:1.0:1783952119.910867:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465519488 00000100:00100000:0.0:1783952119.910875:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465519744:12345-0@lo:400:kworker.0 Request processed in 38us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952119.910881:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00100000:1.0:1783952119.910889:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:1.0:1783952119.910893:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465519488:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1783952119.910897:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952119.910901:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952119.910903:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00020000:1.0:1783952119.910918:0:23862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952119.910948:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465519744:0@lo:400:kworker.0 00000100:00100000:1.0:1783952119.910961:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465519488:12345-0@lo:38:kworker.0 Request processed in 66us (3984us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952119.910964:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465519104:0@lo:400:kworker.0 00000100:00100000:1.0:1783952119.910967:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:0.0:1783952119.911017:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465519616:0@lo:400:kworker.0 00000100:00100000:0.0:1783952119.911030:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465519360:0@lo:400:kworker.0 00000100:00080000:0.0:1783952119.911060:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952119.911066:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952119.911069:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465518976:0@lo:38:kworker.0 00000100:00080000:0.0:1783952119.911078:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952119.911088:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952119.911091:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465519232:0@lo:38:kworker.0 00000100:00080000:0.0:1783952119.911103:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952119.911106:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952119.911109:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465519488:0@lo:38:kworker.0 00000100:00080000:0.0:1783952119.911119:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952119.911122:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952119.911124:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465519872:0@lo:38:kworker.0 00010000:00010000:1.0:1783952120.354995:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952120.424770:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:3.0:1783952120.827131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952120.827181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952120.827207:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:3.0:1783952120.827227:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447754368 offset 0 length 224: 4 00000100:00100000:3.0:1783952120.827252:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952120.827283:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447754752 00000100:00100000:3.0:1783952120.827292:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447754752 00000100:00100000:3.0:1783952120.827349:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447754880 00000100:00100000:3.0:1783952120.827352:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447754880 00000100:00100000:3.0:1783952120.827395:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4939 00000100:00100000:3.0:1783952120.827406:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447754752:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:3.0:1783952120.827436:0:26198:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb55d0 00000100:00080000:3.0:1783952120.827446:0:26198:0:(import.c:65:import_set_state_nolock()) ffff97b146945800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783952120.827507:0:26198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968954 00000100:00100000:3.0:1783952120.827897:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+2:2397:x1870605447754752:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 492us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952120.827906:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4939 00000100:00100000:3.0:1783952120.827933:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4940 00000100:00100000:3.0:1783952120.827940:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447754880:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:3.0:1783952120.827952:0:26198:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb55d7 00000100:00080000:3.0:1783952120.827957:0:26198:0:(import.c:65:import_set_state_nolock()) ffff97b1476fe800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783952120.827980:0:26198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968955 00000100:00100000:3.0:1783952120.828053:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+2:2397:x1870605447754880:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 114us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952120.828060:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4940 00000100:00100000:3.0:1783952120.828100:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447754496 00000100:00100000:3.0:1783952120.828107:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447754496 00000100:00100000:3.0:1783952120.828128:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447754624 00000100:00100000:3.0:1783952120.828131:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447754624 00000100:00100000:3.0:1783952120.828155:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1324 00000100:00100000:3.0:1783952120.828161:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2399:x1870605447754624:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952120.828190:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2399:x1870605447754624:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952120.828196:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1324 00000100:00100000:3.0:1783952120.828208:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1333 00000100:00100000:3.0:1783952120.828212:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447754496:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783952120.828231:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952120.828255:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447754496:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 41us (1135us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952120.828260:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1333 00000100:00080000:0.0:1783952120.828676:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952120.828680:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952120.828682:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783952120.829324:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952120.835034:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952120.867714:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00000100:00000400:3.0:1783952120.943817:0:3642:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783952104/real 1783952104] req@ffff97b04b602d80 x1870605465513728/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783952120 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952120.943856:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff97b04b602d80 x1870605465513728/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783952120 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952120.943865:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1783952120.943869:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1783952120.943872:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.148@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1783952120.943874:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783952120.943890:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b04b602d80 x1870605465513728/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783952120 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952120.943899:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b16dd4fb80 x1870605465515904/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952125 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952120.943906:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b144915f80 x1870605465517312/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952130 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952120.943944:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b047ac5880 x1870605465518848/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952135 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783952120.943959:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783952120.943962:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783952120.943963:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783952120.943965:0:3642:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1783952120.944402:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465517312:0@lo:400:kworker.0 00000100:00100000:3.0:1783952120.944439:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465518848:0@lo:400:kworker.0 00000100:00080000:3.0:1783952120.944456:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952120.944461:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783952120.944463:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952120.944467:0:40998:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3778 00000100:00080000:3.0:1783952120.944475:0:40998:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952120.950617:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b164e3f800 x1870605465520000/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952120.950655:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952120.950660:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952120.950663:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952120.950668:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3834 00000100:00080000:3.0:1783952120.950672:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783952120.950679:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952120.950712:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b164e3d500 x1870605465520128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952120.950741:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952120.950745:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952120.950747:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952120.950750:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3834 00000100:00080000:3.0:1783952120.950753:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783952120.950756:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952120.950768:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b164e3ce00 x1870605465520384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952120.950797:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952120.950800:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952120.950802:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952120.950805:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3834 00000100:00080000:3.0:1783952120.950808:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783952120.950811:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952120.950825:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b164e3d880 x1870605465520640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952120.950844:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952120.950846:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952120.950848:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952120.950850:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3834 00000100:00080000:3.0:1783952120.950852:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783952120.950855:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952120.950870:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b164e3df80 x1870605465521024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952120.950906:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465520000:0@lo:250:kworker.0 00000400:00000100:3.0:1783952120.950967:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465520000 offset 0 length 520: 4 00000100:00100000:3.0:1783952120.951002:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465520128:0@lo:38:kworker.0 00000100:00100000:3.0:1783952120.951030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952120.951048:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465520384:0@lo:38:kworker.0 00000100:00100000:3.0:1783952120.951066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952120.951079:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465520640:0@lo:38:kworker.0 00000100:00100000:3.0:1783952120.951098:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952120.951111:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465521024:0@lo:38:kworker.0 00000100:00100000:3.0:1783952120.951127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952120.951155:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465520256:0@lo:400:kworker.0 00000100:00100000:3.0:1783952120.951175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952120.951189:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952120.951194:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465520896:0@lo:400:kworker.0 00000100:00100000:3.0:1783952120.951213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952120.951239:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465520128 00000100:00100000:3.0:1783952120.951245:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465520128 00000100:00100000:3.0:1783952120.951271:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465520384 00000100:00100000:3.0:1783952120.951273:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465520384 00000100:00100000:3.0:1783952120.951283:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465521024 00000100:00100000:3.0:1783952120.951285:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465521024 00000100:00100000:3.0:1783952120.951291:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465520256 00000100:00100000:3.0:1783952120.951293:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465520256 00000100:00100000:3.0:1783952120.951314:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:3.0:1783952120.951328:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465520256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952120.951375:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465520256:12345-0@lo:400:kworker.0 Request processed in 48us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952120.951382:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:3.0:1783952120.951397:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1783952120.951401:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465520128:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952120.951420:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952120.951444:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465520128:12345-0@lo:38:kworker.0 Request processed in 42us (414us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952120.951450:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1783952120.951460:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1783952120.951464:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465520384:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952120.951472:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952120.951614:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465520768:0@lo:400:kworker.0 00000100:00100000:1.0:1783952120.951643:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952120.951670:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952120.951675:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465520512:0@lo:400:kworker.0 00000100:00100000:1.0:1783952120.951695:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952120.952626:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465520896 00000100:00100000:2.0:1783952120.952636:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465520896 00000100:00100000:2.0:1783952120.952678:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465520768 00000100:00100000:2.0:1783952120.952680:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465520768 00000100:00100000:2.0:1783952120.952711:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:2.0:1783952120.952719:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465520896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952120.952771:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465520896:12345-0@lo:400:kworker.0 Request processed in 52us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952120.952778:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000100:00100000:2.0:1783952120.952791:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:2.0:1783952120.952796:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465520768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952120.952823:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465520768:12345-0@lo:400:kworker.0 Request processed in 28us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952120.952829:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00000100:00100000:2.0:1783952120.952943:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465520768:0@lo:400:kworker.0 00000100:00100000:2.0:1783952120.953751:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465520512 00000100:00100000:2.0:1783952120.953758:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465520512 00000100:00100000:2.0:1783952120.953787:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:2.0:1783952120.953793:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465520512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952120.953852:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465520512:12345-0@lo:400:kworker.0 Request processed in 59us (2156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952120.953858:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:2.0:1783952120.953871:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1783952120.953876:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465521024:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952120.953893:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952120.953916:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465521024:12345-0@lo:38:kworker.0 Request processed in 39us (2788us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952120.953936:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1783952120.953963:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465520640 00000100:00100000:2.0:1783952120.953967:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465520640 00000100:00100000:2.0:1783952120.953987:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:2.0:1783952120.953992:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465520640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952120.954001:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952120.954028:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465520640:12345-0@lo:38:kworker.0 Request processed in 35us (2929us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952120.954034:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:2.0:1783952120.954068:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465520512:0@lo:400:kworker.0 00000100:00100000:3.0:1783952120.956728:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1870605465520384:12345-0@lo:38:kworker.0 Request processed in 25us (422us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952120.956744:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:2.0:1783952120.956883:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465515904:0@lo:400:kworker.0 00000100:00100000:2.0:1783952120.956893:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465513728:0@lo:400:kworker.0 00000100:00100000:3.0:1783952120.957082:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465520896:0@lo:400:kworker.0 00000100:00100000:3.0:1783952120.957098:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465520256:0@lo:400:kworker.0 00000100:00080000:3.0:1783952120.957136:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952120.957141:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952120.957144:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465520128:0@lo:38:kworker.0 00000100:00080000:3.0:1783952120.957154:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952120.957157:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952120.957159:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465520384:0@lo:38:kworker.0 00000100:00080000:3.0:1783952120.957193:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952120.957196:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952120.957199:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465520640:0@lo:38:kworker.0 00000100:00080000:3.0:1783952120.957208:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952120.957211:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952120.957214:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465521024:0@lo:38:kworker.0 00000400:00000100:2.0:1783952121.262785:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447755008 offset 0 length 520: 4 00010000:00010000:1.0:1783952121.377949:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952121.446190:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:1.0:1783952121.891725:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00000100:00100000:0.0:1783952121.953765:0:66258:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:0.0:1783952121.953782:0:66258:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00010000:00010000:1.0:1783952122.410407:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952122.464820:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465521152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952122.464884:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952122.464945:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952122.464953:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465521280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952122.464975:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952122.465002:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465521152 00000100:00100000:3.0:1783952122.465008:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465521152 00000100:00100000:3.0:1783952122.465052:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465521280 00000100:00100000:3.0:1783952122.465055:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465521280 00000100:00100000:3.0:1783952122.465070:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:3.0:1783952122.465077:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465521152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783952122.465107:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952122.465144:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465521152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952122.465150:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:3.0:1783952122.465164:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00100000:3.0:1783952122.465169:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465521280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783952122.465183:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952122.465208:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465521280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952122.465221:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00080000:3.0:1783952122.465239:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952122.465242:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952122.465273:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465521280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952122.465302:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465521152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952122.465609:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:2.0:1783952122.918684:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:3.0:1783952123.427983:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952123.489249:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000020:01000004:0.0:1783952123.533282:0:92491:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783952123.533289:0:92491:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1783952123.533290:0:92491:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783952123.533402:0:92491:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97b174b36000 00000020:01000004:0.0:1783952123.533467:0:92491:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1783952123.533481:0:92491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783952123.533495:0:92491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97b048b5b380) 00000020:00000080:0.0:1783952123.533513:0:92491:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783952123.708825:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783952123.709403:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783952123.711488:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783952123.711969:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783952123.712798:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783952123.713212:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783952123.714118:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783952123.715468:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783952123.716079:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783952123.718376:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783952123.719384:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1783952123.721059:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1783952123.721489:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1783952123.721935:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783952123.725150:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1783952123.725774:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.726092:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.726366:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.727024:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.727329:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.727573:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.727998:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.728400:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.728795:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.729141:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.729425:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.729650:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.730167:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.730473:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.730812:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.731154:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.731401:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.731649:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.732128:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.732794:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.733156:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.733353:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.733571:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.734042:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.734235:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.734422:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.734797:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.735167:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.735368:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1783952123.735621:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.736089:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.736321:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1783952123.739461:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1783952123.740381:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1783952123.740669:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1783952123.741345:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1783952123.741574:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1783952123.742039:0:92491:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1783952123.743194:0:92491:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783952123.743423:0:92491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1783952123.743433:0:92491:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783952123.743446:0:92491:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5663 00000020:01000004:1.0:1783952123.743453:0:92491:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1783952123.743464:0:92491:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1783952123.743470:0:92491:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b174b36000 from MGS 00000020:01000004:1.0:1783952123.743474:0:92491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1783952123.743485:0:92491:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97b1447b99c0) 00000020:00000080:1.0:1783952123.743500:0:92491:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:1.0:1783952123.743567:0:92491:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b174b36000 from MGS, refs=2 00080000:01000000:1.0:1783952123.743572:0:92491:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783952123.743577:0:92491:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5671 00010000:00010000:1.0:1783952123.743763:0:92491:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1783952123.750252:0:92491:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783952123.753465:0:92496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783952123.753518:0:92491:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783952123.753571:0:92491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783952123.754475:0:92491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783952123.754980:0:92491:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783952123.755113:0:92491:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783952123.755119:0:92491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783952123.760641:0:92491:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783952123.760655:0:92491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783952123.761114:0:92491:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783952123.761120:0:92491:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783952123.761810:0:92491:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783952123.761846:0:92491:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1783952123.761848:0:92491:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1783952123.761852:0:92491:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1783952123.761857:0:92491:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 75, was 0): CONNECTING 00000100:00100000:3.0:1783952123.761863:0:92491:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1783952123.936733:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:3.0:1783952124.449236:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952124.512707:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:0.0:1783952124.960794:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:1.0:1783952125.472830:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952125.536772:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:0.0:1783952125.985092:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00000100:00080000:1.0:1783952126.048886:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952126.048897:0:86521:0:(pinger.c:247:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783952126.048916:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952126.048930:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952126.048935:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952126.048943:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3835 00000100:00080000:1.0:1783952126.048948:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952126.048956:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952126.048996:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1f800 x1870605465521408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952126.049062:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952126.049067:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952126.049069:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952126.049072:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3835 00000100:00080000:1.0:1783952126.049075:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952126.049078:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952126.049091:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1e300 x1870605465521664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952126.049112:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952126.049116:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952126.049117:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952126.049121:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3835 00000100:00080000:1.0:1783952126.049123:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952126.049126:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952126.049138:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1e680 x1870605465521920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952126.049175:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952126.049178:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952126.049180:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952126.049183:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3835 00000100:00080000:1.0:1783952126.049185:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952126.049189:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952126.049199:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b048e35180 x1870605465522304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952126.049283:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465521536:0@lo:400:kworker.0 00000100:00100000:0.0:1783952126.049359:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952126.049403:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783952126.049409:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465522176:0@lo:400:kworker.0 00000100:00100000:0.0:1783952126.049436:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952126.049505:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465521792:0@lo:400:kworker.0 00000100:00100000:3.0:1783952126.049539:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952126.049568:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952126.049573:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465522048:0@lo:400:kworker.0 00000100:00100000:3.0:1783952126.049617:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952126.049657:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465522176 00000100:00100000:3.0:1783952126.049664:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465522176 00000100:00100000:3.0:1783952126.049733:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465522048 00000100:00100000:3.0:1783952126.049737:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465522048 00000100:00100000:3.0:1783952126.049762:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808 00000100:00100000:3.0:1783952126.049771:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465522176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952126.049819:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465522176:12345-0@lo:400:kworker.0 Request processed in 49us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952126.049832:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808 00000100:00100000:3.0:1783952126.049847:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:3.0:1783952126.049853:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465522048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952126.049897:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465522048:12345-0@lo:400:kworker.0 Request processed in 45us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952126.049903:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00080000:3.0:1783952126.049924:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952126.049928:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952126.049944:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465521408:0@lo:38:kworker.0 00000100:00100000:3.0:1783952126.049969:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952126.049989:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465521664:0@lo:38:kworker.0 00000100:00100000:3.0:1783952126.050007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952126.050023:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465521920:0@lo:38:kworker.0 00000100:00100000:3.0:1783952126.050048:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952126.050063:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465522304:0@lo:38:kworker.0 00000100:00100000:3.0:1783952126.050082:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952126.050111:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465521536 00000100:00100000:3.0:1783952126.050114:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465521536 00000100:00100000:3.0:1783952126.050144:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465521792 00000100:00100000:3.0:1783952126.050147:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465521792 00000100:00100000:3.0:1783952126.050159:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465521408 00000100:00100000:3.0:1783952126.050161:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465521408 00000100:00100000:3.0:1783952126.050169:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465521664 00000100:00100000:3.0:1783952126.050171:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465521664 00000100:00100000:3.0:1783952126.050176:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465522304 00000100:00100000:3.0:1783952126.050178:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465522304 00000100:00100000:3.0:1783952126.050187:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1783952126.050200:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465521536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952126.050233:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465521536:12345-0@lo:400:kworker.0 Request processed in 34us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952126.050239:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1783952126.050252:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1783952126.050257:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465521792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952126.050282:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465521792:12345-0@lo:400:kworker.0 Request processed in 25us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952126.050287:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1783952126.050296:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1783952126.050300:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465521408:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952126.050316:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952126.050344:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465521408:12345-0@lo:38:kworker.0 Request processed in 42us (374us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952126.050348:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1783952126.050358:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1783952126.050362:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465521664:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952126.050369:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952126.050387:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465521664:12345-0@lo:38:kworker.0 Request processed in 24us (379us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952126.050391:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1783952126.050401:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1783952126.050404:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465522304:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952126.050411:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952126.050442:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465522304:12345-0@lo:38:kworker.0 Request processed in 35us (358us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952126.050448:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00080000:3.0:1783952126.050472:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952126.050500:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465522048:0@lo:400:kworker.0 00000100:00100000:3.0:1783952126.050513:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465521792:0@lo:400:kworker.0 00000100:00080000:3.0:1783952126.050541:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952126.050545:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952126.050547:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465521408:0@lo:38:kworker.0 00000100:00080000:3.0:1783952126.050555:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952126.050558:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952126.050561:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465521664:0@lo:38:kworker.0 00000100:00080000:3.0:1783952126.050568:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952126.050571:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952126.050573:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465522304:0@lo:38:kworker.0 00000100:00100000:3.0:1783952126.050623:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465522176:0@lo:400:kworker.0 00000100:00100000:3.0:1783952126.050633:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465521536:0@lo:400:kworker.0 00000100:00100000:1.0:1783952126.050959:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465521920 00000100:00100000:1.0:1783952126.050965:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465521920 00000100:00100000:1.0:1783952126.051001:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:1.0:1783952126.051006:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465521920:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952126.051018:0:23862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952126.051062:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465521920:12345-0@lo:38:kworker.0 Request processed in 55us (1013us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952126.051067:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00080000:3.0:1783952126.051347:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952126.051353:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952126.051356:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465521920:0@lo:38:kworker.0 00000100:00100000:3.0:1783952126.448781:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952126.448829:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952126.448948:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447755264 00000100:00100000:1.0:1783952126.448958:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447755264 00000100:00100000:1.0:1783952126.449026:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447755136 00000100:00100000:1.0:1783952126.449029:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447755136 00000100:00100000:1.0:1783952126.449045:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1329 00000100:00100000:1.0:1783952126.449056:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2399:x1870605447755264:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952126.449135:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2399:x1870605447755264:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 80us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952126.449143:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1329 00000100:00100000:1.0:1783952126.449175:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1340 00000100:00100000:1.0:1783952126.449179:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870605447755136:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:1.0:1783952126.449202:0:66238:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952126.449231:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1870605447755136:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 49us (401us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952126.449238:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1340 00000100:00080000:3.0:1783952126.450431:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783952126.497629:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952126.560760:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:0.0:1783952127.008753:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00000001:00100000:3.0:1783952127.079428:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000020:00000080:3.0:1783952127.079438:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b146940000/d33551be-a709-4ba2-a74c-f4d7b53c6817 00000020:00000080:0.0:1783952127.079637:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b146940000/d33551be-a709-4ba2-a74c-f4d7b53c6817 for lustre-OST0001 00000020:00000080:0.0:1783952127.079707:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1476fe800 for lustre-OST0001 00000001:00100000:1.0:1783952127.081141:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000020:00000080:1.0:1783952127.081147:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b146944000/d33551be-a709-4ba2-a74c-f4d7b53c6817 00000020:00000080:2.0:1783952127.081253:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b146944000/d33551be-a709-4ba2-a74c-f4d7b53c6817 for lustre-OST0000 00000020:00000080:2.0:1783952127.081305:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b146945800 for lustre-OST0000 00010000:00010000:3.0:1783952127.520814:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952127.584722:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:3.0:1783952127.586514:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465522560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952127.586615:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952127.586725:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465522560 00000100:00100000:1.0:1783952127.586732:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465522560 00000100:00100000:1.0:1783952127.586785:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00100000:1.0:1783952127.586795:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465522560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952127.586825:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952127.586890:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465522560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952127.586897:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00100000:0.0:1783952127.586909:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465522432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952127.586942:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952127.587118:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465522432 00000100:00100000:1.0:1783952127.587122:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465522432 00000100:00100000:1.0:1783952127.587156:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:1.0:1783952127.587163:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465522432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952127.587180:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952127.587208:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465522432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952127.587214:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00100000:0.0:1783952127.587306:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465522432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952127.587741:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465522560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952128.032723:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:3.0:1783952128.544914:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952128.608764:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:1.0:1783952129.058622:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:1.0:1783952129.568739:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952129.632733:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:1.0:1783952130.080707:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00000100:00100000:0.0:1783952130.145282:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783952120/real 1783952120] req@ffff97b164e3f800 x1870605465520000/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783952130 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952130.145318:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97b164e3f800 x1870605465520000/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783952130 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.145341:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.145368:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783952130.145383:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465520000:0@lo:250:kworker.0 00000100:00080000:1.0:1783952130.145516:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952130.145522:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783952130.145524:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952130.145529:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3835 00000100:00080000:1.0:1783952130.145534:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783952130.145540:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952130.145573:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b048e34380 x1870605465522688/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952130.145618:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952130.145622:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952130.145624:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952130.145628:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3840 00000100:00080000:1.0:1783952130.145630:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952130.145634:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952130.145652:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b048e36300 x1870605465522816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952130.145684:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952130.145687:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952130.145689:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952130.145692:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3840 00000100:00080000:1.0:1783952130.145694:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952130.145713:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952130.145726:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b048e35880 x1870605465523072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952130.145752:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952130.145756:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952130.145758:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952130.145761:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3840 00000100:00080000:1.0:1783952130.145763:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952130.145767:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952130.145779:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de29c00 x1870605465523328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952130.145800:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952130.145804:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952130.145806:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952130.145809:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3840 00000100:00080000:1.0:1783952130.145811:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952130.145814:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952130.145824:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab00000 x1870605465523712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952130.145858:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465522944:0@lo:400:kworker.0 00000100:00100000:1.0:1783952130.145925:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.145956:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952130.145962:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465523584:0@lo:400:kworker.0 00000100:00100000:1.0:1783952130.145987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.146022:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465523200:0@lo:400:kworker.0 00000100:00100000:1.0:1783952130.146046:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.146064:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783952130.146069:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465523456:0@lo:400:kworker.0 00000100:00100000:1.0:1783952130.146104:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.146134:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465522944 00000100:00100000:1.0:1783952130.146142:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465522944 00000100:00100000:1.0:1783952130.146187:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465523200 00000100:00100000:1.0:1783952130.146190:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465523200 00000100:00100000:1.0:1783952130.146212:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1783952130.146221:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465522944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952130.146270:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465522944:12345-0@lo:400:kworker.0 Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.146277:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1783952130.146297:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1783952130.146303:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465523200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952130.146332:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465523200:12345-0@lo:400:kworker.0 Request processed in 29us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.146337:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1783952130.146372:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465523200:0@lo:400:kworker.0 00000100:00100000:1.0:1783952130.146398:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465522944:0@lo:400:kworker.0 00000100:00100000:0.0:1783952130.146745:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465523584 00000100:00100000:0.0:1783952130.146751:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465523584 00000100:00100000:0.0:1783952130.146790:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465523456 00000100:00100000:0.0:1783952130.146794:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465523456 00000100:00100000:0.0:1783952130.146822:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:0.0:1783952130.146829:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465523584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952130.146880:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465523584:12345-0@lo:400:kworker.0 Request processed in 52us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952130.146895:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00100000:0.0:1783952130.146908:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:0.0:1783952130.146914:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465523456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952130.146947:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465523456:12345-0@lo:400:kworker.0 Request processed in 33us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952130.146953:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00000100:00020000:0.0:1783952130.146980:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b048e34380 x1870605465522688/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.147000:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.147013:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.147016:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465522688:0@lo:250:kworker.0 00000100:00100000:0.0:1783952130.147022:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465522816:0@lo:38:kworker.0 00000100:00100000:0.0:1783952130.147051:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.147069:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465523072:0@lo:38:kworker.0 00000100:00100000:0.0:1783952130.147102:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.147117:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465523328:0@lo:38:kworker.0 00000100:00100000:0.0:1783952130.147140:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.147156:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465523712:0@lo:38:kworker.0 00000100:00100000:0.0:1783952130.147177:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.147217:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465523456:0@lo:400:kworker.0 00000100:00100000:0.0:1783952130.147241:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465523584:0@lo:400:kworker.0 00000100:00100000:0.0:1783952130.147257:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465522816 00000100:00100000:0.0:1783952130.147260:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465522816 00000100:00100000:0.0:1783952130.147284:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465523072 00000100:00100000:0.0:1783952130.147287:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465523072 00000100:00100000:0.0:1783952130.147298:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465523712 00000100:00100000:0.0:1783952130.147301:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465523712 00000100:00100000:0.0:1783952130.147313:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1783952130.147318:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465522816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952130.147337:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952130.147371:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465522816:12345-0@lo:38:kworker.0 Request processed in 51us (320us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952130.147377:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1783952130.147389:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1783952130.147393:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465523072:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952130.147402:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952130.147426:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465523072:12345-0@lo:38:kworker.0 Request processed in 31us (323us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952130.147431:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1783952130.147442:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1783952130.147445:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465523712:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952130.147454:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952130.147476:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465523712:12345-0@lo:38:kworker.0 Request processed in 29us (299us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952130.147482:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00080000:0.0:1783952130.147503:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.147508:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.147511:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.147514:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.147524:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783952130.147528:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.147546:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465523840/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.147571:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465523840/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.147579:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.147614:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.147617:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465523840:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.147630:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.147633:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952130.147636:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465522816:0@lo:38:kworker.0 00000100:00080000:0.0:1783952130.147643:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.147646:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952130.147649:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465523072:0@lo:38:kworker.0 00000100:00080000:0.0:1783952130.147657:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.147660:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952130.147662:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465523712:0@lo:38:kworker.0 00000100:00080000:0.0:1783952130.147824:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.147827:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.147829:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.147832:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.147843:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783952130.147847:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.147864:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465523968/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.147889:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465523968/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.147897:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.147904:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.147907:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465523968:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.147920:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.147924:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.147925:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.147928:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.147930:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.147933:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.147942:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465524096/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.147961:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465524096/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.147967:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.147973:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.147975:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465524096:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.147999:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148003:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148005:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148008:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148010:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148030:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148040:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465524224/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148061:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465524224/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148068:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148188:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148193:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465524224:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.148209:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148212:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148214:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148216:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148219:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148222:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148232:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465524352/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148253:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465524352/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148260:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148267:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148270:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465524352:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.148282:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148285:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148287:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148289:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148297:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148300:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148310:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465524480/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148331:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465524480/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148338:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148344:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148346:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465524480:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.148358:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148361:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148363:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148366:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148368:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148371:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148380:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465524608/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148412:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465524608/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148419:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148425:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148428:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465524608:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.148441:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148444:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148445:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148454:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148456:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148459:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148469:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465524736/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148491:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465524736/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148498:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148503:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148505:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465524736:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.148517:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148520:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148521:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148524:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148526:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148529:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148538:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465524864/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148558:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465524864/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148564:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148571:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148573:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465524864:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.148612:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148615:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148621:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148625:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148627:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148630:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148640:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465524992/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148662:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465524992/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148669:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148675:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148677:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465524992:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.148690:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148693:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148695:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148697:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148699:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148702:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148711:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465525120/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148732:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465525120/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148739:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148745:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148748:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465525120:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.148759:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148770:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148772:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148775:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148778:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148781:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148791:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465525248/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148812:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465525248/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148818:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148824:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148826:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465525248:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.148849:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148852:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148854:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148857:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148859:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148862:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148871:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465525376/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148890:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465525376/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148896:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148902:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148905:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465525376:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.148927:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.148930:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.148932:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.148935:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.148937:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.148940:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.148950:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465525504/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.148972:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465525504/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.148980:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.148987:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.148990:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465525504:0@lo:250:kworker.0 00000100:00080000:0.0:1783952130.149002:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952130.149005:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952130.149006:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952130.149009:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:0.0:1783952130.149011:0:86521:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952130.149013:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952130.149023:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047ac7800 x1870605465525632/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:0.0:1783952130.149042:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b047ac7800 x1870605465525632/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952130.149049:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952130.149056:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1783952130.149066:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465525632:0@lo:250:kworker.0 00000100:00080000:3.0:1783952130.149241:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952130.149246:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952130.149249:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 10000000:01000000:3.0:1783952130.149273:0:92491:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1783952130.149289:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb5226 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb522d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.149300:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb5226 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb522d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.149307:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1783952130.149319:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.149329:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb5226 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb522d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.149348:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb518c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5193 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.149354:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb518c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5193 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.149359:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952130.149363:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.149374:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb518c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5193 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.149385:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70000/0x22c73c7857bb51a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb51af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.149391:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70000/0x22c73c7857bb51a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb51af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.149397:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952130.149400:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.149403:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70000/0x22c73c7857bb51a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb51af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.149412:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b140031400/0x22c73c7857bb51d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb51d9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.149418:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b140031400/0x22c73c7857bb51d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb51d9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.149425:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952130.149428:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.149431:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b140031400/0x22c73c7857bb51d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb51d9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.149441:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb51e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb51e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.149447:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb51e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb51e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.149462:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952130.149466:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.149470:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb51e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb51e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.149479:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb51fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5203 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.149486:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb51fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5203 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.149491:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952130.149494:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.149497:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86a600/0x22c73c7857bb51fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5203 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.149505:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbd400/0x22c73c7857bb520a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5211 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.149511:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbd400/0x22c73c7857bb520a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5211 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.149516:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952130.149519:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.149522:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbd400/0x22c73c7857bb520a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5211 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.149532:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb5234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb523b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.149548:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb5234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb523b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.149553:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952130.149557:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.149560:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70a00/0x22c73c7857bb5234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb523b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.149572:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb519a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb51a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.149578:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb519a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb51a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.149583:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1783952130.149704:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465523328 00000100:00100000:2.0:1783952130.149711:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465523328 00000100:00100000:2.0:1783952130.149740:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:2.0:1783952130.149746:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465523328:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952130.149765:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:3.0:1783952130.154997:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.155016:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb519a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb51a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.155047:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb51b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb51bd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.155054:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb51b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb51bd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.155060:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952130.155085:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.155089:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb51b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb51bd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.155136:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb51c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb51cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.155142:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb51c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb51cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.155147:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783952130.155151:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.155155:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbde00/0x22c73c7857bb51c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb51cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.155163:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b140031200/0x22c73c7857bb51ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb51f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.155169:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b140031200/0x22c73c7857bb51ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb51f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.155173:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1783952130.155419:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465523328:12345-0@lo:38:kworker.0 Request processed in 5657us (8263us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952130.155431:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00080000:2.0:1783952130.155508:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952130.155514:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952130.155519:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465523328:0@lo:38:kworker.0 00010000:00010000:3.0:1783952130.155611:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.155618:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b140031200/0x22c73c7857bb51ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb51f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.155629:0:92491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70200/0x22c73c7857bb5218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb521f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952130.155635:0:92491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70200/0x22c73c7857bb5218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb521f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.155640:0:92491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783952130.155650:0:92491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1783952130.155655:0:92491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70200/0x22c73c7857bb5218 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb521f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783952130.155674:0:92491:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 91, was 0): DISCONN 00000100:00080000:3.0:1783952130.155680:0:92491:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952130.155683:0:92491:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:3.0:1783952130.155687:0:92491:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783952130.155692:0:92491:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952130.155720:0:92491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd7aa00 x1870605465525760/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952130.155745:0:92491:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1783952130.156508:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465525760:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783952130.156574:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.157235:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465525760 00000100:00100000:3.0:1783952130.157244:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465525760 00000100:00100000:3.0:1783952130.157285:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783952130.157293:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3641:x1870605465525760:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783952130.157321:0:92497:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo t0 exp 0000000000000000 cur 3845 last 0 00000020:00000080:3.0:1783952130.157352:0:92497:0:(genops.c:1406:class_connect()) connect: client 75da5dc4-aa7e-42cf-a965-1b5f01232c6f, cookie 0x22c73c7857bb5678 00000100:00080000:3.0:1783952130.157493:0:92497:0:(import.c:65:import_set_state_nolock()) ffff97b176d53800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952130.157561:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:3641:x1870605465525760:12345-0@lo:250:mount.lustre.0 Request processed in 267us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952130.157569:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783952130.157900:0:3641:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.148@tcp: committing for last_committed 0 gen 28 00000100:00080000:1.0:1783952130.157910:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.148@tcp: connect to target with instance 0 00000100:00080000:1.0:1783952130.157917:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783952130.157921:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783952130.157924:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783952130.157940:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783952130.157967:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783952130.157991:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465525760:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1783952130.158204:0:92491:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1783952130.158216:0:92491:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783952130.158247:0:92491:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1783952130.158253:0:92491:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783952130.158350:0:92491:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783952130.158381:0:92491:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1783952130.158387:0:92491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783952130.158390:0:92491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783952130.158391:0:92491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952130.158392:0:92491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952130.158393:0:92491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952130.158394:0:92491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952130.158395:0:92491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783952130.158396:0:92491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783952130.158398:0:92491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952130.158399:0:92491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783952130.158401:0:92491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1783952130.158403:0:92491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783952130.158404:0:92491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783952130.158405:0:92491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952130.158406:0:92491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952130.158406:0:92491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952130.158407:0:92491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952130.158408:0:92491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783952130.158409:0:92491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783952130.158410:0:92491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952130.158411:0:92491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783952130.158430:0:92491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783952130.158446:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465525888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783952130.158484:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.158519:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144a1dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952130.158577:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465525888 00000100:00100000:1.0:1783952130.158582:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465525888 00000100:00100000:1.0:1783952130.158644:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783952130.158651:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:92491:x1870605465525888:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783952130.158683:0:92499:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783952130.158685:0:92499:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783952130.158688:0:92499:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1783952130.159065:0:92500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:01000000:1.0:1783952130.159705:0:40998:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.148@tcp 10000000:01000000:1.0:1783952130.159721:0:40998:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1783952130.159724:0:40998:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783952130.159726:0:40998:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783952130.159727:0:40998:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783952130.159729:0:40998:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783952130.159730:0:40998:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783952130.159731:0:40998:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783952130.159733:0:40998:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783952130.159734:0:40998:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783952130.159736:0:40998:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783952130.159770:0:40998:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783952130.159777:0:40998:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1783952130.159779:0:40998:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783952130.159780:0:40998:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783952130.159782:0:40998:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783952130.159783:0:40998:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783952130.159784:0:40998:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783952130.159786:0:40998:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783952130.159787:0:40998:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783952130.159788:0:40998:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783952130.159789:0:40998:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783952130.159812:0:40998:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1783952130.159813:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465526016:0@lo:253:kworker.0 10000000:01000000:1.0:1783952130.159817:0:40998:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1783952130.159825:0:40998:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783952130.159826:0:40998:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783952130.159827:0:40998:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783952130.159828:0:40998:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783952130.159830:0:40998:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783952130.159831:0:40998:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783952130.159832:0:40998:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783952130.159833:0:40998:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783952130.159848:0:40998:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783952130.159865:0:40998:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1783952130.159875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.159906:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465526144:0@lo:253:kworker.0 00000100:00100000:2.0:1783952130.159946:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465526272:0@lo:253:kworker.0 00000100:00100000:1.0:1783952130.159947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.160494:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465526016 00000100:00100000:3.0:1783952130.160502:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465526016 00000100:00100000:3.0:1783952130.160531:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465526144 00000100:00100000:3.0:1783952130.160534:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465526144 00000100:00100000:3.0:1783952130.160558:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783952130.160567:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:3645:x1870605465526016:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783952130.160622:0:92497:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1783952130.160892:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:2.0:1783952130.161071:0:92499:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 119 00000100:00100000:3.0:1783952130.163215:0:92498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1783952130.163228:0:92498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1783952130.165260:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465526272 00000100:00100000:3.0:1783952130.165279:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465526272 00000100:00100000:0.0:1783952130.165424:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783952130.165437:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3642:x1870605465526144:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783952130.165473:0:92502:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783952130.167812:0:92501:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783952130.167848:0:92501:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783952130.167853:0:92501:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783952130.167856:0:92501:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783952130.168310:0:92501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1783952130.176584:0:92499:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783952130.176634:0:92499:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783952130.176663:0:92497:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783952130.177288:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:92491:x1870605465525888:12345-0@lo:253:mount.lustre.0 Request processed in 18633us (18798us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.177300:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783952130.177348:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783952130.177359:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:3643:x1870605465526272:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783952130.177390:0:92499:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1783952130.177458:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465525888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783952130.177473:0:92491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783952130.177476:0:92491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783952130.177478:0:92491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783952130.177480:0:92491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952130.177481:0:92491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952130.177482:0:92491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952130.177483:0:92491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952130.177484:0:92491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783952130.177486:0:92491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783952130.177487:0:92491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952130.177489:0:92491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783952130.177509:0:92491:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b174b36000 from lustre-MDT0000 10000000:01000000:3.0:1783952130.177544:0:92491:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783952130.177547:0:92491:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783952130.177555:0:92491:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97b174b36000 10000000:01000000:3.0:1783952130.177560:0:92491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783952130.177563:0:92491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97b174b36000 10000000:01000000:3.0:1783952130.177566:0:92491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783952130.177569:0:92491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b174b36000 from 1 10000000:01000000:3.0:1783952130.177572:0:92491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783952130.177652:0:92491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.177664:0:92491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.177672:0:92491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952130.177692:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465526400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783952130.177740:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.177780:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049198600 going to sleep for 11 seconds 00000100:00100000:1.0:1783952130.177875:0:92498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:1.0:1783952130.177883:0:92498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:3.0:1783952130.180156:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465526400 00000100:00100000:3.0:1783952130.180170:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465526400 00000100:00100000:1.0:1783952130.180351:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783952130.180362:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:92491:x1870605465526400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783952130.180378:0:92503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952130.180402:0:92503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb5686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb567f expref: -99 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.180427:0:92503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb5686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb567f expref: 9 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.180448:0:92503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb5686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb567f expref: 9 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.180457:0:92503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762ae800, rc 0) 00000100:00100000:1.0:1783952130.180532:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:92491:x1870605465526400:12345-0@lo:101:mount.lustre.0 Request processed in 173us (2791us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.180539:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783952130.180650:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465526400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783952130.180668:0:92491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.180677:0:92491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.180696:0:92491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783952130.180713:0:92491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.180720:0:92491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952130.180727:0:92491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783952130.180732:0:92491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783952130.180738:0:92491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97b174b36000 10000000:01000000:3.0:1783952130.180741:0:92491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783952130.180745:0:92491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783952130.180747:0:92491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783952130.180770:0:92491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.180777:0:92491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.180795:0:92491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952130.180814:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465526528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783952130.180857:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.180882:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049198600 going to sleep for 11 seconds 00000100:00100000:1.0:1783952130.182327:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465526528 00000100:00100000:1.0:1783952130.182337:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465526528 00000100:00100000:1.0:1783952130.182383:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783952130.182390:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:92491:x1870605465526528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783952130.182403:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952130.182416:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb5694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb568d expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.182435:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb5694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb568d expref: 10 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.182444:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb5694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb568d expref: 10 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.182452:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762ae200, rc 0) 00000100:00100000:1.0:1783952130.182497:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92491:x1870605465526528:12345-0@lo:101:mount.lustre.0 Request processed in 108us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.182503:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783952130.182657:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465526528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783952130.182671:0:92491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.182680:0:92491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952130.182747:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465526656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783952130.182777:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.182803:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049198600 going to sleep for 11 seconds 00000100:00100000:0.0:1783952130.182859:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465526656 00000100:00100000:0.0:1783952130.182864:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465526656 00000100:00100000:0.0:1783952130.182901:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783952130.182908:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92491:x1870605465526656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783952130.183059:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92491:x1870605465526656:12345-0@lo:501:mount.lustre.0 Request processed in 148us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952130.183066:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783952130.183233:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465526656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783952130.183265:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465526784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783952130.183307:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952130.183331:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b155dad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952130.183414:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465526784 00000100:00100000:0.0:1783952130.183417:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465526784 00000100:00100000:0.0:1783952130.183438:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783952130.183442:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92491:x1870605465526784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783952130.187053:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92491:x1870605465526784:12345-0@lo:503:mount.lustre.0 Request processed in 3600us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952130.187070:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783952130.187122:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465526784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783952130.187479:0:92504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92504:1870605465526912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952130.187516:0:92504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:0.0:1783952130.187517:0:92497:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783952130.187528:0:92497:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783952130.187554:0:92504:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b155dadb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952130.187653:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465526912 00000100:00100000:3.0:1783952130.187660:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465526912 00000100:00100000:3.0:1783952130.187700:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783952130.187709:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92504:x1870605465526912:12345-0@lo:502:llog_process_th.0 20000000:01000000:1.0:1783952130.187724:0:92500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783952130.187731:0:92500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783952130.187752:0:92500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.187775:0:92500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783952130.187786:0:92500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000055992s 00010000:00010000:1.0:1783952130.187790:0:92500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.187797:0:92500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.187804:0:92500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.187812:0:92500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.187842:0:92500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952130.187847:0:92500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.187857:0:92500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.187870:0:92500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.187878:0:92500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.187885:0:92500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb569b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783952130.187917:0:92502:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783952130.188317:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:3645:x1870605465526016:12345-0@lo:253:kworker.0 Request processed in 27748us (28440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952130.188326:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1783952130.188419:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783952130.188422:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783952130.188424:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783952130.188426:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783952130.188428:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783952130.188429:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783952130.188431:0:3645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783952130.188433:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783952130.188435:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783952130.188437:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465526016:0@lo:253:kworker.0 00000100:00100000:3.0:1783952130.188474:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92504:x1870605465526912:12345-0@lo:502:llog_process_th.0 Request processed in 766us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952130.188480:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783952130.188487:0:92504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92504:1870605465526912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783952130.188513:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783952130.188524:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952130.188526:0:92504:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783952130.188535:0:92504:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783952130.188538:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783952130.188551:0:92504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97b14545b380) 00000020:00000080:2.0:1783952130.188571:0:92504:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1783952130.188576:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783952130.188697:0:92504:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783952130.188703:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb56a9 00000020:00000080:2.0:1783952130.189144:0:92504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783952130.189150:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783952130.189153:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952130.189154:0:92504:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783952130.189157:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783952130.189160:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952130.189161:0:92504:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783952130.189165:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783952130.189172:0:92504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97b1454599c0) 00000020:00000080:2.0:1783952130.189184:0:92504:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1783952130.189187:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783952130.189189:0:92504:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783952130.189192:0:92504:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783952130.189198:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783952130.189237:0:92504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b174b36000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783952130.189247:0:92504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97b14545cd40) 00000020:00000080:2.0:1783952130.189255:0:92504:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1783952130.189304:0:92504:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783952130.189309:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb56be 00000020:00000080:2.0:1783952130.189395:0:92504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783952130.189401:0:92504:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783952130.189405:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x22c73c7857bb56c5 00080000:01000000:2.0:1783952130.189559:0:92504:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783952130.189563:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb56cc 20000000:01000000:1.0:1783952130.197000:0:92502:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783952130.197015:0:92502:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783952130.197264:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:3642:x1870605465526144:12345-0@lo:253:kworker.0 Request processed in 31826us (37315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.197276:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1783952130.197324:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783952130.197326:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783952130.197327:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783952130.197328:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783952130.197329:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783952130.197331:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783952130.197332:0:3642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783952130.197334:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783952130.197335:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783952130.197338:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465526144:0@lo:253:kworker.0 20000000:01000000:0.0:1783952130.197419:0:92500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783952130.197424:0:92500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783952130.197446:0:92500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.197478:0:92500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783952130.197487:0:92500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063869s 00010000:00010000:0.0:1783952130.197492:0:92500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.197499:0:92500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.197506:0:92500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.197514:0:92500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.197520:0:92500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952130.197524:0:92500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.197541:0:92500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.197553:0:92500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.197560:0:92500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.197567:0:92500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb56d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783952130.197726:0:92499:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783952130.204272:0:92499:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783952130.204307:0:92499:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783952130.204408:0:92500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783952130.204414:0:92500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783952130.204444:0:92500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.204462:0:92500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783952130.204472:0:92500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000063869s 00010000:00010000:0.0:1783952130.204477:0:92500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.204484:0:92500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.204492:0:92500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.204499:0:92500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.204505:0:92500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952130.204509:0:92500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.204516:0:92500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.204538:0:92500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.204557:0:92500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.204564:0:92500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb56da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952130.204862:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3643:x1870605465526272:12345-0@lo:253:kworker.0 Request processed in 27501us (43965us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952130.204877:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1783952130.204979:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783952130.204982:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783952130.204993:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783952130.204994:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783952130.204995:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783952130.204996:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783952130.204997:0:3643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783952130.204999:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783952130.205001:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783952130.205004:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465526272:0@lo:253:kworker.0 00010000:00010000:0.0:1783952130.288437:0:92504:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1783952130.289743:0:92504:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 115964116996 lx: 0 gen 22 00000001:00080000:0.0:1783952130.289793:0:92504:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: d33551be-a709-4ba2-a74c-f4d7b53c6817 idx: 2 lr: 0 srv lr: 115964116996 lx: 0 gen 24 00000001:00000004:0.0:1783952130.289817:0:92504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116996 00000001:00080000:0.0:1783952130.291243:0:92504:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1783952130.291319:0:92504:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b145359780: xid 1870605465507456, transno 115964116996, client gen 22, slot idx 0 00000020:00000080:0.0:1783952130.292118:0:92504:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97b048b599c0) 00000020:00000080:0.0:1783952130.292144:0:92504:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1783952130.292219:0:92504:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783952130.292226:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb56f6 00000020:00000080:2.0:1783952130.298084:0:92504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783952130.307713:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x22c73c7857bb56fd 00000020:00000080:1.0:1783952130.310763:0:92504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783952130.310778:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952130.310787:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.310788:0:92504:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783952130.310792:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783952130.310795:0:92504:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1783952130.310796:0:92504:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783952130.310805:0:92504:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783952130.310807:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783952130.310809:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.310811:0:92504:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783952130.310813:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783952130.310818:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.310819:0:92504:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783952130.310824:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783952130.310888:0:92504:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783952130.310908:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952130.310911:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.310912:0:92504:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783952130.310915:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783952130.310917:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.310919:0:92504:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783952130.310922:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783952130.310927:0:92504:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:00000080:1.0:1783952130.310951:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783952130.310967:0:92504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff97b1447b8000) 00000020:00000080:1.0:1783952130.310988:0:92504:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1783952130.310994:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783952130.311053:0:92504:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783952130.311058:0:92504:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783952130.311064:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb570b 00010000:00080000:1.0:1783952130.311096:0:92504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b164cea000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1783952130.312499:0:92504:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1783952130.316338:0:92504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952130.316352:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783952130.316404:0:92504:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783952130.316430:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5712 00000100:00080000:1.0:1783952130.316441:0:92504:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783952130.316448:0:92504:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97b164cea000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952130.316495:0:92504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab02300 x1870605465527040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952130.316525:0:92504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1783952130.316615:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952130.316620:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.316622:0:92504:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1783952130.316625:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783952130.316628:0:92504:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1783952130.316630:0:92504:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783952130.316632:0:92504:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783952130.316634:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783952130.316637:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.316638:0:92504:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783952130.316640:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783952130.316645:0:92504:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783952130.316648:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.316650:0:92504:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783952130.316653:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783952130.316657:0:92504:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:1.0:1783952130.316682:0:92504:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783952130.316685:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783952130.316699:0:92504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97b1447bcd40) 00000020:00000080:1.0:1783952130.316712:0:92504:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1783952130.316717:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783952130.316773:0:92504:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783952130.316781:0:92504:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783952130.316786:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5720 00010000:00080000:1.0:1783952130.316814:0:92504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b1476fe800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1783952130.316997:0:92504:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:1.0:1783952130.318170:0:92504:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783952130.318528:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465527040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783952130.318815:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.318995:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465527040 00000100:00100000:1.0:1783952130.319010:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465527040 00000100:00100000:1.0:1783952130.319054:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:1.0:1783952130.319062:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465527040:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783952130.319101:0:23862:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3845 last 0 00000020:00000080:1.0:1783952130.319134:0:23862:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5727 00000004:00100000:1.0:1783952130.319149:0:23862:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783952130.319243:0:23862:0:(import.c:65:import_set_state_nolock()) ffff97b046a94000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952130.319307:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465527040:12345-0@lo:38:llog_process_th.0 Request processed in 244us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.319315:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:3.0:1783952130.319519:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783952130.319530:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1783952130.319549:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783952130.319559:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783952130.319562:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b164cea000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783952130.319580:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465527040:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783952130.319862:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000040:01000000:2.0:1783952130.319926:0:92504:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783952130.323985:0:92504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783952130.327748:0:92504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:2.0:1783952130.327991:0:92504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000100:00100000:3.0:1783952130.328113:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465527168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952130.328187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952130.330158:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465527168 00000100:00100000:2.0:1783952130.330176:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465527168 00000100:00100000:2.0:1783952130.330236:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:2.0:1783952130.330246:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465527168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783952130.330285:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:2.0:1783952130.330471:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465527168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 226us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952130.330478:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:2.0:1783952130.330937:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465527168:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783952130.331099:0:92510:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:3.0:1783952130.331105:0:92510:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783952130.332116:0:92504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952130.332127:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783952130.332173:0:92504:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783952130.332204:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb572e 00000100:00080000:1.0:1783952130.332212:0:92504:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783952130.332221:0:92504:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b1476fe800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952130.332261:0:92504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab01180 x1870605465527296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952130.332300:0:92504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783952130.332556:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952130.332560:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.332563:0:92504:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783952130.332566:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783952130.332569:0:92504:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1783952130.332572:0:92504:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783952130.332574:0:92504:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783952130.332575:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783952130.332578:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.332580:0:92504:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783952130.332625:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783952130.332629:0:92504:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783952130.332636:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952130.332638:0:92504:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783952130.332641:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783952130.332646:0:92504:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:1.0:1783952130.332674:0:92504:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783952130.332676:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783952130.332689:0:92504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97b0468a0000) 00000020:00000080:1.0:1783952130.332704:0:92504:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783952130.332709:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783952130.332770:0:92504:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783952130.332776:0:92504:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783952130.332783:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb573c 00010000:00080000:1.0:1783952130.332810:0:92504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b144763000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1783952130.333004:0:92504:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1783952130.333063:0:92504:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783952130.333076:0:92504:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1783952130.333566:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465527296:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783952130.333660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.334878:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465527296 00000100:00100000:1.0:1783952130.334887:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465527296 00000100:00100000:1.0:1783952130.334928:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4941 00000100:00100000:1.0:1783952130.334940:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3641:x1870605465527296:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783952130.334970:0:26199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3845 last 0 00000020:00000080:1.0:1783952130.334994:0:26199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5743 00002000:00100000:1.0:1783952130.335008:0:26199:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97b144764000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783952130.335012:0:26199:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783952130.335015:0:26199:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783952130.335061:0:26199:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783952130.335081:0:26199:0:(import.c:65:import_set_state_nolock()) ffff97b144767000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952130.335153:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465527296:12345-0@lo:8:llog_process_th.0 Request processed in 205us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.335163:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4941 00000100:00100000:3.0:1783952130.335248:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783952130.335257:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783952130.335264:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783952130.335268:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783952130.335271:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fe800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783952130.335287:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783952130.335292:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465527296:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783952130.335801:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465527424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952130.335856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.335897:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465527424 00000100:00100000:3.0:1783952130.335901:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465527424 00000100:00100000:3.0:1783952130.335936:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:3.0:1783952130.335943:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465527424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783952130.335967:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952130.336001:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465527424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952130.336024:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00080000:3.0:1783952130.336042:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952130.336067:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465527424:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1783952130.336279:0:92504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1783952130.336614:0:92510:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783952130.336660:0:92510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3845279071504ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783952130.336666:0:92510:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:2.0:1783952130.336737:0:92504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:2.0:1783952130.336878:0:92504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000040:00080000:2.0:1783952130.337427:0:92512:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1783952130.337432:0:92512:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783952130.338335:0:92504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783952130.338346:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783952130.338384:0:92504:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783952130.338416:0:92504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb574a 00000100:00080000:2.0:1783952130.338425:0:92504:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783952130.338430:0:92504:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97b144763000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952130.338460:0:92504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04799aa00 x1870605465527552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952130.338484:0:92504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783952130.338528:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1783952130.338707:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465527552:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783952130.338767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.338859:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465527552 00000100:00100000:0.0:1783952130.338866:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465527552 00000100:00100000:0.0:1783952130.338900:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4942 00000100:00100000:0.0:1783952130.338908:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3641:x1870605465527552:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783952130.338931:0:11961:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3845 last 0 00000020:00000080:0.0:1783952130.338954:0:11961:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5751 00002000:00100000:0.0:1783952130.338966:0:11961:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97b14de87000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783952130.338970:0:11961:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783952130.338972:0:11961:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783952130.339033:0:11961:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783952130.339058:0:11961:0:(import.c:65:import_set_state_nolock()) ffff97b14de80800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783952130.339100:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465527552:12345-0@lo:8:llog_process_th.0 Request processed in 192us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952130.339106:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4942 00000100:00100000:3.0:1783952130.339170:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783952130.339177:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783952130.339184:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783952130.339188:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783952130.339190:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b144763000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783952130.339209:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783952130.339214:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465527552:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1783952130.339231:0:92512:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783952130.339273:0:92512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3845281684286ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783952130.339278:0:92512:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:00000080:2.0:1783952130.339317:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952130.339320:0:92504:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783952130.339325:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783952130.339329:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952130.339331:0:92504:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783952130.339334:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783952130.339336:0:92504:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783952130.339338:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783952130.339341:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952130.339342:0:92504:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783952130.339344:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783952130.339346:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952130.339347:0:92504:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783952130.339350:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783952130.339375:0:92504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92504:1870605465527680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952130.339428:0:92504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952130.339453:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465527680 00000100:00100000:2.0:1783952130.339456:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465527680 00000100:00100000:2.0:1783952130.339481:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783952130.339487:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:92504:x1870605465527680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952130.339769:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:92504:x1870605465527680:12345-0@lo:502:llog_process_th.0 Request processed in 281us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952130.339784:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783952130.339816:0:92504:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952130.339827:0:92504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92504:1870605465527680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783952130.339859:0:92504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783952130.339863:0:92504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952130.339864:0:92504:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783952130.339867:0:92504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783952130.340025:0:92491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783952130.340046:0:92491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783952130.340064:0:92491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.340074:0:92491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952130.340082:0:92491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b174b36000 from 1 10000000:01000000:0.0:1783952130.340085:0:92491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783952130.340105:0:92491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.340113:0:92491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.340122:0:92491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952130.340134:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465527936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783952130.340158:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.340177:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b17496d000 going to sleep for 11 seconds 00000100:00100000:0.0:1783952130.340816:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465527808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952130.340858:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952130.341291:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465527808 00000100:00100000:2.0:1783952130.341298:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465527808 00000100:00100000:2.0:1783952130.341350:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:2.0:1783952130.341358:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465527808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783952130.341384:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952130.341448:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465527808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952130.341455:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00100000:2.0:1783952130.341497:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465527808:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783952130.342455:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1783952130.344197:0:92492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1783952130.344214:0:92492:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783952130.344354:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465527936 00000100:00100000:3.0:1783952130.344365:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465527936 00000100:00100000:3.0:1783952130.344557:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783952130.344568:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:92491:x1870605465527936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783952130.344609:0:92503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952130.344631:0:92503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb575f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5758 expref: -99 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.344658:0:92503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb575f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5758 expref: 9 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.344670:0:92503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb575f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5758 expref: 9 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.344689:0:92503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216ac00, rc 0) 00000100:00100000:3.0:1783952130.344762:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:92491:x1870605465527936:12345-0@lo:101:mount.lustre.0 Request processed in 196us (4603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952130.344768:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783952130.344876:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465527936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783952130.344894:0:92491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.344903:0:92491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952130.345448:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528064:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783952130.345495:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.346144:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b17496d000 going to sleep for 11 seconds 00000100:00100000:1.0:1783952130.346259:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465528064 00000100:00100000:1.0:1783952130.346266:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465528064 00000100:00100000:1.0:1783952130.346343:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783952130.346351:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:92491:x1870605465528064:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783952130.346372:0:92502:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783952130.346670:0:92502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783952130.346677:0:92502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783952130.346680:0:92502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783952130.346683:0:92502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 122 00000100:00100000:1.0:1783952130.346787:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:92491:x1870605465528064:12345-0@lo:256:mount.lustre.0 Request processed in 436us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.346795:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783952130.347002:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528064:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783952130.349319:0:92491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783952130.349396:0:92491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.349414:0:92491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952130.349424:0:92491:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b174b36000 from 1 10000000:01000000:1.0:1783952130.349427:0:92491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783952130.349479:0:92491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.349489:0:92491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.349500:0:92491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952130.349525:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783952130.349769:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.349808:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147240a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952130.349843:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465528192 00000100:00100000:1.0:1783952130.349850:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465528192 00000100:00100000:1.0:1783952130.349949:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783952130.349958:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:92491:x1870605465528192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783952130.349974:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952130.349986:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762af400/0x22c73c7857bb576d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5766 expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.350008:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762af400/0x22c73c7857bb576d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5766 expref: 10 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.350018:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762af400/0x22c73c7857bb576d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5766 expref: 10 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.350027:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af400, rc 0) 00000100:00100000:1.0:1783952130.350063:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92491:x1870605465528192:12345-0@lo:101:mount.lustre.0 Request processed in 106us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.350070:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783952130.350359:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783952130.350375:0:92491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.350384:0:92491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952130.350455:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783952130.350481:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.350504:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147240a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783952130.350619:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465528320 00000100:00100000:2.0:1783952130.350624:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465528320 00000100:00100000:2.0:1783952130.350650:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783952130.350658:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92491:x1870605465528320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783952130.350806:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92491:x1870605465528320:12345-0@lo:501:mount.lustre.0 Request processed in 150us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952130.350813:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783952130.350930:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783952130.350960:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783952130.351000:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.351030:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049198000 going to sleep for 11 seconds 00000100:00100000:2.0:1783952130.351089:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465528448 00000100:00100000:2.0:1783952130.351099:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465528448 00000100:00100000:2.0:1783952130.351128:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783952130.351135:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92491:x1870605465528448:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783952130.351224:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92491:x1870605465528448:12345-0@lo:503:mount.lustre.0 Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952130.351231:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783952130.351409:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783952130.351826:0:92514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92514:1870605465528576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952130.351876:0:92514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.351898:0:92514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b151339d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783952130.351948:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465528576 00000100:00100000:2.0:1783952130.351952:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465528576 00000100:00100000:2.0:1783952130.351982:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783952130.351988:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92514:x1870605465528576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952130.352410:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92514:x1870605465528576:12345-0@lo:502:llog_process_th.0 Request processed in 421us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952130.352418:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783952130.352489:0:92514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92514:1870605465528576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783952130.352513:0:92514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952130.352522:0:92514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952130.352524:0:92514:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783952130.352541:0:92514:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b174b36000 00000020:00000080:0.0:1783952130.352545:0:92514:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783952130.352552:0:92514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783952130.352555:0:92514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952130.352556:0:92514:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783952130.352559:0:92514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952130.352561:0:92514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952130.352563:0:92514:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783952130.352566:0:92514:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b174b36000 00000020:00000080:0.0:1783952130.352568:0:92514:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783952130.352777:0:92514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92514:1870605465528704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952130.352817:0:92514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.352859:0:92514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b151339d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783952130.352910:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465528704 00000100:00100000:3.0:1783952130.352915:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465528704 00000100:00100000:3.0:1783952130.352947:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783952130.352955:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92514:x1870605465528704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952130.353040:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92514:x1870605465528704:12345-0@lo:502:llog_process_th.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952130.353047:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783952130.356713:0:92514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92514:1870605465528704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783952130.356755:0:92514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783952130.356763:0:92514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952130.356765:0:92514:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783952130.356770:0:92514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783952130.356960:0:92491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1783952130.356987:0:92491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783952130.357013:0:92491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.357026:0:92491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952130.357084:0:92491:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783952130.357088:0:92491:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97b174b36000 10000000:01000000:1.0:1783952130.357091:0:92491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97b174b36000 10000000:01000000:1.0:1783952130.357095:0:92491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783952130.357101:0:92491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174b36000 from 1 10000000:01000000:1.0:1783952130.357104:0:92491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783952130.357136:0:92491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.357144:0:92491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.357166:0:92491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952130.357188:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783952130.357251:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.357282:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fbe300 going to sleep for 11 seconds 00000100:00100000:0.0:1783952130.357336:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465528832 00000100:00100000:0.0:1783952130.357342:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465528832 00000100:00100000:0.0:1783952130.357383:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783952130.357391:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92491:x1870605465528832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783952130.357405:0:92497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952130.357417:0:92497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb577b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5774 expref: -99 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.357438:0:92497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb577b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5774 expref: 11 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.357449:0:92497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb577b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5774 expref: 11 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.357458:0:92497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc200, rc 0) 00000100:00100000:0.0:1783952130.357491:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92491:x1870605465528832:12345-0@lo:101:mount.lustre.0 Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952130.357498:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783952130.357547:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783952130.357558:0:92491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.357577:0:92491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952130.357642:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783952130.357666:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.357685:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b151339300 going to sleep for 11 seconds 00000100:00100000:0.0:1783952130.357696:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465528960 00000100:00100000:0.0:1783952130.357699:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465528960 00000100:00100000:0.0:1783952130.357726:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783952130.357732:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92491:x1870605465528960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783952130.357823:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92491:x1870605465528960:12345-0@lo:501:mount.lustre.0 Request processed in 91us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952130.357829:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783952130.357866:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465528960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783952130.357888:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465529088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783952130.357919:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.357932:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b151339300 going to sleep for 11 seconds 00000100:00100000:0.0:1783952130.357943:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465529088 00000100:00100000:0.0:1783952130.357946:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465529088 00000100:00100000:0.0:1783952130.357963:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783952130.357968:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92491:x1870605465529088:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783952130.358039:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92491:x1870605465529088:12345-0@lo:503:mount.lustre.0 Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952130.358045:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783952130.358081:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465529088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783952130.359761:0:92516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92516:1870605465529216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952130.359818:0:92516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952130.359860:0:92516:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fbe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952130.359909:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465529216 00000100:00100000:0.0:1783952130.359915:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465529216 00000100:00100000:0.0:1783952130.362987:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783952130.363008:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92516:x1870605465529216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952130.363198:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92516:x1870605465529216:12345-0@lo:502:llog_process_th.0 Request processed in 199us (3378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952130.363206:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783952130.363312:0:92516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92516:1870605465529216:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783952130.363383:0:92516:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783952130.363398:0:92516:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97b0489bcd40) 00000020:00000080:3.0:1783952130.363422:0:92516:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1783952130.365636:0:92516:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b174b36000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783952130.365648:0:92516:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b174b36000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783952130.365651:0:92516:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174b36000 4 00010000:00080000:3.0:1783952130.365690:0:92516:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b046483000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:3.0:1783952130.367290:0:92516:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1783952130.367402:0:92516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783952130.367448:0:92516:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783952130.367459:0:92516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x22c73c7857bb5789 00000100:00080000:3.0:1783952130.367470:0:92516:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783952130.367476:0:92516:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b046483000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952130.367511:0:92516:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1e300 x1870605465529344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952130.367556:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465529344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783952130.367646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.367723:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465529344 00000100:00100000:3.0:1783952130.367730:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465529344 00000100:00100000:3.0:1783952130.367762:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1783952130.367769:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465529344:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783952130.367821:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465529344:12345-0@lo:38:llog_process_th.0 Request processed in 51us (175us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783952130.367828:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1783952130.370916:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783952130.370929:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046483000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952130.370948:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783952130.370953:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465529344:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1783952130.370995:0:92516:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783952130.371234:0:92516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92516:1870605465529472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952130.371298:0:92516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.371329:0:92516:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952130.371349:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465529472 00000100:00100000:3.0:1783952130.371360:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465529472 00000100:00100000:3.0:1783952130.372190:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783952130.372206:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92516:x1870605465529472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952130.372340:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:92516:x1870605465529472:12345-0@lo:502:llog_process_th.0 Request processed in 138us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952130.380784:0:92516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92516:1870605465529472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952130.380873:0:92516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92516:1870605465529600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952130.380941:0:92516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952130.380981:0:92516:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6000 going to sleep for 11 seconds 00000100:00100000:2.0:1783952130.382676:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465529600 00000100:00100000:2.0:1783952130.382691:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465529600 00000100:00100000:2.0:1783952130.382757:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783952130.382769:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:92516:x1870605465529600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952130.382948:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:92516:x1870605465529600:12345-0@lo:502:llog_process_th.0 Request processed in 182us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952130.382957:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783952130.383017:0:92516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92516:1870605465529600:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783952130.383061:0:92516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783952130.383141:0:92491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783952130.383165:0:92491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783952130.383179:0:92491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952130.383190:0:92491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783952130.383230:0:92491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783952130.383232:0:92491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783952130.383234:0:92491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783952130.383235:0:92491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783952130.383237:0:92491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783952130.383238:0:92491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783952130.383240:0:92491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783952130.383242:0:92491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783952130.383244:0:92491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783952130.383245:0:92491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783952130.383249:0:92491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783952130.383251:0:92491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783952130.383253:0:92491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783952130.383254:0:92491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783952130.383255:0:92491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783952130.383256:0:92491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783952130.383258:0:92491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783952130.383259:0:92491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783952130.383260:0:92491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783952130.383261:0:92491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783952130.383263:0:92491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783952130.383279:0:92491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783952130.383293:0:92491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465529728:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783952130.383330:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952130.383356:0:92491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147240a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783952130.384681:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465529728 00000100:00100000:2.0:1783952130.384696:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465529728 00000100:00100000:2.0:1783952130.384742:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783952130.384750:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:92491:x1870605465529728:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783952130.384780:0:92498:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783952130.384794:0:92498:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783952130.386261:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 20000000:01000000:1.0:1783952130.392144:0:92498:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783952130.392167:0:92498:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783952130.392277:0:92500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783952130.392285:0:92500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783952130.392310:0:92500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.392331:0:92500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb575f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5758 expref: 11 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.392344:0:92500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.392387:0:92500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb575f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5758 expref: 11 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952130.392402:0:92500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb575f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5758 expref: 11 pid: 92503 timeout: 3945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952130.392417:0:92500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92500:1870605465529856:0@lo:104: 00000100:00100000:0.0:1783952130.392478:0:92500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952130.392527:0:92500:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b151339c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783952130.392625:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465529856 00000100:00100000:1.0:1783952130.392636:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465529856 00000100:00100000:1.0:1783952130.392685:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1783952130.392698:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:92500:x1870605465529856:12345-0@lo:104: 00010000:00010000:1.0:1783952130.392715:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952130.392786:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783952130.392792:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:92500:x1870605465529856:12345-0@lo:104: Request processed in 96us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952130.392799:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1783952130.392962:0:92500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92500:1870605465529856:0@lo:104: 00010000:00010000:0.0:1783952130.392999:0:92500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952130.393191:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952130.393199:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952130.393207:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd200 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952130.393211:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952130.393220:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952130.393228:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952130.393234:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783952130.393273:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952130.393280:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952130.393308:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952130.393319:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbd200/0x22c73c7857bb5758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb575f expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952130.393337:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952130.393345:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952130.393347:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952130.393385:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783952130.393399:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465529984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952130.393434:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.393472:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465529984 00000100:00100000:3.0:1783952130.393483:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465529984 00010000:00010000:3.0:1783952130.393501:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb575f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5758 expref: 12 pid: 92503 timeout: 3945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952130.393528:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1783952130.393547:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:3642:x1870605465529984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952130.393561:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952130.393567:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb575f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5758 expref: 12 pid: 92503 timeout: 3945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393580:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb575f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5758 expref: 12 pid: 92503 timeout: 3945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393639:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb575f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5758 expref: 12 pid: 92503 timeout: 3945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393652:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393677:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783952130.393690:0:7927:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001408870s 00010000:00010000:3.0:1783952130.393698:0:7927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393704:0:7927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393713:0:7927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393720:0:7927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393726:0:7927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952130.393732:0:7927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393740:0:7927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393758:0:7927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393767:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952130.393796:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:3642:x1870605465529984:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952130.393803:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1783952130.393854:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465529984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952130.393877:0:92500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393885:0:92500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952130.393891:0:92500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb5790 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952130.394377:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:92491:x1870605465529728:12345-0@lo:253:mount.lustre.0 Request processed in 9627us (11046us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952130.394390:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783952130.394473:0:92491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:92491:1870605465529728:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783952130.394485:0:92491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783952130.394495:0:92491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783952130.394497:0:92491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783952130.394498:0:92491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952130.394499:0:92491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952130.394501:0:92491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952130.394502:0:92491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952130.394503:0:92491:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783952130.394505:0:92491:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783952130.394507:0:92491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952130.394508:0:92491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783952130.394518:0:92491:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1783952130.404829:0:92491:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411352 00000040:01000000:2.0:1783952130.405150:0:92491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1783952130.405401:0:92523:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783952130.406519:0:92491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1783952130.406899:0:92524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92524:1870605465530112:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952130.406970:0:92524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.407012:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465530112 00000100:00100000:3.0:1783952130.407019:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465530112 00000100:00100000:3.0:1783952130.407062:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:3.0:1783952130.407071:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92524:x1870605465530112:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952130.407139:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92524:x1870605465530112:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952130.407147:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00100000:3.0:1783952130.407172:0:92524:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952130.407199:0:92524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92524:1870605465530112:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783952130.407226:0:92524:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783952130.407255:0:92524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92524:1870605465530240:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952130.407283:0:92524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.407308:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465530240 00000100:00100000:3.0:1783952130.407311:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465530240 00000100:00100000:3.0:1783952130.407347:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1783952130.407353:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92524:x1870605465530240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952130.407450:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92524:x1870605465530240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 97us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952130.407456:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1783952130.407473:0:92524:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952130.407485:0:92524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92524:1870605465530240:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952130.407529:0:92524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92524:1870605465530368:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952130.407554:0:92524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952130.407572:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465530368 00000100:00100000:3.0:1783952130.407576:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465530368 00000100:00100000:3.0:1783952130.407622:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:3.0:1783952130.407629:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92524:x1870605465530368:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783952130.407674:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92524:x1870605465530368:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 46us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952130.407680:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:3.0:1783952130.407699:0:92524:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952130.407711:0:92524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92524:1870605465530368:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783952130.407755:0:92524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1783952130.410396:0:92491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783952130.410440:0:92491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783952130.410909:0:92491:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783952130.410917:0:92491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783952130.410951:0:92491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783952130.411861:0:92491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783952130.412399:0:92491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783952130.412428:0:92491:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783952130.412522:0:92491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1783952130.413003:0:92522:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411352 00000020:00080000:1.0:1783952130.413009:0:92522:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411352 00000040:00080000:2.0:1783952130.413354:0:92523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783952130.415638:0:92523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783952130.415730:0:92523:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:0.0:1783952130.416784:0:92491:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4f:0x0] (8/32) registered 00000040:00080000:3.0:1783952130.417388:0:92524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783952130.417458:0:92524:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783952130.417463:0:92524:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1783952130.419039:0:92491:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964116996 00010000:00080000:2.0:1783952130.420798:0:92525:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92525 00010000:02000000:2.0:1783952130.420852:0:92525:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1783952130.420856:0:92525:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783952130.420859:0:92525:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1783952130.420939:0:92491:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783952130.420958:0:92491:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783952130.420984:0:92491:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783952130.421004:0:92491:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783952130.422158:0:92491:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783952130.422408:0:92491:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783952130.596245:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952130.657377:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:1.0:1783952131.104997:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 10000000:01000000:0.0:1783952131.232794:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783952131.232802:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b174b36000 from 123 10000000:01000000:0.0:1783952131.232807:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783952131.232861:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.232873:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.232884:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952131.232908:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465530496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.233045:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952131.233130:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783952131.236494:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465530496 00000100:00100000:2.0:1783952131.236506:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465530496 00000100:00100000:2.0:1783952131.236571:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783952131.236580:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:6514:x1870605465530496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952131.236775:0:92503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952131.236797:0:92503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86bc00/0x22c73c7857bb579e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5797 expref: -99 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.236822:0:92503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86bc00/0x22c73c7857bb579e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5797 expref: 11 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.236846:0:92503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86bc00/0x22c73c7857bb579e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5797 expref: 11 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.236854:0:92503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86bc00, rc 0) 00000100:00100000:2.0:1783952131.236962:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465530496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 384us (3917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952131.236976:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783952131.239207:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465530496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952131.239243:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.239255:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.239315:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465530624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.239370:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.239407:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b158f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.241679:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465530624 00000100:00100000:0.0:1783952131.241695:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465530624 00000100:00100000:0.0:1783952131.241763:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783952131.241775:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465530624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783952131.241803:0:92502:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783952131.241822:0:92502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783952131.241833:0:92502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 123 00000100:00100000:0.0:1783952131.241962:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465530624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 190us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.241970:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783952131.243065:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465530624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783952131.243126:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783952131.243135:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.243146:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952131.243156:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783952131.243159:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b151231000 from 52 10000000:01000000:1.0:1783952131.243161:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783952131.243191:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.243200:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.243209:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.243239:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465530752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.243280:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.243321:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.243452:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465530752 00000100:00100000:0.0:1783952131.243457:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465530752 00000100:00100000:0.0:1783952131.243502:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783952131.243510:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465530752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952131.243533:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952131.243552:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb57ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb57a5 expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.243575:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb57ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb57a5 expref: 12 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.243585:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb57ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57a5 expref: 12 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.243612:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbce00, rc 0) 00000100:00100000:0.0:1783952131.243645:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465530752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.243651:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783952131.243770:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465530752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952131.243782:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.243790:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.243856:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465530880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.243881:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.243907:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.244094:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465530880 00000100:00100000:0.0:1783952131.244098:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465530880 00000100:00100000:0.0:1783952131.244131:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783952131.244138:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465530880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.244264:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465530880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.244270:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783952131.244335:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465530880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.244363:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.244407:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.244427:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.244466:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465531008 00000100:00100000:0.0:1783952131.244471:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465531008 00000100:00100000:0.0:1783952131.244537:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783952131.244544:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465531008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.244644:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465531008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.244650:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783952131.248710:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952131.254996:0:92566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783952131.258843:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783952131.258880:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783952131.258893:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.258906:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952131.258988:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783952131.258991:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b151231000 from 120 10000000:01000000:1.0:1783952131.258994:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783952131.259029:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb57b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.259036:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb57b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.259045:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb57b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.259068:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.259133:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.259210:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783952131.265548:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465531136 00000100:00100000:3.0:1783952131.265562:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465531136 00000100:00100000:3.0:1783952131.265628:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783952131.265645:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465531136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952131.265664:0:92499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952131.265681:0:92499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb57ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb57b3 expref: -99 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.265713:0:92499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb57ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb57b3 expref: 13 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.265725:0:92499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb57ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57b3 expref: 13 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.265734:0:92499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216ac00, rc 0) 00000100:00100000:3.0:1783952131.265815:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465531136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (6682us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952131.265822:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783952131.266163:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952131.266182:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb57b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.266192:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb57b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb57ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.266255:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.266297:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.266334:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.266390:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465531264 00000100:00100000:0.0:1783952131.266395:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465531264 00000100:00100000:0.0:1783952131.266429:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783952131.266437:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465531264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783952131.266452:0:92502:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783952131.266467:0:92502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783952131.266471:0:92502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783952131.266474:0:92502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783952131.266477:0:92502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783952131.266479:0:92502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:0.0:1783952131.266707:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465531264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 271us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.266714:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783952131.267072:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783952131.267142:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783952131.267149:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb57b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.267157:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb57b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952131.267165:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783952131.267167:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1783952131.267170:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783952131.267193:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.267210:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.267218:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952131.267233:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952131.267260:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952131.267291:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396240 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.267335:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465531392 00000100:00100000:0.0:1783952131.267339:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465531392 00000100:00100000:0.0:1783952131.267373:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783952131.267381:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465531392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952131.267391:0:92497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952131.267403:0:92497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb57c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb57c1 expref: -99 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.267421:0:92497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb57c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb57c1 expref: 14 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.267429:0:92497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb57c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57c1 expref: 14 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.267436:0:92497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd600, rc 0) 00000100:00100000:0.0:1783952131.267546:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465531392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.267559:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783952131.268016:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952131.268031:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.268046:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.268109:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.268140:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.268171:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7240 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.268215:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465531520 00000100:00100000:0.0:1783952131.268220:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465531520 00000100:00100000:0.0:1783952131.268253:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783952131.268261:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465531520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.268440:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465531520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.268448:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783952131.269666:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.269713:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.269765:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952131.269796:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783952131.269863:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465531648 00000100:00100000:1.0:1783952131.269869:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465531648 00000100:00100000:1.0:1783952131.269913:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783952131.269921:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465531648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.271007:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465531648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1084us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952131.271018:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783952131.271147:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783952131.276314:0:92570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1783952131.279773:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1783952131.279808:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783952131.279819:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.279842:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952131.279853:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1783952131.279856:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b151231000 from 1 10000000:01000000:1.0:1783952131.279859:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783952131.279894:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb57cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.279912:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb57cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.279924:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb57cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.280477:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.280556:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.280625:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7240 going to sleep for 11 seconds 00000100:00100000:2.0:1783952131.281340:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465531776 00000100:00100000:2.0:1783952131.281350:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465531776 00000100:00100000:2.0:1783952131.281404:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783952131.281415:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465531776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952131.281433:0:92497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952131.281448:0:92497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86a600/0x22c73c7857bb57d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb57cf expref: -99 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.281473:0:92497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86a600/0x22c73c7857bb57d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb57cf expref: 15 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.281485:0:92497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86a600/0x22c73c7857bb57d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57cf expref: 15 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.281494:0:92497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a600, rc 0) 00000100:00100000:2.0:1783952131.281551:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465531776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952131.281558:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783952131.282374:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952131.282394:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb57cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.282404:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb57cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb57d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952131.282423:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783952131.282429:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb57cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.282436:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb57cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952131.282444:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783952131.282446:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b151231000 from 7 10000000:01000000:1.0:1783952131.282448:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783952131.282478:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb57dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.282494:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb57dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.282502:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb57dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.282533:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.282573:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.282618:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465531904 00000100:00100000:1.0:1783952131.282622:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465531904 00000100:00100000:1.0:1783952131.282657:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783952131.282665:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465531904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952131.282675:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952131.282684:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb57e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb57dd expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.282702:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb57e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb57dd expref: 16 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.282711:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb57e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57dd expref: 16 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.282718:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762aee00, rc 0) 00000100:00100000:1.0:1783952131.282743:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465531904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952131.282749:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783952131.282785:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7240 going to sleep for 11 seconds 00000100:00100000:1.0:1783952131.282801:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465531904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952131.282811:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb57dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57e4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.282819:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb57dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb57e4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.282882:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.282905:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.282935:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465532032 00000100:00100000:1.0:1783952131.282939:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465532032 00000100:00100000:1.0:1783952131.282962:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783952131.282968:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465532032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.283073:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465532032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952131.283079:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783952131.283102:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7240 going to sleep for 11 seconds 00000100:00100000:1.0:1783952131.283112:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.283134:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.283172:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.283189:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465532160 00000100:00100000:1.0:1783952131.283192:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465532160 00000100:00100000:1.0:1783952131.283211:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783952131.283218:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465532160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.283285:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465532160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952131.283300:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783952131.283330:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7240 going to sleep for 11 seconds 00000100:00100000:1.0:1783952131.283341:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783952131.284782:0:92574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783952131.287028:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783952131.287066:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783952131.287078:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb57dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57e4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.287091:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb57dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57e4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952131.287101:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783952131.287104:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b046482800 from 52 10000000:01000000:1.0:1783952131.287107:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783952131.287141:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.287149:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.287160:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.287186:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.287249:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.287297:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1512d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1783952131.287350:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465532288 00000100:00100000:2.0:1783952131.287358:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465532288 00000100:00100000:2.0:1783952131.287410:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783952131.287420:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160517450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465532288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952131.287433:0:92499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952131.287447:0:92499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86a000/0x22c73c7857bb57f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb57eb expref: -99 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.287471:0:92499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86a000/0x22c73c7857bb57f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb57eb expref: 17 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.287482:0:92499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86a000/0x22c73c7857bb57f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57eb expref: 17 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.287490:0:92499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a000, rc 0) 00000100:00100000:2.0:1783952131.287557:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160517450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465532288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952131.287564:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783952131.291256:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952131.291288:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.291301:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952131.291391:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.291451:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952131.291474:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952131.291704:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465532416 00000100:00100000:1.0:1783952131.291710:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465532416 00000100:00100000:1.0:1783952131.291769:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783952131.291777:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465532416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.291925:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465532416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952131.292030:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.292060:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.292101:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952131.292126:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783952131.292156:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783952131.292180:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465532544 00000100:00100000:1.0:1783952131.292184:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465532544 00000100:00100000:1.0:1783952131.292209:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783952131.292215:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160514050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465532544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.292286:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160514050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465532544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952131.292292:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783952131.292378:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952131.293352:0:92576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783952131.293612:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783952131.293635:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783952131.293645:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.293671:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952131.293681:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783952131.293684:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783952131.293687:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783952131.293716:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.293725:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.293734:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952131.293757:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.293804:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952131.293845:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783952131.294031:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465532672 00000100:00100000:1.0:1783952131.294039:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465532672 00000100:00100000:1.0:1783952131.294087:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783952131.294096:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465532672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952131.294110:0:92497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952131.294123:0:92497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762af200/0x22c73c7857bb5800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb57f9 expref: -99 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.294145:0:92497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762af200/0x22c73c7857bb5800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb57f9 expref: 18 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.294156:0:92497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762af200/0x22c73c7857bb5800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57f9 expref: 18 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.294165:0:92497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af200, rc 0) 00000100:00100000:1.0:1783952131.294206:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465532672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952131.294220:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783952131.294356:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952131.294371:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.294379:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952131.294447:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.294475:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952131.294492:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952131.295110:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465532800 00000100:00100000:1.0:1783952131.295115:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465532800 00000100:00100000:1.0:1783952131.295150:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783952131.295158:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465532800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.295306:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465532800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952131.295313:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783952131.295411:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.295446:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.295488:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952131.295517:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952131.295680:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465532928 00000100:00100000:1.0:1783952131.295684:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465532928 00000100:00100000:1.0:1783952131.295716:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783952131.295723:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465532928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.298741:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465532928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3008us (3241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952131.298756:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783952131.298913:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465532928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783952131.300382:0:92577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1783952131.300627:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1783952131.300657:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783952131.300668:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.300680:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952131.300689:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783952131.300692:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b046482800 from 7 10000000:01000000:0.0:1783952131.300695:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783952131.300729:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbc400/0x22c73c7857bb5807 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.300737:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbc400/0x22c73c7857bb5807 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.300748:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbc400/0x22c73c7857bb5807 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952131.300780:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.300848:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952131.300884:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952131.301092:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465533056 00000100:00100000:2.0:1783952131.301102:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465533056 00000100:00100000:2.0:1783952131.301187:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783952131.301197:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465533056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952131.301213:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952131.301228:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86aa00/0x22c73c7857bb580e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5807 expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.301253:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86aa00/0x22c73c7857bb580e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5807 expref: 19 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.301272:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86aa00/0x22c73c7857bb580e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5807 expref: 19 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.301283:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86aa00, rc 0) 00000100:00100000:2.0:1783952131.301328:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465533056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952131.301336:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783952131.301403:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952131.301418:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbc400/0x22c73c7857bb5807 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb580e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.301427:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbc400/0x22c73c7857bb5807 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb580e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952131.301478:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.301503:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952131.301712:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952131.305274:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465533184 00000100:00100000:1.0:1783952131.305288:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465533184 00000100:00100000:1.0:1783952131.305349:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783952131.305359:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465533184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.305513:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465533184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (4008us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952131.305530:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783952131.305809:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.305866:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.305911:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952131.306091:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952131.306222:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465533312 00000100:00100000:2.0:1783952131.306226:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465533312 00000100:00100000:3.0:1783952131.306272:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783952131.306282:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465533312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952131.306403:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465533312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952131.306410:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783952131.306495:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952131.307457:0:92579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783952131.307994:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783952131.308018:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783952131.308029:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbc400/0x22c73c7857bb5807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb580e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.308054:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbc400/0x22c73c7857bb5807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb580e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952131.308064:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783952131.308066:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174849000 from 52 10000000:01000000:1.0:1783952131.308069:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783952131.308102:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.308111:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.308121:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.308144:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.308194:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.308221:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b158f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.308270:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465533440 00000100:00100000:0.0:1783952131.308277:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465533440 00000100:00100000:0.0:1783952131.308315:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783952131.308324:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465533440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952131.308337:0:92497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952131.308357:0:92497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb581c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5815 expref: -99 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.308378:0:92497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb581c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5815 expref: 20 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.308390:0:92497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb581c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5815 expref: 20 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.308399:0:92497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbda00, rc 0) 00000100:00100000:0.0:1783952131.308430:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465533440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.308437:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783952131.308508:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952131.308533:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.308543:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.308615:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.308638:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.308661:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b158f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.308768:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465533568 00000100:00100000:0.0:1783952131.308772:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465533568 00000100:00100000:0.0:1783952131.308801:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783952131.308807:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465533568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.308914:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465533568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.308921:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783952131.309043:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.309070:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.309106:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.309134:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b158f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.309171:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465533696 00000100:00100000:0.0:1783952131.309175:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465533696 00000100:00100000:0.0:1783952131.309205:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783952131.309212:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465533696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.309279:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465533696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.309286:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783952131.309354:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783952131.313263:0:92580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783952131.313342:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783952131.313365:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783952131.313377:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.313389:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952131.313399:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783952131.313402:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1783952131.313406:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783952131.313443:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.313451:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952131.313464:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952131.313492:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952131.313612:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952131.313657:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b158f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.314075:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465533824 00000100:00100000:0.0:1783952131.314090:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465533824 00000100:00100000:0.0:1783952131.314144:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783952131.314154:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465533824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952131.314169:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952131.314182:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb582a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5823 expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.314207:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb582a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5823 expref: 21 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.314217:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb582a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5823 expref: 21 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.314225:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc600, rc 0) 00000100:00100000:0.0:1783952131.314318:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465533824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.314325:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783952131.322674:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952131.322704:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.322717:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952131.322797:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.322868:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952131.322912:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.323074:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465533952 00000100:00100000:0.0:1783952131.323081:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465533952 00000100:00100000:0.0:1783952131.323136:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783952131.323145:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465533952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.323288:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465533952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.323295:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783952131.323816:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465533952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.323867:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.323911:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952131.324018:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.324078:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465534080 00000100:00100000:0.0:1783952131.324083:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465534080 00000100:00100000:0.0:1783952131.324159:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783952131.324167:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465534080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.324879:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465534080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 712us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.324888:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783952131.324966:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783952131.325652:0:92582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783952131.325721:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783952131.325745:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783952131.325755:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.325765:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952131.325789:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783952131.325792:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b174849000 from 7 10000000:01000000:3.0:1783952131.325794:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783952131.325836:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb5831 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.325846:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb5831 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.325856:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb5831 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952131.325876:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952131.325916:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952131.326297:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396240 going to sleep for 11 seconds 00000100:00100000:2.0:1783952131.326422:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465534208 00000100:00100000:2.0:1783952131.326429:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465534208 00000100:00100000:2.0:1783952131.326474:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783952131.326491:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465534208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952131.326505:0:92497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952131.326573:0:92497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86a200/0x22c73c7857bb5838 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5831 expref: -99 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.326619:0:92497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86a200/0x22c73c7857bb5838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5831 expref: 22 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.326631:0:92497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86a200/0x22c73c7857bb5838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5831 expref: 22 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.326640:0:92497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a200, rc 0) 00000100:00100000:2.0:1783952131.326679:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465534208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952131.326685:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783952131.326783:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952131.326796:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb5831 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5838 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.326806:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb5831 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5838 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952131.326872:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952131.326896:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952131.326916:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396240 going to sleep for 11 seconds 00000100:00100000:2.0:1783952131.327020:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465534336 00000100:00100000:2.0:1783952131.327024:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465534336 00000100:00100000:2.0:1783952131.327055:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783952131.327062:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465534336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.327164:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465534336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952131.327171:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783952131.327225:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952131.327252:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952131.327295:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952131.327317:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396240 going to sleep for 11 seconds 00000100:00100000:3.0:1783952131.327330:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465534464 00000100:00100000:3.0:1783952131.327333:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465534464 00000100:00100000:3.0:1783952131.327357:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783952131.327362:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465534464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952131.327429:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465534464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952131.327435:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783952131.327472:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783952131.328346:0:92583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783952131.332533:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783952131.332568:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783952131.332579:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb5831 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5838 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.332614:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb5831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5838 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952131.332631:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1783952131.332635:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97b167c90000 from 1 10000000:01000000:2.0:1783952131.332637:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783952131.332679:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb583f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.332687:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb583f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.332697:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb583f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952131.332720:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.332787:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952131.332839:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.332977:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465534592 00000100:00100000:0.0:1783952131.332985:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465534592 00000100:00100000:0.0:1783952131.333034:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783952131.333045:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465534592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952131.333059:0:92497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952131.333074:0:92497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb5846 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb583f expref: -99 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.333096:0:92497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb5846 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb583f expref: 23 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.333108:0:92497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb5846 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb583f expref: 23 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.333117:0:92497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd200, rc 0) 00000100:00100000:0.0:1783952131.333158:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465534592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.333165:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783952131.333307:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952131.333321:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb583f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5846 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.333329:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb583f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5846 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952131.333346:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783952131.333350:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb583f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5846 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.333357:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb583f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5846 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952131.333378:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783952131.333380:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97b167c90000 from 1 10000000:01000000:2.0:1783952131.333382:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783952131.333396:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.333403:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.333410:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952131.333422:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.333445:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952131.333474:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.333514:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465534720 00000100:00100000:0.0:1783952131.333518:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465534720 00000100:00100000:0.0:1783952131.333631:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783952131.333638:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465534720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952131.333646:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952131.333655:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb5854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb584d expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.333679:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb5854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb584d expref: 24 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.333687:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb5854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb584d expref: 24 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952131.333694:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbde00, rc 0) 00000100:00100000:0.0:1783952131.333719:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465534720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952131.333725:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783952131.333795:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952131.333806:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952131.333814:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952131.333875:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952131.333899:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952131.333985:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1783952131.334021:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465534848 00000100:00100000:0.0:1783952131.334026:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465534848 00000100:00100000:0.0:1783952131.334083:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783952131.334090:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465534848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952131.334167:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465534848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (266us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783952131.334174:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783952131.335794:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b602d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465534848:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783952131.335860:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783952131.335870:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952131.335880:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952131.567456:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952131.570908:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447755520 00000100:00100000:1.0:1783952131.570920:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447755520 00000100:00100000:1.0:1783952131.572617:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1332 00000100:00100000:1.0:1783952131.572632:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2398:x1870605447755520:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952131.572718:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2398:x1870605447755520:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 90us (5271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952131.572727:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1332 00000100:00080000:2.0:1783952131.577997:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952131.587464:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952131.587503:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952131.587686:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447755392 00000100:00100000:3.0:1783952131.587696:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447755392 00000100:00100000:3.0:1783952131.587736:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1345 00000100:00100000:3.0:1783952131.587745:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447755392:12345-192.168.202.48@tcp:38:kworker.0 00010000:00080000:3.0:1783952131.587779:0:83761:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'd33551be-a709-4ba2-a74c-f4d7b53c6817' at ffff97b17407c800, cookie 0x22c73c7857bb56e8 00010000:00080000:3.0:1783952131.587796:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp recovering/t0 exp ffff97b17407c800 cur 3846 last 1783952130 00010000:02000400:3.0:1783952131.587804:0:83761:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1783952131.587810:0:83761:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1783952131.587841:0:83761:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783952131.587987:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b1447cf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952131.588052:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447755392:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 306us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952131.588059:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1345 00000100:00100000:3.0:1783952131.588082:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447755648 00000100:00100000:3.0:1783952131.588086:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447755648 00000100:00100000:3.0:1783952131.588106:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 60 00000100:00100000:3.0:1783952131.588110:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:0+-99:2397:x1870605447755648:12345-192.168.202.48@tcp:250:kworker.0 00010000:00080000:3.0:1783952131.588123:0:92503:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp t0 exp 0000000000000000 cur 3846 last 0 00000020:00000080:3.0:1783952131.588204:0:92503:0:(genops.c:1406:class_connect()) connect: client e617e28a-7c0f-459e-8765-f628898cec50, cookie 0x22c73c7857bb585b 00000100:00080000:3.0:1783952131.588306:0:92503:0:(import.c:65:import_set_state_nolock()) ffff97b1447ca000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952131.588333:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+5:2397:x1870605447755648:12345-192.168.202.48@tcp:250:kworker.0 Request processed in 221us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952131.588340:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 60 00000100:00100000:1.0:1783952131.604777:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952131.606907:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447755776 00000100:00100000:3.0:1783952131.606921:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447755776 00000100:00100000:3.0:1783952131.606990:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1346 00000100:00100000:3.0:1783952131.607001:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447755776:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1783952131.607023:0:67035:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b04ab01180 x1870605447755776/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:392/0 lens 328/0 e 0 to 0 dl 1783952142 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952131.607049:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447755776:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 51us (2282us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952131.607061:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1346 00010000:00080000:1.0:1783952131.607221:0:92525:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1783952131.617563:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952131.681015:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:0.0:1783952132.132674:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:1.0:1783952132.642750:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952132.704868:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465534976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952132.704941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952132.705006:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465534976 00000100:00100000:1.0:1783952132.705014:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465534976 00000100:00100000:1.0:1783952132.705065:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:1.0:1783952132.705074:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465534976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952132.705102:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952132.705146:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465534976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952132.705152:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:1.0:1783952132.705201:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465534976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952132.705270:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00080000:2.0:1783952132.705721:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952132.706804:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952132.706833:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465535104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952132.706887:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952132.712940:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465535104 00000100:00100000:1.0:1783952132.712956:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465535104 00000100:00100000:1.0:1783952132.713053:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:1.0:1783952132.713064:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465535104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952132.713097:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952132.713178:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465535104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (6289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952132.713185:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00100000:0.0:1783952132.713295:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465535104:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783952132.714730:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952133.153833:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00000001:00100000:1.0:1783952133.218937:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783952133.550290:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952133.550458:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447755904 00000100:00100000:3.0:1783952133.550469:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447755904 00000100:00100000:3.0:1783952133.550528:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:3.0:1783952133.550539:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+5:70975:x1870605447755904:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952133.550557:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952133.550576:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216aa00/0x22c73c7857bb5862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3d9 expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952133.550708:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216aa00/0x22c73c7857bb5862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3d9 expref: 6 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952133.550721:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216aa00/0x22c73c7857bb5862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3d9 expref: 6 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952133.550731:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216aa00, rc 0) 00000100:00100000:3.0:1783952133.550791:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+6:70975:x1870605447755904:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 253us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952133.550798:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 61 00000100:00100000:2.0:1783952133.571089:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952133.571242:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447756032 00000100:00100000:0.0:1783952133.571253:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447756032 00000100:00100000:0.0:1783952133.571326:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:0.0:1783952133.571336:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+6:70975:x1870605447756032:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783952133.571376:0:92499:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1783952133.571391:0:92499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783952133.571395:0:92499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783952133.571398:0:92499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783952133.571402:0:92499:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783952133.571404:0:92499:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:0.0:1783952133.573223:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+6:70975:x1870605447756032:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 Request processed in 1880us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952133.573236:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:3.0:1783952133.577869:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952133.577957:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447756160 00000100:00100000:0.0:1783952133.577969:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447756160 00000100:00100000:0.0:1783952133.578025:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:0.0:1783952133.578035:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+6:70975:x1870605447756160:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952133.578051:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952133.578068:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbd400/0x22c73c7857bb5869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3e0 expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952133.578098:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbd400/0x22c73c7857bb5869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e0 expref: 7 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952133.578110:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbd400/0x22c73c7857bb5869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e0 expref: 7 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952133.578120:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd400, rc 0) 00000100:00100000:0.0:1783952133.578191:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+7:70975:x1870605447756160:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 158us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952133.578213:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:3.0:1783952133.584457:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952133.584620:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447756288 00000100:00100000:1.0:1783952133.584631:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447756288 00000100:00100000:1.0:1783952133.584683:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:1.0:1783952133.584692:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+7:70975:x1870605447756288:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952133.584844:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447756288:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 153us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952133.584852:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:3.0:1783952133.590897:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952133.590979:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447756416 00000100:00100000:1.0:1783952133.590989:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447756416 00000100:00100000:1.0:1783952133.591041:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:1.0:1783952133.591050:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447756416:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952133.591269:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447756416:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 219us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952133.591277:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:0.0:1783952133.602813:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952133.603286:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447756544 00000100:00100000:2.0:1783952133.603296:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447756544 00000100:00100000:2.0:1783952133.603345:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:2.0:1783952133.603411:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447756544:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952133.603430:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952133.603448:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86a800/0x22c73c7857bb5870 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3e7 expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952133.603472:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86a800/0x22c73c7857bb5870 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e7 expref: 9 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952133.603481:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86a800/0x22c73c7857bb5870 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e7 expref: 9 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952133.603487:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a800, rc 0) 00000100:00100000:2.0:1783952133.603540:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447756544:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 187us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952133.603548:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:3.0:1783952133.606509:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952133.606715:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447756672 00000100:00100000:0.0:1783952133.606724:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447756672 00000100:00100000:0.0:1783952133.606773:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:0.0:1783952133.606783:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447756672:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952133.606941:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447756672:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 158us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952133.606950:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:3.0:1783952133.613901:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952133.613940:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447756800 00000100:00100000:3.0:1783952133.613956:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447756800 00000100:00100000:3.0:1783952133.614012:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:3.0:1783952133.614022:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447756800:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952133.614158:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447756800:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952133.614166:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:2.0:1783952133.627058:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952133.627140:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447756928 00000100:00100000:3.0:1783952133.627150:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447756928 00000100:00100000:3.0:1783952133.627212:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:3.0:1783952133.627223:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447756928:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952133.627241:0:92497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952133.627257:0:92497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3ee expref: -99 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952133.627288:0:92497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3ee expref: 10 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952133.627300:0:92497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3ee expref: 10 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952133.627310:0:92497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a000, rc 0) 00000100:00100000:3.0:1783952133.627363:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447756928:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 142us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952133.627372:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:2.0:1783952133.633762:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952133.633843:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447757056 00000100:00100000:3.0:1783952133.633854:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447757056 00000100:00100000:3.0:1783952133.633909:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:3.0:1783952133.633918:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447757056:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952133.634048:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447757056:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 130us (294us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783952133.634056:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 70 00010000:00010000:0.0:1783952133.667305:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952133.730726:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00100000:0.0:1783952134.176693:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:1.0:1783952134.688819:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952134.752699:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000001:02000400:2.0:1783952135.064156:0:92776:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783952135.200711:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 0 seconds 00010000:00010000:2.0:1783952135.714090:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952135.776970:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 0 seconds 00000100:00080000:1.0:1783952135.779199:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952135.779205:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952135.779208:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952135.779217:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3845 00000100:00080000:1.0:1783952135.779221:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952135.779228:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952135.779250:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ab02300 x1870605465535360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952135.779273:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952135.779276:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952135.779278:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952135.779281:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3845 00000100:00080000:1.0:1783952135.779283:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952135.779287:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952135.779312:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b048e36300 x1870605465535616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952135.779340:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952135.779344:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952135.779346:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952135.779349:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3845 00000100:00080000:1.0:1783952135.779352:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952135.779355:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952135.779368:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b048e35180 x1870605465535872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952135.779387:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952135.779396:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952135.779398:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952135.779401:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3845 00000100:00080000:1.0:1783952135.779403:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952135.779407:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952135.779419:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04671fb80 x1870605465536256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952135.779445:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783952135.779448:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952135.779449:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046483000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952135.779454:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b046483000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952135.779464:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04671e680 x1870605465536768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952135.779493:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465535232:0@lo:400:kworker.0 00000100:00100000:1.0:1783952135.779558:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.779613:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465536128:0@lo:400:kworker.0 00000100:00100000:1.0:1783952135.779640:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.779666:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783952135.779671:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465535488:0@lo:400:kworker.0 00000100:00100000:1.0:1783952135.779693:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.779710:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465536384:0@lo:400:kworker.0 00000100:00100000:1.0:1783952135.779735:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.779763:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465535360:0@lo:38:kworker.0 00000100:00100000:0.0:1783952135.779808:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465535744:0@lo:400:kworker.0 00000100:00100000:1.0:1783952135.779905:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.779933:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465535616:0@lo:38:kworker.0 00000100:00100000:1.0:1783952135.779954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.779969:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465535872:0@lo:38:kworker.0 00000100:00100000:1.0:1783952135.779987:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.780004:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465536256:0@lo:38:kworker.0 00000100:00100000:1.0:1783952135.780025:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.780041:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465536768:0@lo:38:kworker.0 00000100:00100000:1.0:1783952135.780062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.780091:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465535488 00000100:00100000:1.0:1783952135.780097:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465535488 00000100:00100000:3.0:1783952135.780127:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465536384 00000100:00100000:3.0:1783952135.780130:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465536384 00000100:00100000:1.0:1783952135.780143:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465535360 00000100:00100000:1.0:1783952135.780146:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465535360 00000100:00100000:3.0:1783952135.780152:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465535872 00000100:00100000:1.0:1783952135.780154:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465535616 00000100:00100000:3.0:1783952135.780155:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465535872 00000100:00100000:1.0:1783952135.780155:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465535616 00000100:00100000:1.0:1783952135.780162:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465536256 00000100:00100000:1.0:1783952135.780163:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465536256 00000100:00100000:1.0:1783952135.780170:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465536768 00000100:00100000:1.0:1783952135.780172:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465536768 00000100:00100000:1.0:1783952135.780182:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1783952135.780191:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465535488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952135.780243:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465535488:12345-0@lo:400:kworker.0 Request processed in 53us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952135.780250:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1783952135.780266:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1783952135.780270:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465535360:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783952135.780690:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465536128 00000100:00100000:0.0:1783952135.780694:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465536128 00000100:00100000:3.0:1783952135.780808:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:3.0:1783952135.780816:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465536384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952135.780853:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465536384:12345-0@lo:400:kworker.0 Request processed in 39us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952135.780859:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:3.0:1783952135.780873:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:3.0:1783952135.780877:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465535872:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783952135.780976:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812 00000100:00100000:0.0:1783952135.780983:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465536128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952135.781017:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465536128:12345-0@lo:400:kworker.0 Request processed in 35us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.781023:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812 00000100:00100000:0.0:1783952135.781044:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465535232 00000100:00100000:0.0:1783952135.781048:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465535232 00000100:00100000:0.0:1783952135.781071:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783952135.781077:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465535232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952135.781104:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465535232:12345-0@lo:400:kworker.0 Request processed in 28us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.781116:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783952135.781144:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465536000:0@lo:400:kworker.0 00010000:00080000:3.0:1783952135.781245:0:8444:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff97b17407e800, cookie 0x22c73c7857bb56e1 00010000:00080000:3.0:1783952135.781252:0:8444:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378653 exp ffff97b17407e800 cur 3850 last 1783952130 00000004:00100000:3.0:1783952135.781271:0:8444:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1783952135.781660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952135.781689:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465536640:0@lo:400:kworker.0 00000100:00100000:0.0:1783952135.781725:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952135.781758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952135.781769:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465536512:0@lo:400:kworker.0 00000100:00100000:0.0:1783952135.781805:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952135.781840:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465536000 00000100:00100000:0.0:1783952135.781844:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465536000 00000100:00100000:0.0:1783952135.781870:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465536640 00000100:00100000:0.0:1783952135.781872:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465536640 00010000:00080000:1.0:1783952135.781943:0:68591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3850 last 0 00000100:00080000:3.0:1783952135.781980:0:8444:0:(import.c:65:import_set_state_nolock()) ffff97b17704c800 : changing import state from RECOVER to FULL 00000020:00000080:1.0:1783952135.781980:0:68591:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x22c73c7857bb587e 00000004:00100000:1.0:1783952135.781995:0:68591:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783952135.782011:0:68591:0:(import.c:65:import_set_state_nolock()) ffff97b144577000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952135.782029:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465535872:12345-0@lo:38:kworker.0 Request processed in 1150us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952135.782036:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:1.0:1783952135.782038:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870605465535360:12345-0@lo:38:kworker.0 Request processed in 1766us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952135.782043:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00080000:3.0:1783952135.782055:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952135.782055:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465535744 00000100:00080000:3.0:1783952135.782058:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952135.782058:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465535744 00000100:00080000:3.0:1783952135.782060:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952135.782072:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1783952135.782078:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465535616:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783952135.782080:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1783952135.782085:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465535744:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783952135.782099:0:67035:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3850 last 0 00000100:00100000:1.0:1783952135.782116:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465535744:12345-0@lo:400:kworker.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000020:00000080:3.0:1783952135.782121:0:67035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x22c73c7857bb5885 00000100:00100000:1.0:1783952135.782121:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000004:00100000:3.0:1783952135.782127:0:67035:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1783952135.782132:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1783952135.782136:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465536256:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1783952135.782142:0:67035:0:(import.c:65:import_set_state_nolock()) ffff97b143cdf800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1783952135.782148:0:68591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3850 last 0 00000020:00000080:1.0:1783952135.782168:0:68591:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x22c73c7857bb588c 00000004:00100000:1.0:1783952135.782174:0:68591:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783952135.782187:0:68591:0:(import.c:65:import_set_state_nolock()) ffff97b144570000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952135.782213:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870605465536256:12345-0@lo:38:kworker.0 Request processed in 75us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952135.782220:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1783952135.782232:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1783952135.782236:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1870605465536768:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783952135.782248:0:68591:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3850 last 0 00000020:00000080:1.0:1783952135.782268:0:68591:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x22c73c7857bb5893 00000004:00100000:1.0:1783952135.782273:0:68591:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1783952135.782370:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465536512 00000100:00100000:0.0:1783952135.782375:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465536512 00000100:00100000:3.0:1783952135.782702:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870605465535616:12345-0@lo:38:kworker.0 Request processed in 621us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.782804:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1783952135.782813:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465536000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952135.782857:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465536000:12345-0@lo:400:kworker.0 Request processed in 46us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.782863:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1783952135.782876:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:0.0:1783952135.782881:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465536640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952135.782964:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1783952135.783263:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465536640:12345-0@lo:400:kworker.0 Request processed in 382us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.783270:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00100000:0.0:1783952135.783283:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:0.0:1783952135.783289:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465536512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952135.783324:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465536512:12345-0@lo:400:kworker.0 Request processed in 35us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.783330:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00100000:0.0:1783952135.783399:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465535744:0@lo:400:kworker.0 00000100:00080000:1.0:1783952135.783405:0:68591:0:(import.c:65:import_set_state_nolock()) ffff97b144576800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783952135.783413:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465536512:0@lo:400:kworker.0 00000100:00100000:1.0:1783952135.783437:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465536768:12345-0@lo:38:kworker.0 Request processed in 1199us (3374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952135.783443:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1783952135.783454:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465536000:0@lo:400:kworker.0 00000100:00100000:0.0:1783952135.783487:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465536640:0@lo:400:kworker.0 00000100:00100000:1.0:1783952135.783532:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952135.783542:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465536896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952135.783556:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465535488:0@lo:400:kworker.0 00000100:00100000:0.0:1783952135.783571:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465536384:0@lo:400:kworker.0 00000100:00100000:1.0:1783952135.783572:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783952135.783674:0:92525:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1783952135.783680:0:92525:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 115964116997 00000020:00080000:3.0:1783952135.783685:0:92525:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952135.783688:0:92525:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116997 00000020:00080000:3.0:1783952135.783692:0:92525:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952135.783694:0:92525:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116997 00000100:00080000:3.0:1783952135.783704:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952135.783777:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952135.783838:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465536896 00000100:00100000:3.0:1783952135.783843:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465536896 00000100:00100000:3.0:1783952135.783879:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:3.0:1783952135.784259:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465536896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952135.784288:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:3.0:1783952135.784333:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465536896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 448us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952135.784340:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00010000:00080000:3.0:1783952135.784410:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b04ab02300 x1870605465535360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.784423:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00100000:1.0:1783952135.784506:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465536896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952135.785041:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465535232:0@lo:400:kworker.0 00000100:00100000:0.0:1783952135.785057:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465536128:0@lo:400:kworker.0 00000001:00100000:1.0:1783952135.785781:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1783952135.787163:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff97b04ab02300 x1870605465535360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952160 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.787246:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783952135.787252:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783952135.787257:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783952135.787263:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465535360:0@lo:38:kworker.0 00010000:00080000:3.0:1783952135.787475:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b048e36300 x1870605465535616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.787497:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000001:00100000:2.0:1783952135.787660:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1783952135.789070:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff97b048e36300 x1870605465535616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952160 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.789082:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783952135.789086:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783952135.789090:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783952135.789096:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465535616:0@lo:38:kworker.0 00000100:00080000:3.0:1783952135.789127:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:3.0:1783952135.789136:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1783952135.789140:0:3641:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1783952135.789142:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116996 gen 3 00000100:00080000:3.0:1783952135.789145:0:3641:0:(recover.c:53:ptlrpc_replay_next()) import ffff97b048caf800 from lustre-MDT0000_UUID committed 115964116996 last 0 00000100:00080000:3.0:1783952135.789147:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1783952135.790156:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465535872:0@lo:38:kworker.0 00010000:00080000:3.0:1783952135.790249:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b04671fb80 x1870605465536256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.790276:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000100:00080000:3.0:1783952135.792349:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff97b04671fb80 x1870605465536256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952160 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.792362:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783952135.792368:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783952135.792372:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1783952135.792378:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005a292e61): req@ffff97b14de1c700 x1870605465518464/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783952135.792584:0:92811:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1783952135.792603:0:92811:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1783952135.792609:0:92811:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00100000:1.0:1783952135.792936:0:66257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.792970:0:66257:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 11 seconds 00000100:00100000:1.0:1783952135.793010:0:66251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465518464 00000100:00100000:1.0:1783952135.793017:0:66251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465518464 00000100:00080000:2.0:1783952135.793037:0:92811:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1783952135.793064:0:66251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783952135.793072:0:66251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66257:x1870605465518464:12345-0@lo:700:mdt_seqm_0000.0 00010000:00080000:1.0:1783952135.793088:0:66251:0:(ldlm_lib.c:3211:target_queue_recovery_request()) @@@ not queueing req@ffff97b049e77480 x1870605465518464/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:396/0 lens 264/0 e 0 to 0 dl 1783952146 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952135.793358:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465536256:0@lo:38:kworker.0 00010000:00080000:3.0:1783952135.793384:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b04671e680 x1870605465536768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.793408:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:3.0:1783952135.793416:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783952135.793420:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783952135.793422:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046483000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783952135.793426:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465536768:0@lo:38:kworker.0 00000100:00100000:3.0:1783952135.793833:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465537024:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783952135.793869:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952135.794443:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465537024 00000100:00100000:2.0:1783952135.794449:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465537024 00000100:00100000:2.0:1783952135.794492:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:2.0:1783952135.794501:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465537024:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783952135.794518:0:8445:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b146bad880 x1870605465537024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:396/0 lens 224/0 e 0 to 0 dl 1783952146 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952135.794537:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465537024:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 39us (667us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952135.794544:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000020:00080000:2.0:1783952135.794561:0:92525:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783952135.794565:0:92525:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964116997 00010000:00080000:2.0:1783952135.794568:0:92525:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1783952135.794572:0:92525:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783952135.794578:0:92525:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783952135.794580:0:92525:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783952135.794604:0:92525:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b04ab01180 x1870605447755776/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:392/0 lens 328/0 e 0 to 0 dl 1783952142 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783952135.794621:0:92525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952135.794648:0:92525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb589a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3af expref: -99 pid: 92525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.794673:0:92525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb589a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 7 pid: 92525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.794691:0:92525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb589a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 7 pid: 92525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.794716:0:92525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ba00, rc 0) 00010000:00080000:2.0:1783952135.794772:0:92525:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:2.0:1783952135.794793:0:92525:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1783952135.804717:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952135.804751:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447757184 00000100:00100000:1.0:1783952135.804760:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447757184 00000100:00100000:1.0:1783952135.804824:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1335 00000100:00100000:1.0:1783952135.804835:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2397:x1870605447757184:12345-192.168.202.48@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1783952135.804856:0:67035:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b049e74a80 x1870605447757184/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:396/0 lens 224/0 e 0 to 0 dl 1783952146 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952135.804880:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2397:x1870605447757184:12345-192.168.202.48@tcp:400:ptlrpcd_rcv.0 Request processed in 49us (171us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952135.804899:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1335 00010000:00080000:2.0:1783952135.806988:0:92525:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1783952135.807112:0:92525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 40000000:02000000:0.0:1783952135.813297:0:66251:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000001:00100000:3.0:1783952135.817127:0:92492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000001:00100000:3.0:1783952135.817136:0:92492:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1783952135.817394:0:92525:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1783952135.817449:0:92525:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1783952135.817466:0:92525:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff97b146bad880 x1870605465537024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:396/0 lens 224/0 e 0 to 0 dl 1783952146 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.817634:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1783952135.817644:0:3641:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff97b16dd4fb80 x1870605465537024/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952151 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.817666:0:3641:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff97b16dd4fb80 x1870605465537024/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952151 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.817672:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783952135.817683:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00010000:00080000:1.0:1783952135.817683:0:92525:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.48@tcp: req@ffff97b049e74a80 x1870605447757184/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:396/0 lens 224/0 e 0 to 0 dl 1783952146 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952135.817689:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fd917088): req@ffff97b049d70e00 x1870605465515520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952135.817705:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465537024:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783952135.817825:0:75700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1783952135.817825:0:92525:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:3.0:1783952135.817865:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b174b5e540 going to sleep for 11 seconds 00000100:00100000:3.0:1783952135.817881:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465537152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952135.817904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952135.817934:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465515520 00000100:00100000:3.0:1783952135.817940:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465515520 00000100:00100000:3.0:1783952135.817979:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465537152 00000100:00100000:3.0:1783952135.817983:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465537152 00000100:00100000:3.0:1783952135.818002:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:3.0:1783952135.818010:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75700:x1870605465515520:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783952135.818478:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:2.0:1783952135.818488:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465537152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952135.818511:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1783952135.818558:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465537152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952135.818564:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:2.0:1783952135.819078:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465537152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952135.819688:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75700:x1870605465515520:12345-0@lo:1000:osp_up0-1.0 Request processed in 1676us (1861us total) trans 120259084289 rc 0/0 00000100:00100000:3.0:1783952135.819698:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:3.0:1783952135.819749:0:75700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d70e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465515520:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783952135.832868:0:66251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66257:x1870605465518464:12345-0@lo:700:mdt_seqm_0000.0 Request processed in 39788us (39924us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.832888:0:66251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783952135.833062:0:66257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1c700 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-lwp-MDT0001_UUID:66257:1870605465518464:0@lo:700:mdt_seqm_0000.0 40000000:02000000:2.0:1783952135.833076:0:66257:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000100:00100000:2.0:1783952135.846442:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447751424:12345-192.168.202.48@tcp:700:cp.0 Request processed in 20129219us (20133709us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952135.849667:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:2.0:1783952135.850663:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952135.850700:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447757440 00000100:00100000:2.0:1783952135.850845:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447757440 00000100:00100000:2.0:1783952135.850970:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1351 00000100:00100000:2.0:1783952135.850981:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447757440:12345-192.168.202.48@tcp:101:cp.0 00010000:00010000:2.0:1783952135.851001:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952135.851030:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86be00/0x22c73c7857bb58a1 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3f5 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.851136:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86b000/0x22c73c7857bb58a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.851145:0:66236:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86b000/0x22c73c7857bb58a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.851168:0:66236:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86b000/0x22c73c7857bb58a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952135.851191:0:66236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66236:1870605465537280:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1783952135.851240:0:66236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952135.851265:0:66236:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a9c0 going to sleep for 11 seconds 00000100:00080000:2.0:1783952135.851280:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952135.851296:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465537280 00000100:00100000:2.0:1783952135.851300:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465537280 00000100:00100000:2.0:1783952135.851328:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:2.0:1783952135.851334:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66236:x1870605465537280:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783952135.851346:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952135.851356:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b400/0x22c73c7857bb58af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb58a8 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.851377:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b400/0x22c73c7857bb58af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb58a8 expref: 8 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.851390:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b400/0x22c73c7857bb58af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb58a8 expref: 8 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.851409:0:8445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:2.0:1783952135.851412:0:8445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783952135.851415:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86b400, rc 0) 00000100:00100000:2.0:1783952135.851450:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66236:x1870605465537280:12345-0@lo:101:mdt00_000.0 Request processed in 116us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952135.851469:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:2.0:1783952135.853216:0:66236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66236:1870605465537280:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1783952135.853244:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86b000/0x22c73c7857bb58a8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb58af expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.853257:0:66236:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86b000/0x22c73c7857bb58a8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb58af expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952135.853282:0:66236:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1783952135.853289:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86b000/0x22c73c7857bb58a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb58af expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.853298:0:66236:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86b000/0x22c73c7857bb58a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb58af expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.853368:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.853379:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.853389:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.853416:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.853424:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.853430:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952135.854083:0:66236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66236:1870605465537408:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783952135.854140:0:66236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952135.854192:0:66236:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952135.854246:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465537408 00000100:00100000:0.0:1783952135.854252:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465537408 00000100:00100000:0.0:1783952135.854298:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:0.0:1783952135.854306:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66236:x1870605465537408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783952135.854413:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66236:x1870605465537408:12345-0@lo:1000:mdt00_000.0 Request processed in 107us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.854420:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00100000:2.0:1783952135.855860:0:66236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66236:1870605465537408:0@lo:1000:mdt00_000.0 00000004:00080000:3.0:1783952135.857343:0:66236:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xb1:0x0], count =369 00000004:00080000:3.0:1783952135.857355:0:66236:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0xb1:0x0]+369 in llog 00000004:00080000:3.0:1783952135.857375:0:66236:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x222:0x0], index 0: 0 00010000:00010000:3.0:1783952135.857741:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b000/0x22c73c7857bb58c4 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857766:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b000/0x22c73c7857bb58c4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857778:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b000/0x22c73c7857bb58c4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857835:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857842:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857848:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857855:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857861:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952135.857866:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857873:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857885:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:3.0:1783952135.857888:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952135.857892:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857898:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86b800/0x22c73c7857bb58b6 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952135.857917:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000107d9047 reply state 0000000015f56a22 transno 77309411444 ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857928:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857935:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xb1bed465 (ffff97b176ee0400) 00010000:00010000:3.0:1783952135.857937:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952135.857940:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783952135.857980:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86be00/0x22c73c7857bb58a1 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3f5 expref: 10 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.857996:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b000/0x22c73c7857bb58c4 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3f5 expref: 9 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.858004:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff97b155d9df00) 00010000:00010000:3.0:1783952135.858006:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952135.858008:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b000, rc 0) 00000100:00100000:3.0:1783952135.858125:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71063:x1870605447757440:12345-192.168.202.48@tcp:101:cp.0 Request processed in 7145us (7464us total) trans 77309411444 rc 0/0 00000100:00100000:3.0:1783952135.858134:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1351 00000004:00000080:1.0:1783952135.867214:0:92525:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa80a486cbe10 00100000:10000000:1.0:1783952135.867230:0:92525:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:0.0:1783952135.872045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952135.872134:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447757568 00000100:00100000:3.0:1783952135.872144:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447757568 00000100:00100000:3.0:1783952135.872269:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4943 00000100:00100000:3.0:1783952135.872277:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17743a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1870605447757568:12345-192.168.202.48@tcp:8:cp.0 00010000:00080000:3.0:1783952135.872323:0:8433:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp t0 exp 0000000000000000 cur 3850 last 0 00000020:00000080:3.0:1783952135.872356:0:8433:0:(genops.c:1406:class_connect()) connect: client d33551be-a709-4ba2-a74c-f4d7b53c6817, cookie 0x22c73c7857bb58d2 00002000:00100000:3.0:1783952135.872373:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d33551be-a709-4ba2-a74c-f4d7b53c6817/ffff97b046ae1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783952135.872400:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783952135.872676:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783952135.872708:0:8433:0:(import.c:65:import_set_state_nolock()) ffff97b046ae6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952135.872774:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17743a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447757568:12345-192.168.202.48@tcp:8:cp.0 Request processed in 496us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952135.872781:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4943 00000004:00080000:2.0:1783952135.876053:0:92511:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x723:0x0] 00000100:00100000:2.0:1783952135.876105:0:92511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92511:1870605465537536:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783952135.876175:0:92511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952135.876208:0:92511:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905acc0 going to sleep for 11 seconds 00000004:00080000:0.0:1783952135.877448:0:92513:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x722:0x0] 00000100:00100000:0.0:1783952135.877505:0:92513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92513:1870605465537664:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783952135.877554:0:92513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952135.877577:0:92513:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf840 going to sleep for 11 seconds 00000100:00100000:0.0:1783952135.877618:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465537536 00000100:00100000:0.0:1783952135.877625:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465537536 00000100:00100000:0.0:1783952135.877664:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465537664 00000100:00100000:0.0:1783952135.877667:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465537664 00000100:00100000:0.0:1783952135.877687:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4944 00000100:00100000:0.0:1783952135.877694:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:92511:x1870605465537536:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783952135.877722:0:26202:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -62 00002000:02000040:0.0:1783952135.877727:0:26202:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1828 to 0x280000401:1889) 00000100:00100000:1.0:1783952135.881110:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4945 00000100:00100000:1.0:1783952135.881132:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:92513:x1870605465537664:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783952135.881168:0:26201:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -63 00002000:02000040:1.0:1783952135.881174:0:26201:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1827 to 0x2c0000401:1889) 00000100:00100000:2.0:1783952135.883219:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952135.883430:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447757696 00000100:00100000:3.0:1783952135.883440:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447757696 00000100:00100000:3.0:1783952135.883538:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4946 00000100:00100000:3.0:1783952135.883548:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:0:x1870605447757696:12345-192.168.202.48@tcp:101:cp.0 00010000:00010000:3.0:1783952135.883566:0:26204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952135.883617:0:26204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb58d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a3fc expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952135.883644:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x222:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783952135.883664:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:3.0:1783952135.883668:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783952135.883678:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb58d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3fc expref: 7 pid: 26204 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.883699:0:26204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb58d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3fc expref: 7 pid: 26204 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.883723:0:26204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b200, rc 0) 00000100:00100000:3.0:1783952135.883778:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:0:x1870605447757696:12345-192.168.202.48@tcp:101:cp.0 Request processed in 232us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952135.883805:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4946 00000100:00080000:2.0:1783952135.884202:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952135.888188:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952135.888264:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447757824 00000100:00100000:3.0:1783952135.888274:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447757824 00000100:00100000:3.0:1783952135.888329:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4947 00000100:00100000:3.0:1783952135.888345:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71063:x1870605447757824:12345-192.168.202.48@tcp:101:cp.0 00010000:00010000:3.0:1783952135.888363:0:26200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952135.888380:0:26200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a403 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.888415:0:26200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb58d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3fc expref: 8 pid: 26204 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.888424:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783952135.888428:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783952135.888433:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 8 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.888466:0:26200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb58d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3fc expref: 8 pid: 26204 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.888493:0:26200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb58d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3fc expref: 8 pid: 26204 timeout: 3950 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952135.888508:0:26200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26200:1870605465537792:192.168.202.48@tcp:104: 00000100:00100000:3.0:1783952135.888583:0:26200:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04855e180 going to sleep for 11 seconds 00002000:00010000:0.0:1783952135.894093:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.894108:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb58e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.894127:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.894132:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.894138:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb58e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.894152:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb58e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.894162:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb58e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.894257:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb58e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.894327:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783952135.894442:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.894447:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b217a5f/0x22c73c7857bb58ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.894455:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.894458:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.894462:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b217a5f/0x22c73c7857bb58ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.894478:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b217a5f/0x22c73c7857bb58ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.894611:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b217a5f/0x22c73c7857bb58ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.894620:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b217a5f/0x22c73c7857bb58ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.895810:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952135.895821:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb58e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.895831:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.895835:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb58e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.895855:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb58e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.895874:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb58e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.895881:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb58e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.895908:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.895911:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b217a5f/0x22c73c7857bb58ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.895917:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.895921:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b217a5f/0x22c73c7857bb58ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.895928:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b217a5f/0x22c73c7857bb58ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.895951:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b217a5f/0x22c73c7857bb58ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.895959:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.895961:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.895963:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952135.896268:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783952135.896275:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b217a5f/0x22c73c7857bb58ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.896415:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.896422:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dfc72d2/0x22c73c7857bb58f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.896432:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.896436:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.896442:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dfc72d2/0x22c73c7857bb58f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.896452:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dfc72d2/0x22c73c7857bb58f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.896461:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dfc72d2/0x22c73c7857bb58f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.896478:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dfc72d2/0x22c73c7857bb58f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.896713:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.896719:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dfc72d2/0x22c73c7857bb58f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.896727:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.896730:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dfc72d2/0x22c73c7857bb58f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.896738:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dfc72d2/0x22c73c7857bb58f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.896748:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dfc72d2/0x22c73c7857bb58f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.896757:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.896758:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.896760:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952135.896852:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783952135.896857:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dfc72d2/0x22c73c7857bb58f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.896927:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.896932:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb58fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.896951:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.896954:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.896958:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb58fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.896965:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb58fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.896972:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb58fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.896978:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb58fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.897108:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.897114:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb58fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.897131:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.897134:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb58fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.897141:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb58fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.897151:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb58fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.897158:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.897160:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.897161:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952135.897239:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783952135.897243:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb58fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.897262:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952135.897540:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.897545:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb5903 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.897554:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.897557:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.897561:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb5903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.897577:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb5903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.897638:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb5903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.897648:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb5903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.897694:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783952135.897737:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.897742:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb590a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.897751:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.897754:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.897758:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb590a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.897769:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb590a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.897777:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb590a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.897805:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb590a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.897953:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952135.897958:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb5903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.897966:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbdc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.897969:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb5903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.897976:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb5903 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.897987:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb5903 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.897999:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb5903 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898014:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.898017:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb590a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898024:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbcc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.898027:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb590a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898033:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb590a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898043:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb590a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898049:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.898050:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.898052:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952135.898112:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783952135.898117:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb590a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.898235:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.898241:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb5911 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.898249:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.898252:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.898256:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb5911 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.898264:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb5911 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.898271:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb5911 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.898278:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb5911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898609:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.898614:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb5911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898621:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.898630:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb5911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898638:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb5911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898649:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb5911 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898657:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.898658:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.898660:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952135.898732:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783952135.898736:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008632d827/0x22c73c7857bb5911 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.898801:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.898807:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb5918 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.898815:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.898818:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.898821:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb5918 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.898830:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb5918 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.898838:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb5918 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.898968:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb5918 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.898991:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.898997:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb5918 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.899003:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644da00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.899006:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb5918 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.899013:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb5918 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.899023:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb5918 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.899030:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.899037:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.899039:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952135.899102:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783952135.899107:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb5918 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.899233:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.899239:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb591f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.899247:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.899250:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.899254:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb591f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.899263:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb591f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.899272:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb591f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.899279:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb591f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.900598:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.900608:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb591f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.900619:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.900623:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb591f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.900633:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb591f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.900650:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb591f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.900662:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.900664:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.900665:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952135.903680:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783952135.903695:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dadde7d/0x22c73c7857bb591f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.903838:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.903854:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb5926 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.903879:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.903884:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.903891:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb5926 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.903904:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb5926 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.903915:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb5926 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.903923:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb5926 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.905111:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.905124:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb5926 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.905136:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.905140:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb5926 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.905151:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb5926 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.905180:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb5926 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.905190:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.905192:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.905193:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952135.905384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952135.905424:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447757952 00000100:00100000:2.0:1783952135.905433:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447757952 00010000:00010000:2.0:1783952135.905470:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb58d9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3fc expref: 9 pid: 26204 timeout: 3950 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952135.905513:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2553 00000100:00100000:2.0:1783952135.905531:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1472bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2401:x1870605447757952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783952135.905546:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952135.905567:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb58d9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3fc expref: 9 pid: 26204 timeout: 3950 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.905600:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783952135.905607:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f34f1e/0x22c73c7857bb5926 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.905702:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.905708:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb592d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.905718:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.905722:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.905727:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb592d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.905745:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb592d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.905753:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb592d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.905761:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb592d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.905774:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783952135.905825:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.905830:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb5934 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.905839:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.905841:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952135.905955:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb58d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3fc expref: 9 pid: 26204 timeout: 3950 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.905973:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952135.905976:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952135.905984:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 9 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.905991:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 9 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.906023:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 9 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952135.906037:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6502:1870605465537920:192.168.202.48@tcp:105: 00010000:00010000:0.0:1783952135.906073:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb5934 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.906085:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb5934 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.906092:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb5934 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.906109:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb5934 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952135.906111:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905aa80 going to sleep for 11 seconds 00010000:00010000:0.0:1783952135.906121:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783952135.906348:0:26200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb58d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3fc expref: 9 pid: 26204 timeout: 3950 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952135.906362:0:26200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26200:1870605465537792:192.168.202.48@tcp:104: 00010000:00010000:3.0:1783952135.906383:0:26200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 8 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.906394:0:26200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a800, rc 0) 00000100:00100000:3.0:1783952135.906431:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71063:x1870605447757824:12345-192.168.202.48@tcp:101:cp.0 Request processed in 18093us (18252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952135.906439:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4947 00010000:00010000:3.0:1783952135.906515:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952135.906521:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb592d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.906529:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.906533:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb592d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.906551:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb592d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.906563:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb592d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.906570:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316347f2/0x22c73c7857bb592d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.907919:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.907924:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb5934 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.907934:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.907937:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb5934 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.907946:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb5934 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.907960:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb5934 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.907968:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000815c98df/0x22c73c7857bb5934 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.907999:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.908001:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.908003:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.908010:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.908016:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952135.908906:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.908917:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb593b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.908930:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.908935:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.908941:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb593b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.908957:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb593b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.908978:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb593b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.908986:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb593b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909009:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783952135.909110:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.909115:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb5942 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909122:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.909125:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.909129:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb5942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909136:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb5942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909143:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb5942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909149:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb5942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909180:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783952135.909217:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.909222:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb5949 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909231:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.909234:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.909237:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb5949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909245:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb5949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909252:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb5949 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909259:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb5949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909271:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783952135.909308:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.909313:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb5950 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909320:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.909328:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.909332:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb5950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909341:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb5950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909348:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb5950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909355:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb5950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909366:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783952135.909405:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.909409:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb5957 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909416:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.909418:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.909422:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb5957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909430:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb5957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909438:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb5957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909451:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb5957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909459:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783952135.909493:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.909498:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b69163ee/0x22c73c7857bb595e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909505:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.909508:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.909512:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b69163ee/0x22c73c7857bb595e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909521:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b69163ee/0x22c73c7857bb595e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909528:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b69163ee/0x22c73c7857bb595e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909536:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b69163ee/0x22c73c7857bb595e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909545:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783952135.909580:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.909625:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0177feb/0x22c73c7857bb5965 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909642:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.909645:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.909648:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0177feb/0x22c73c7857bb5965 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909657:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0177feb/0x22c73c7857bb5965 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909664:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0177feb/0x22c73c7857bb5965 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909671:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0177feb/0x22c73c7857bb5965 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909709:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1783952135.909744:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.909749:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3dd385/0x22c73c7857bb596c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909757:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.909760:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.909763:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3dd385/0x22c73c7857bb596c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909772:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3dd385/0x22c73c7857bb596c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909801:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3dd385/0x22c73c7857bb596c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909808:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3dd385/0x22c73c7857bb596c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909817:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1783952135.909855:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.909860:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb5973 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909866:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.909869:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.909872:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb5973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909881:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb5973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909889:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb5973 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909895:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb5973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909915:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1783952135.909951:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.909956:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78fc5d5/0x22c73c7857bb597a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909964:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.909966:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.909970:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a78fc5d5/0x22c73c7857bb597a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909979:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a78fc5d5/0x22c73c7857bb597a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909987:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78fc5d5/0x22c73c7857bb597a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.909994:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a78fc5d5/0x22c73c7857bb597a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.910003:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1783952135.910038:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.910043:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb5981 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.910050:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.910058:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1783952135.910059:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.910062:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb5981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910065:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb5988 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.910071:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb5981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910073:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.910076:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.910079:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb5981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910080:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb5988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.910087:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb5981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910090:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb5988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.910095:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:0.0:1783952135.910097:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb5988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910104:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb5988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910111:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1783952135.910129:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.910134:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c541d0e2/0x22c73c7857bb598f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.910140:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.910144:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.910148:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c541d0e2/0x22c73c7857bb598f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.910156:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c541d0e2/0x22c73c7857bb598f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.910164:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c541d0e2/0x22c73c7857bb598f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.910171:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.910175:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb5996 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.910177:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c541d0e2/0x22c73c7857bb598f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.910185:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00010000:00010000:0.0:1783952135.910187:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.910190:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.910193:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb5996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910202:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb5996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910210:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb5996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910217:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb5996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910225:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:0.0:1783952135.910263:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.910267:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb599d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910274:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.910277:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.910281:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb599d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910290:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb599d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910307:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb599d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910314:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb599d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910322:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:0.0:1783952135.910359:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.910364:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb59a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910371:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.910374:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.910378:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb59a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910386:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb59a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910405:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb59a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910412:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb59a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910430:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00010000:00010000:2.0:1783952135.910470:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:2.0:1783952135.910478:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb593b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910486:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cda00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.910497:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb593b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910506:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb593b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910521:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb593b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910529:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c330196/0x22c73c7857bb593b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910546:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1783952135.910549:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb5942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910555:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cd400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.910559:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb5942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910566:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb5942 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910603:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb5942 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910612:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7c0791/0x22c73c7857bb5942 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910630:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1783952135.910634:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb5949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910640:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cd200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.910643:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb5949 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910651:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb5949 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910662:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb5949 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910669:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c972c762/0x22c73c7857bb5949 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910680:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1783952135.910684:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb5950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910690:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.910693:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb5950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.910702:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.910707:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb59ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910715:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.910717:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.910721:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb59ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910729:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb59ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910737:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb59ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910745:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb59ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.910754:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00010000:00010000:2.0:1783952135.910819:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb5950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910829:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb5950 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910836:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007441d980/0x22c73c7857bb5950 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910857:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1783952135.910861:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb5957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910866:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.910869:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb5957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910876:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb5957 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910885:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb5957 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910892:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032b417fb/0x22c73c7857bb5957 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910915:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1783952135.910918:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b69163ee/0x22c73c7857bb595e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910924:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.910927:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b69163ee/0x22c73c7857bb595e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910935:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b69163ee/0x22c73c7857bb595e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910946:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b69163ee/0x22c73c7857bb595e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910953:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b69163ee/0x22c73c7857bb595e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910965:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1783952135.910968:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0177feb/0x22c73c7857bb5965 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910973:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.910975:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0177feb/0x22c73c7857bb5965 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.910993:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0177feb/0x22c73c7857bb5965 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911003:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0177feb/0x22c73c7857bb5965 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911011:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0177feb/0x22c73c7857bb5965 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911025:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1783952135.911028:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa3dd385/0x22c73c7857bb596c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911034:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.911036:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3dd385/0x22c73c7857bb596c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911043:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3dd385/0x22c73c7857bb596c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911052:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa3dd385/0x22c73c7857bb596c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911058:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa3dd385/0x22c73c7857bb596c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911081:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783952135.911084:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb5973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911090:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.911093:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb5973 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911099:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb5973 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911109:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb5973 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911116:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa607b75/0x22c73c7857bb5973 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911127:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783952135.911130:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a78fc5d5/0x22c73c7857bb597a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911137:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.911140:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78fc5d5/0x22c73c7857bb597a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911159:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78fc5d5/0x22c73c7857bb597a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911169:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a78fc5d5/0x22c73c7857bb597a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911177:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a78fc5d5/0x22c73c7857bb597a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911190:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783952135.911193:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb5981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911199:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.911202:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb5981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911209:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb5981 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911217:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb5981 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911224:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9fbc1fa/0x22c73c7857bb5981 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911245:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783952135.911248:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb5988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911254:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.911257:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb5988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911265:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb5988 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911275:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb5988 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911283:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e06b245/0x22c73c7857bb5988 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911298:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783952135.911301:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c541d0e2/0x22c73c7857bb598f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.911306:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952135.911308:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.911312:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c541d0e2/0x22c73c7857bb598f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.911312:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb59b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.911321:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.911328:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952135.911330:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c541d0e2/0x22c73c7857bb598f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.911332:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb59b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911340:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c541d0e2/0x22c73c7857bb598f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911349:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c541d0e2/0x22c73c7857bb598f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.911351:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb59b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.911360:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb59b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911362:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783952135.911365:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb5996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.911367:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb59b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911372:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644dc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.911375:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb5996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.911376:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783952135.911382:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb5996 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911390:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb5996 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911398:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000326b5279/0x22c73c7857bb5996 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911419:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783952135.911423:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb599d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911429:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644de00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.911432:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb599d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911440:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb599d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911450:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb599d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911458:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d54fa3d/0x22c73c7857bb599d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911472:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783952135.911475:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb59a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911481:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.911484:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb59a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911499:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb59a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911508:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb59a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911515:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb59a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911528:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783952135.911531:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb59ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911537:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.911540:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb59ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911546:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb59ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911554:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb59ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.911561:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000457ce471/0x22c73c7857bb59ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.911979:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.911985:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb59b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.911993:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.911996:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.912000:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb59b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912008:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb59b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912015:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb59b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912029:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb59b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912040:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783952135.912081:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.912086:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb59c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912093:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.912096:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.912100:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb59c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912110:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb59c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912118:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb59c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912125:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb59c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912134:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783952135.912143:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783952135.912148:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb59b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912155:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.912158:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb59b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912165:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb59b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912176:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb59b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912183:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a53fd6/0x22c73c7857bb59b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912193:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783952135.912196:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb59b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912202:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.912206:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb59b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912235:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb59b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912245:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb59b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912253:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e9dadb/0x22c73c7857bb59b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912266:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952135.912269:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb59c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912276:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644cc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.912278:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb59c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.912281:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952135.912287:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb59c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912287:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb59c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912297:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb59c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912298:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.912301:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952135.912304:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb59c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912305:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb59c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912316:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb59c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.912323:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb59c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.912324:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952135.912326:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952135.912328:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952135.912330:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb59c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913105:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783952135.913153:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.913159:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb59ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913246:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.913250:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.913255:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb59ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913266:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb59ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913287:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb59ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913295:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb59ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913304:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783952135.913472:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952135.913484:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb59c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.913491:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ce00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.913495:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb59c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.913501:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb59c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.913514:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb59c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.913520:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8212e41/0x22c73c7857bb59c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.913533:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.913536:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb59ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.913551:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.913554:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb59ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.913561:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb59ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.913569:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb59ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.913745:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.913751:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000350a4faa/0x22c73c7857bb59d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913759:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.913762:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.913766:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000350a4faa/0x22c73c7857bb59d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913775:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000350a4faa/0x22c73c7857bb59d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913791:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000350a4faa/0x22c73c7857bb59d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913798:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000350a4faa/0x22c73c7857bb59d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.913814:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952135.913817:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783952135.913819:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952135.913822:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000350a4faa/0x22c73c7857bb59d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.913829:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2cc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.913832:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000350a4faa/0x22c73c7857bb59d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.913840:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000350a4faa/0x22c73c7857bb59d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.913851:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000350a4faa/0x22c73c7857bb59d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.913858:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000350a4faa/0x22c73c7857bb59d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.913870:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952135.913871:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952135.913873:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.913919:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb59ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.913933:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.913935:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.913937:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.913942:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.913948:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952135.913973:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.913979:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7f3502/0x22c73c7857bb59dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.913987:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.913989:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.913993:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7f3502/0x22c73c7857bb59dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914002:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7f3502/0x22c73c7857bb59dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914009:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7f3502/0x22c73c7857bb59dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914016:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7f3502/0x22c73c7857bb59dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914033:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783952135.914062:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1783952135.914064:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.914069:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb59e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914069:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5aa3966/0x22c73c7857bb59ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914077:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.914078:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.914081:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.914085:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb59e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914085:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.914089:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5aa3966/0x22c73c7857bb59ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.914095:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb59e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914097:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5aa3966/0x22c73c7857bb59ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.914103:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb59e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914105:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5aa3966/0x22c73c7857bb59ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.914111:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb59e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914113:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5aa3966/0x22c73c7857bb59ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.914123:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783952135.914217:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.914222:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb59f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.914235:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.914238:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.914242:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb59f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.914251:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb59f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.914259:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb59f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.914267:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb59f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914765:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1783952135.914820:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.914824:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb59f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914833:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.914835:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.914839:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb59f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914853:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb59f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914861:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb59f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.914872:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb59f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.915824:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1783952135.915906:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.915912:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb59ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.915922:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.915925:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.915929:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb59ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.915938:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb59ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.915944:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb59ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.915951:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb59ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.916779:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783952135.916963:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.916969:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb5a06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917283:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783952135.917291:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce7f3502/0x22c73c7857bb59dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917299:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2dc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.917304:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7f3502/0x22c73c7857bb59dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917326:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7f3502/0x22c73c7857bb59dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917342:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce7f3502/0x22c73c7857bb59dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917348:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7f3502/0x22c73c7857bb59dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917363:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783952135.917367:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb59e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917372:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.917375:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb59e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917381:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb59e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917389:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb59e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917396:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb59e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917423:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783952135.917426:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5aa3966/0x22c73c7857bb59ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917433:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2ce00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.917436:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5aa3966/0x22c73c7857bb59ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917443:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5aa3966/0x22c73c7857bb59ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917451:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5aa3966/0x22c73c7857bb59ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917459:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5aa3966/0x22c73c7857bb59ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917470:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783952135.917474:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb59f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917480:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.917483:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb59f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917500:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb59f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917510:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb59f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917518:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb59f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917531:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952135.917534:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb59f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917540:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2de00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.917543:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb59f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917550:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb59f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917559:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb59f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.917567:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb59f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.917854:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.917861:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.917867:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb5a06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.917879:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb5a06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.917943:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb5a06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.917951:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb5a06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.917961:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783952135.918045:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952135.918047:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb59ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.918052:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2ca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.918055:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb59ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.918063:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb59ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.918074:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb59ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.918082:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952135.918085:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb5a06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.918091:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.918094:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb5a06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.918100:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb5a06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.918119:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb5a06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.918125:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb5a06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.918138:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.918140:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.918142:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.918156:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952135.918659:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.918665:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb5a0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.918675:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.918677:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.918681:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb5a0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.918689:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb5a0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.918696:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb5a0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.918702:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb5a0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.918869:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783952135.918928:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.918933:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb5a14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.918942:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.918945:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.918948:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb5a14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.918957:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb5a14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.918965:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb5a14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.918972:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb5a14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.918985:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783952135.919020:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.919025:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb5a1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919033:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.919041:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.919046:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb5a1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919055:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb5a1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919063:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb5a1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919070:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb5a1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919078:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783952135.919120:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.919124:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb5a22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919132:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.919135:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.919138:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb5a22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919145:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb5a22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919152:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb5a22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919165:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb5a22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919173:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783952135.919212:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.919217:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb5a29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919227:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.919230:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.919234:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb5a29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919241:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb5a29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919248:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb5a29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919254:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb5a29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919262:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783952135.919297:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.919302:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb5a30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919315:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.919318:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.919321:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb5a30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919330:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb5a30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919337:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb5a30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919344:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb5a30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919353:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783952135.919391:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.919396:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb5a37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919403:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.919405:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.919408:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb5a37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919416:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb5a37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919435:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb5a37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919441:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb5a37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919450:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1783952135.919664:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.919669:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb5a3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919677:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.919680:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.919684:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb5a3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919691:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb5a3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919699:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb5a3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919771:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb5a3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919798:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1783952135.919836:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.919841:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb5a45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919850:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.919853:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.919861:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb5a45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919870:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb5a45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919878:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb5a45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.919885:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb5a45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.919950:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1783952135.919957:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb59ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952135.920039:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.920044:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b22d5e02/0x22c73c7857bb5a4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.920051:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.920054:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.920057:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b22d5e02/0x22c73c7857bb5a4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952135.920060:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1783952135.920066:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b22d5e02/0x22c73c7857bb5a4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.920073:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b22d5e02/0x22c73c7857bb5a4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.920080:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b22d5e02/0x22c73c7857bb5a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.920087:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:3.0:1783952135.920117:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447758208 00002000:00010000:0.0:1783952135.920121:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.920125:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5a53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952135.920126:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447758208 00010000:00010000:0.0:1783952135.920132:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.920134:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.920144:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5a53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.920151:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5a53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.920159:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5a53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952135.920171:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 233 00000100:00100000:3.0:1783952135.920182:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71063:x1870605447758208:12345-192.168.202.48@tcp:35:cp.0 00010000:00010000:2.0:1783952135.920258:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783952135.920266:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb5a0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920280:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.920284:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb5a0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920361:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb5a0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920377:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb5a0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783952135.920380:0:66241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 77309411445 00010000:00010000:2.0:1783952135.920384:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb5a0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952135.920477:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:71063:x1870605447758208:12345-192.168.202.48@tcp:35:cp.0 Request processed in 297us (421us total) trans 77309411446 rc 0/0 00010000:00010000:1.0:1783952135.920557:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:2.0:1783952135.920604:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783952135.920608:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb5a14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920615:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.920619:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb5a14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920626:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb5a14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920637:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb5a14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920650:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1537ff/0x22c73c7857bb5a14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920664:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783952135.920667:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb5a1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920674:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.920677:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb5a1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920684:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb5a1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952135.920692:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952135.920694:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb5a1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.920697:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb5a5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920706:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cd8c06a/0x22c73c7857bb5a1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920718:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783952135.920721:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb5a22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920727:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.920737:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb5a22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920744:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb5a22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920755:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb5a22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920762:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec42945d/0x22c73c7857bb5a22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952135.920803:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 233 00000020:00080000:3.0:1783952135.920809:0:66241:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783952135.920817:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783952135.920821:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb5a29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920828:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.920831:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb5a29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920838:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb5a29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920847:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb5a29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920854:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd6a2c4f/0x22c73c7857bb5a29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920870:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783952135.920874:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb5a30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920880:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.920883:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb5a30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920891:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb5a30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920901:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb5a30 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920907:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb5a30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920919:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783952135.920923:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb5a37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920929:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.920932:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb5a37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.920949:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:2.0:1783952135.920951:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb5a37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.920958:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952135.920961:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb5a37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.920963:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb5a5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920969:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047e67f76/0x22c73c7857bb5a37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.920974:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb5a5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920981:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783952135.920981:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb5a5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920984:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb5a3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.920990:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb5a5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.920991:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.920995:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb5a3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.920998:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783952135.921001:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb5a3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921010:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb5a3e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921017:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d2a4b4a/0x22c73c7857bb5a3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952135.921035:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952135.921037:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783952135.921039:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb5a61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921040:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b22d5e02/0x22c73c7857bb5a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921047:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:2.0:1783952135.921048:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2c800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952135.921050:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952135.921051:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b22d5e02/0x22c73c7857bb5a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921054:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb5a61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921060:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b22d5e02/0x22c73c7857bb5a4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921063:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb5a61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921070:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b22d5e02/0x22c73c7857bb5a4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921071:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb5a61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921077:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b22d5e02/0x22c73c7857bb5a4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921083:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb5a61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921090:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783952135.921091:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783952135.921093:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb5a45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921099:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.921103:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb5a45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921119:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb5a45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952135.921123:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.921127:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb5a68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921129:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb5a45 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921135:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:2.0:1783952135.921137:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021a2af24/0x22c73c7857bb5a45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921137:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.921142:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb5a68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921147:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783952135.921150:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb5a68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921151:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb5a5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921158:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952135.921159:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb5a68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.921161:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb5a5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921166:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb5a68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921174:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783952135.921209:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.921213:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb5a6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921227:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.921230:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.921234:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb5a6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921243:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb5a6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921251:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb5a6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921259:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb5a6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921260:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5a53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921268:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783952135.921268:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783952135.921303:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.921308:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb5a76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921316:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.921319:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.921323:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb5a76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921331:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb5a76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921349:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb5a76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921356:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb5a76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921364:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1783952135.921374:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.921379:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb5a7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921387:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=3850s v=(0 0) 00002000:00010000:1.0:1783952135.921396:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.921400:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb5a84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921407:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.921410:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.921413:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb5a84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921422:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb5a84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921430:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb5a84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921437:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb5a84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.921455:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1783952135.921463:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.921532:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb5a7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921544:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb5a7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921552:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb5a7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921569:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb5a7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921577:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1783952135.921633:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.921638:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041bbb063/0x22c73c7857bb5a8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921645:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.921648:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.921651:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041bbb063/0x22c73c7857bb5a8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921660:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041bbb063/0x22c73c7857bb5a8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921667:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041bbb063/0x22c73c7857bb5a8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921674:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041bbb063/0x22c73c7857bb5a8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921682:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1783952135.921716:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952135.921720:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4e7e2c5/0x22c73c7857bb5a92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921733:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:0.0:1783952135.921735:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952135.921739:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4e7e2c5/0x22c73c7857bb5a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921747:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4e7e2c5/0x22c73c7857bb5a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921754:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4e7e2c5/0x22c73c7857bb5a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921761:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4e7e2c5/0x22c73c7857bb5a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952135.921769:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00080000:0.0:1783952135.922023:0:26202:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1827 00000100:00100000:0.0:1783952135.922103:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:92511:x1870605465537536:12345-0@lo:5:osp-pre-0-0.0 Request processed in 44406us (45925us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.922111:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4944 00000100:00100000:0.0:1783952135.922161:0:92511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92511:1870605465537536:0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1783952135.922930:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb5a5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.922947:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb5a5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.922954:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009607f5fb/0x22c73c7857bb5a5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.922991:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783952135.922995:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb5a61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923002:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.923005:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb5a61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923013:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb5a61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923024:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb5a61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923030:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861d7bdc/0x22c73c7857bb5a61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923042:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783952135.923045:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb5a68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923050:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.923053:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb5a68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923070:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb5a68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923078:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb5a68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923085:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006457fe2/0x22c73c7857bb5a68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923096:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783952135.923099:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb5a6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923105:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.923108:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb5a6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923114:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb5a6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923122:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb5a6f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923128:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003800ce28/0x22c73c7857bb5a6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923148:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783952135.923152:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5a53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.923157:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2c000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.923160:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5a53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.924828:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783952135.924840:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb5a76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.924850:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.924854:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb5a76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.924877:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb5a76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.924973:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb5a76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.924982:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008626b8ff/0x22c73c7857bb5a76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925003:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783952135.925008:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb5a84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925014:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.925017:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb5a84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925024:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb5a84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925032:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb5a84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925038:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c20c9f0/0x22c73c7857bb5a84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925062:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783952135.925067:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb5a7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925073:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2da00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.925077:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb5a7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925084:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb5a7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925094:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb5a7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925101:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb5a7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925116:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952135.925120:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041bbb063/0x22c73c7857bb5a8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925126:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952135.925129:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041bbb063/0x22c73c7857bb5a8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925146:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041bbb063/0x22c73c7857bb5a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952135.925312:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.925320:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb5a99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.925332:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.925336:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.925342:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb5a99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.925354:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb5a99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.925363:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb5a99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.925371:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb5a99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925374:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5a53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.925382:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783952135.925385:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5a53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952135.925469:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952135.925474:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb5aa0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925568:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5a53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925585:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783952135.925602:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4e7e2c5/0x22c73c7857bb5a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925608:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.925611:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4e7e2c5/0x22c73c7857bb5a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925631:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4e7e2c5/0x22c73c7857bb5a92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925642:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4e7e2c5/0x22c73c7857bb5a92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925648:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4e7e2c5/0x22c73c7857bb5a92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925661:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952135.925664:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb5a99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925670:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.925673:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb5a99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925680:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb5a99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925689:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb5a99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925694:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098a657b6/0x22c73c7857bb5a99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.925717:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952135.925719:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952135.925721:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783952135.925827:0:92511:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x761:0x0] from OST, last_created [0x280000401:0x761:0x0]last_used is [0x280000401:0x723:0x0] 00010000:00010000:3.0:1783952135.925865:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041bbb063/0x22c73c7857bb5a8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952135.925872:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041bbb063/0x22c73c7857bb5a8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952135.925913:0:92511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92511:1870605465538176:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1783952135.925951:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.925953:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952135.925955:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952135.925973:0:92511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952135.925994:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6502:1870605465537920:192.168.202.48@tcp:105: 00000100:00100000:0.0:1783952135.925999:0:92511:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf780 going to sleep for 11 seconds 00010000:00010000:3.0:1783952135.926007:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952135.926019:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783952135.926030:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465538048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952135.926052:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1472bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2401:x1870605447757952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 20523us (20672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.926053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952135.926061:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2553 00000100:00100000:0.0:1783952135.926083:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465538048 00000100:00100000:0.0:1783952135.926088:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465538048 00000100:00100000:3.0:1783952135.926111:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465538176 00000100:00100000:3.0:1783952135.926114:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465538176 00000100:00100000:0.0:1783952135.926122:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:0.0:1783952135.926129:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465538048:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952135.926135:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4948 00000100:00100000:3.0:1783952135.926139:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:92511:x1870605465538176:12345-0@lo:5:osp-pre-0-0.0 00002000:00000024:0.0:1783952135.926148:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952135.926184:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465538048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952135.926190:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:0.0:1783952135.926221:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465538048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783952135.926285:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=3850s v=(0 0) 00010000:00010000:1.0:1783952135.926294:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952135.926300:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb5aa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.926310:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb5aa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.926318:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb5aa0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.926324:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb5aa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952135.926337:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783952135.926566:0:26198:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1890 00002000:00080000:1.0:1783952135.927103:0:26201:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1826 00000100:00100000:1.0:1783952135.927565:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:92513:x1870605465537664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 46439us (50008us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952135.927662:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4945 00010000:00010000:2.0:1783952135.927698:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952135.927707:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb5aa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.927717:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952135.927721:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb5aa0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.927730:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb5aa0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.927744:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb5aa0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.927752:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c46afef/0x22c73c7857bb5aa0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952135.927774:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952135.927776:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952135.927777:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952135.928841:0:92513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92513:1870605465537664:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783952135.928860:0:92513:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x761:0x0] from OST, last_created [0x2c0000401:0x761:0x0]last_used is [0x2c0000401:0x722:0x0] 00000100:00100000:1.0:1783952135.929001:0:92513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e77b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92513:1870605465538432:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783952135.929055:0:92513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.929078:0:92513:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1783952135.929611:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465538304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952135.929646:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952135.929683:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465538304 00000100:00100000:0.0:1783952135.929685:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465538432 00000100:00100000:1.0:1783952135.929690:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465538304 00000100:00100000:0.0:1783952135.929690:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465538432 00000100:00100000:0.0:1783952135.929725:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4949 00000100:00100000:1.0:1783952135.929731:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:0.0:1783952135.929733:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:92513:x1870605465538432:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783952135.929749:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465538304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952135.929765:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00002000:00080000:0.0:1783952135.929767:0:26196:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1890 00000100:00100000:1.0:1783952135.929812:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465538304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952135.929818:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00100000:0.0:1783952135.932110:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:92513:x1870605465538432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2372us (3050us total) trans 4294968956 rc 0/0 00000100:00100000:0.0:1783952135.932122:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4949 00010000:00010000:2.0:1783952135.932142:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952135.932151:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952135.932263:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465538304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952135.932301:0:92513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e77b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92513:1870605465538432:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783952135.932311:0:92513:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x761:0x0]-[0x2c0000401:0x781:0x0] 00000100:00100000:3.0:1783952135.932696:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:92511:x1870605465538176:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6553us (6720us total) trans 4294968955 rc 0/0 00000100:00100000:3.0:1783952135.932704:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4948 00000100:00100000:0.0:1783952135.932886:0:92511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92511:1870605465538176:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783952135.932896:0:92511:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x761:0x0]-[0x280000401:0x781:0x0] 00000020:00000004:2.0:1783952136.006309:0:92830:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783952136.006926:0:92830:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783952136.692423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952136.694080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952136.694119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952136.694155:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952136.694222:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447758720 00000100:00100000:3.0:1783952136.694231:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447758720 00000100:00100000:3.0:1783952136.694289:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2816 00000100:00100000:3.0:1783952136.694299:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447758720:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952136.694420:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447758464 00000100:00100000:3.0:1783952136.694421:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447758720:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 123us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952136.694424:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447758464 00000100:00100000:3.0:1783952136.694429:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2816 00000100:00100000:1.0:1783952136.694450:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447758592 00000100:00100000:1.0:1783952136.694453:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447758592 00000100:00100000:1.0:1783952136.694470:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1336 00000100:00100000:1.0:1783952136.694489:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447758464:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952136.694531:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447758464:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 43us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952136.694537:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1336 00000100:00100000:1.0:1783952136.694551:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1337 00000100:00100000:1.0:1783952136.694558:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:2398:x1870605447758592:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952136.694624:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:2398:x1870605447758592:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 66us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952136.694631:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1337 00000100:00100000:0.0:1783952136.697072:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447758336 00000100:00100000:0.0:1783952136.697085:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447758336 00000100:00100000:1.0:1783952136.698930:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 72 00000100:00100000:1.0:1783952136.698944:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+10:2399:x1870605447758336:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952136.699071:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+10:2399:x1870605447758336:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 129us (6656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952136.699079:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 72 00010000:00010000:3.0:1783952136.736715:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783952136.990325:0:92880:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783952136.991378:0:92880:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783952137.242229:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952137.242371:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447758848 00000100:00100000:2.0:1783952137.242380:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447758848 00000100:00100000:2.0:1783952137.242478:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1352 00000100:00100000:2.0:1783952137.242490:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71330:x1870605447758848:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:2.0:1783952137.242513:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952137.242534:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14400/0x22c73c7857bb5aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a40a expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783952137.242754:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1783952137.247117:0:83761:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4505us 00010000:00010000:2.0:1783952137.277126:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15200/0x22c73c7857bb5aae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.277150:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15200/0x22c73c7857bb5aae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.277164:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15200/0x22c73c7857bb5aae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.277182:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15c00/0x22c73c7857bb5ab5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.277189:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15c00/0x22c73c7857bb5ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.277196:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15c00/0x22c73c7857bb5ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952137.278036:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:83761:1870605465538560:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783952137.278108:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952137.278180:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a600 going to sleep for 11 seconds 00000100:00100000:3.0:1783952137.278221:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465538560 00000100:00100000:3.0:1783952137.278227:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465538560 00000100:00100000:3.0:1783952137.278372:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:3.0:1783952137.278383:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:83761:x1870605465538560:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952137.278482:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:83761:x1870605465538560:12345-0@lo:1000:mdt00_005.0 Request processed in 100us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952137.278490:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000100:00100000:1.0:1783952137.278572:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:83761:1870605465538560:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1783952137.278658:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71800/0x22c73c7857bb5abc lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278669:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71800/0x22c73c7857bb5abc lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278679:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71800/0x22c73c7857bb5abc lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952137.278713:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71800/0x22c73c7857bb5abc lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278725:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15200/0x22c73c7857bb5aae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278731:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15200/0x22c73c7857bb5aae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278737:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15200/0x22c73c7857bb5aae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278743:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952137.278747:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15200/0x22c73c7857bb5aae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278754:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15200/0x22c73c7857bb5aae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278765:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:1.0:1783952137.278768:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952137.278797:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15200/0x22c73c7857bb5aae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278814:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15200/0x22c73c7857bb5aae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278828:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15c00/0x22c73c7857bb5ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278834:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15c00/0x22c73c7857bb5ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278839:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15c00/0x22c73c7857bb5ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278843:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952137.278846:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15c00/0x22c73c7857bb5ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278852:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15c00/0x22c73c7857bb5ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278859:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff97b155c1af00) 00010000:00010000:1.0:1783952137.278861:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952137.278864:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15c00/0x22c73c7857bb5ab5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.278869:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15c00/0x22c73c7857bb5ab5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.279221:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14400/0x22c73c7857bb5aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a40a expref: 9 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.279248:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71800/0x22c73c7857bb5abc lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a40a expref: 8 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.279255:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b151509200) 00010000:00010000:1.0:1783952137.279257:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783952137.279260:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71800, rc 0) 00000100:00100000:1.0:1783952137.279389:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71330:x1870605447758848:12345-192.168.202.48@tcp:101:rm.0 Request processed in 36900us (37169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952137.279397:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1352 00000100:00100000:2.0:1783952137.282988:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952137.283244:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447758976 00000100:00100000:1.0:1783952137.283259:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447758976 00000100:00100000:1.0:1783952137.283376:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1353 00000100:00100000:1.0:1783952137.283387:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:71330:x1870605447758976:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:1.0:1783952137.283408:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952137.283547:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5ac3 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a411 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.283652:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71c00/0x22c73c7857bb5aca lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.283667:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71c00/0x22c73c7857bb5aca lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.283680:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71c00/0x22c73c7857bb5aca lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952137.283729:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1783952137.283746:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783952137.283798:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5ac3 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a411 expref: 14 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.283818:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71c00/0x22c73c7857bb5aca lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a411 expref: 13 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.283827:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44400) 00010000:00010000:1.0:1783952137.283830:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783952137.283833:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71c00, rc 0) 00000100:00100000:1.0:1783952137.284183:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:71330:x1870605447758976:12345-192.168.202.48@tcp:101:rm.0 Request processed in 797us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952137.284192:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1353 00000100:00080000:3.0:1783952137.284730:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952137.288823:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952137.290067:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447759232 00000100:00100000:1.0:1783952137.290080:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447759232 00000100:00100000:1.0:1783952137.290149:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1354 00000100:00100000:1.0:1783952137.290160:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:71330:x1870605447759232:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:1.0:1783952137.290184:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952137.290212:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5ad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a418 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952137.290320:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1783952137.290437:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5ad1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a418 expref: 15 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.290452:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b151509700) 00010000:00010000:1.0:1783952137.290455:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783952137.290475:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5ad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a418 expref: 15 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.290495:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70600, rc 0) 00000100:00100000:1.0:1783952137.290571:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:71330:x1870605447759232:12345-192.168.202.48@tcp:101:rm.0 Request processed in 412us (1758us total) trans 77309411447 rc 301/301 00000100:00100000:1.0:1783952137.290578:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1354 00000100:00100000:2.0:1783952137.305669:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952137.305761:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447759360 00000100:00100000:0.0:1783952137.305781:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447759360 00000100:00100000:0.0:1783952137.305839:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 234 00000100:00100000:0.0:1783952137.305850:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177063050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:71330:x1870605447759360:12345-192.168.202.48@tcp:37:rm.0 00000100:00100000:1.0:1783952137.315065:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177063050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:71330:x1870605447759360:12345-192.168.202.48@tcp:37:rm.0 Request processed in 9205us (9395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952137.315080:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 234 00000100:00100000:2.0:1783952137.320645:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952137.321020:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447759616 00000100:00100000:3.0:1783952137.321031:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447759616 00000100:00100000:3.0:1783952137.321086:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 235 00000100:00100000:3.0:1783952137.321097:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:71330:x1870605447759616:12345-192.168.202.48@tcp:35:rm.0 00000100:00100000:3.0:1783952137.321329:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:71330:x1870605447759616:12345-192.168.202.48@tcp:35:rm.0 Request processed in 232us (691us total) trans 77309411448 rc 0/0 00000100:00100000:3.0:1783952137.321337:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 235 00000100:00100000:2.0:1783952137.327687:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952137.327794:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447759872 00000100:00100000:0.0:1783952137.327804:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447759872 00000100:00100000:0.0:1783952137.327865:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1355 00000100:00100000:0.0:1783952137.327875:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:71330:x1870605447759872:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:0.0:1783952137.327911:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952137.327937:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d000/0x22c73c7857bb5adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a41f expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.328053:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ae6 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.328067:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ae6 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.328078:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ae6 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952137.328088:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:0.0:1783952137.328192:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d000/0x22c73c7857bb5adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a41f expref: 18 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.328227:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ae6 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a41f expref: 17 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.328236:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44400) 00010000:00010000:0.0:1783952137.328239:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783952137.328242:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2c200, rc 0) 00000100:00100000:0.0:1783952137.328979:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:71330:x1870605447759872:12345-192.168.202.48@tcp:101:rm.0 Request processed in 1102us (1299us total) trans 77309411449 rc 0/0 00000100:00100000:0.0:1783952137.328988:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1355 00000100:00100000:0.0:1783952137.334727:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952137.334902:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447760000 00000100:00100000:2.0:1783952137.334914:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447760000 00000100:00100000:2.0:1783952137.334977:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1356 00000100:00100000:2.0:1783952137.334988:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:71330:x1870605447760000:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:2.0:1783952137.335013:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952137.335031:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15000/0x22c73c7857bb5af4 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a426 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.335095:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15800/0x22c73c7857bb5afb lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.335109:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15800/0x22c73c7857bb5afb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.335119:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15800/0x22c73c7857bb5afb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952137.335157:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00000004:00200000:2.0:1783952137.335160:0:66237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783952137.335180:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15800/0x22c73c7857bb5afb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.335224:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15000/0x22c73c7857bb5af4 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a426 expref: 19 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.335244:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15800/0x22c73c7857bb5afb lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a426 expref: 18 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.335253:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:2.0:1783952137.335256:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783952137.335259:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a15800, rc 0) 00000100:00100000:2.0:1783952137.335503:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+18:71330:x1870605447760000:12345-192.168.202.48@tcp:101:rm.0 Request processed in 515us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952137.335510:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1356 00000100:00100000:0.0:1783952137.349142:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952137.349233:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447760256 00000100:00100000:1.0:1783952137.349244:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447760256 00000100:00100000:1.0:1783952137.349309:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1357 00000100:00100000:1.0:1783952137.349320:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+18:71330:x1870605447760256:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:1.0:1783952137.349342:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952137.349362:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b02 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a42d expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952137.349460:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1783952137.349574:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b02 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a42d expref: 20 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.349620:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44400) 00010000:00010000:1.0:1783952137.349624:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783952137.349629:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b02 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a42d expref: 20 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.349643:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70600, rc 0) 00000100:00100000:1.0:1783952137.349707:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:71330:x1870605447760256:12345-192.168.202.48@tcp:101:rm.0 Request processed in 388us (574us total) trans 77309411450 rc 301/301 00000100:00100000:1.0:1783952137.349715:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1357 00000100:00100000:2.0:1783952137.360988:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952137.362068:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447760384 00000100:00100000:1.0:1783952137.362081:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447760384 00000100:00100000:1.0:1783952137.362141:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 236 00000100:00100000:1.0:1783952137.362151:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:71330:x1870605447760384:12345-192.168.202.48@tcp:37:rm.0 00000100:00100000:1.0:1783952137.368946:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:71330:x1870605447760384:12345-192.168.202.48@tcp:37:rm.0 Request processed in 6786us (7956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952137.368959:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 236 00000100:00100000:0.0:1783952137.373676:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952137.373824:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447760640 00000100:00100000:2.0:1783952137.373834:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447760640 00000100:00100000:2.0:1783952137.373900:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 237 00000100:00100000:2.0:1783952137.373911:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:71330:x1870605447760640:12345-192.168.202.48@tcp:35:rm.0 00000100:00100000:2.0:1783952137.374135:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+20:71330:x1870605447760640:12345-192.168.202.48@tcp:35:rm.0 Request processed in 225us (466us total) trans 77309411451 rc 0/0 00000100:00100000:2.0:1783952137.374143:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 237 00000100:00100000:2.0:1783952137.380236:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952137.380404:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447760896 00000100:00100000:0.0:1783952137.380413:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447760896 00000100:00100000:0.0:1783952137.380790:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1358 00000100:00100000:0.0:1783952137.380801:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+20:71330:x1870605447760896:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:0.0:1783952137.380827:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952137.380849:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c400/0x22c73c7857bb5b10 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a434 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.381196:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c600/0x22c73c7857bb5b17 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.381211:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c600/0x22c73c7857bb5b17 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.381223:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c600/0x22c73c7857bb5b17 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952137.381248:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00010000:00010000:0.0:1783952137.381502:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c400/0x22c73c7857bb5b10 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a434 expref: 23 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.381532:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c600/0x22c73c7857bb5b17 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a434 expref: 22 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.381541:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:0.0:1783952137.381543:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783952137.381546:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2c600, rc 0) 00000100:00100000:0.0:1783952137.381868:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:71330:x1870605447760896:12345-192.168.202.48@tcp:101:rm.0 Request processed in 1067us (1639us total) trans 77309411452 rc 0/0 00000100:00100000:0.0:1783952137.381876:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1358 00000100:00100000:2.0:1783952137.389354:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952137.395374:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447761024 00000100:00100000:1.0:1783952137.395391:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447761024 00000100:00100000:1.0:1783952137.395576:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1359 00000100:00100000:1.0:1783952137.395603:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71330:x1870605447761024:12345-192.168.202.48@tcp:41:rm.0 00000004:00000024:1.0:1783952137.395660:0:66238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382962176 00000100:00100000:1.0:1783952137.395746:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71330:x1870605447761024:12345-192.168.202.48@tcp:41:rm.0 Request processed in 159us (6481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952137.395754:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1359 00000100:00100000:2.0:1783952137.406634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952137.406777:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447761280 00000100:00100000:1.0:1783952137.406788:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447761280 00000100:00100000:1.0:1783952137.406860:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1360 00000100:00100000:1.0:1783952137.406871:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:71330:x1870605447761280:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:1.0:1783952137.407038:0:67035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783952137.407066:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b000/0x22c73c7857bb58c4 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3f5 expref: 22 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.407104:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff97b155d9df00) 00010000:00010000:1.0:1783952137.407121:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15800/0x22c73c7857bb5afb lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a426 expref: 21 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.407130:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:1.0:1783952137.407133:0:67035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952137.407153:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.407165:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.407174:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.407185:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.407192:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.407198:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.408525:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b33 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.408542:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b33 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.408568:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b33 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783952137.408822:0:67035:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x48:0x0].2, 64 off8320 00000004:00080000:1.0:1783952137.408831:0:67035:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3852351242902ns, next at 3853351241023ns, rc = 0 00010000:00010000:1.0:1783952137.408874:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409552:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409567:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409575:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409581:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409615:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409643:0:67035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952137.409668:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b33 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409675:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b33 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409681:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b33 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409696:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952137.409701:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b33 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409708:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b33 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409720:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff97b151509700) 00010000:00010000:1.0:1783952137.409722:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783952137.409727:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b33 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409732:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b33 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409754:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409760:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409764:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409783:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409788:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952137.409791:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409807:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409815:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:1.0:1783952137.409818:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952137.409832:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409839:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b25 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952137.409850:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036cd7b64 reply state 000000000839b05e transno 77309411453 ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409861:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.409867:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xb1bed465 (ffff97b176ee0400) 00010000:00010000:1.0:1783952137.409870:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952137.409873:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783952137.410315:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952137.410322:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.410338:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952137.410341:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.410347:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.410355:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff97b151509700) 00010000:00010000:2.0:1783952137.410357:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783952137.410360:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 1/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.410366:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70c00/0x22c73c7857bb5b3a lrc: 0/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.410384:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952137.410386:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952137.410388:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952137.410436:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:71330:x1870605447761280:12345-192.168.202.48@tcp:36:rm.0 Request processed in 3562us (3805us total) trans 77309411453 rc 0/0 00000100:00100000:1.0:1783952137.410446:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1360 00000100:00100000:3.0:1783952137.419738:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952137.422102:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447761536 00000100:00100000:1.0:1783952137.422118:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447761536 00000100:00100000:0.0:1783952137.422288:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 238 00000100:00100000:0.0:1783952137.422299:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:71330:x1870605447761536:12345-192.168.202.48@tcp:35:rm.0 00000100:00100000:0.0:1783952137.422558:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:71330:x1870605447761536:12345-192.168.202.48@tcp:35:rm.0 Request processed in 260us (2829us total) trans 77309411454 rc 0/0 00000100:00100000:0.0:1783952137.422566:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 238 00000100:00100000:3.0:1783952137.426629:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952137.426704:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447761792 00000100:00100000:1.0:1783952137.426714:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447761792 00000100:00100000:1.0:1783952137.426763:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1361 00000100:00100000:1.0:1783952137.426782:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:71330:x1870605447761792:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:1.0:1783952137.426857:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783952137.426894:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c600/0x22c73c7857bb5b17 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a434 expref: 23 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.426927:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216b400/0x22c73c7857bb562b lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3c4 expref: 22 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.426940:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b146f44a00) 00010000:00010000:1.0:1783952137.426956:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71c00/0x22c73c7857bb5aca lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a411 expref: 21 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.426965:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44400) 00010000:00010000:1.0:1783952137.426968:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952137.426988:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b41 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427000:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b41 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427009:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b41 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427023:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427030:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427036:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427126:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70000/0x22c73c7857bb5b4f lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427134:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70000/0x22c73c7857bb5b4f lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427140:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70000/0x22c73c7857bb5b4f lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952137.427357:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1783952137.427384:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70000/0x22c73c7857bb5b4f lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427392:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70000/0x22c73c7857bb5b4f lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427398:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70000/0x22c73c7857bb5b4f lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.427404:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952137.427408:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70000/0x22c73c7857bb5b4f lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428203:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70000/0x22c73c7857bb5b4f lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428216:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff97b151509d00) 00010000:00010000:1.0:1783952137.428219:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783952137.428224:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70000/0x22c73c7857bb5b4f lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428244:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70000/0x22c73c7857bb5b4f lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428266:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b41 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428272:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b41 lrc: 2/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428277:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b41 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428282:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952137.428285:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b41 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428291:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b41 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428299:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44400) 00010000:00010000:1.0:1783952137.428301:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952137.428304:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b41 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428309:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70600/0x22c73c7857bb5b41 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952137.428319:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2a075cc reply state 00000000df5edecc transno 77309411455 ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428330:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.428342:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xf7117594 (ffff97b151509a00) 00010000:00010000:1.0:1783952137.428345:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952137.428347:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952137.429139:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:71330:x1870605447761792:12345-192.168.202.48@tcp:36:rm.0 Request processed in 2360us (2554us total) trans 77309411455 rc 0/0 00000100:00100000:2.0:1783952137.429344:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1361 00000100:00100000:2.0:1783952137.443652:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952137.444187:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447762176 00000100:00100000:3.0:1783952137.444198:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447762176 00000100:00100000:3.0:1783952137.444246:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 239 00000100:00100000:3.0:1783952137.444256:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:71330:x1870605447762176:12345-192.168.202.48@tcp:35:rm.0 00000100:00100000:3.0:1783952137.444502:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:71330:x1870605447762176:12345-192.168.202.48@tcp:35:rm.0 Request processed in 244us (856us total) trans 77309411456 rc 0/0 00000100:00100000:3.0:1783952137.444510:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 239 00000100:00100000:3.0:1783952137.446116:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952137.447092:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447761920 00000100:00100000:2.0:1783952137.447103:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447761920 00000100:00100000:2.0:1783952137.447170:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 721 00000100:00100000:2.0:1783952137.447180:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2398:x1870605447761920:12345-192.168.202.48@tcp:103:rm.0 00010000:00010000:2.0:1783952137.447198:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952137.447225:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71800/0x22c73c7857bb5abc lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a40a expref: 8 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.447258:0:22092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b151509200) 00010000:00010000:2.0:1783952137.447271:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952137.447329:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447761920:12345-192.168.202.48@tcp:103:rm.0 Request processed in 151us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952137.447337:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 721 00000100:00100000:2.0:1783952137.458575:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952137.459334:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447762432 00000100:00100000:1.0:1783952137.459346:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447762432 00000100:00100000:1.0:1783952137.459419:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1362 00000100:00100000:1.0:1783952137.459429:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:71330:x1870605447762432:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:1.0:1783952137.459501:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783952137.459527:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ae6 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a41f expref: 23 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.459550:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216a600/0x22c73c7857bb560f lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3bd expref: 22 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.459561:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b146f44400) 00010000:00010000:1.0:1783952137.459571:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952137.460015:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.460025:0:66237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.460035:0:66237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952137.460057:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465538688:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1783952137.460114:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952137.460158:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3840 going to sleep for 11 seconds 00000100:00100000:3.0:1783952137.460500:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465538688 00000100:00100000:3.0:1783952137.460506:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465538688 00000100:00100000:3.0:1783952137.460552:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:3.0:1783952137.460560:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66237:x1870605465538688:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1783952137.460573:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952137.460618:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb5b5d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5b56 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.460643:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb589a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 6 pid: 92525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.460653:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb5b5d lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5b56 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.460678:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb589a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 6 pid: 92525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.460690:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb589a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 6 pid: 92525 timeout: 3952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952137.460709:0:8444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8444:1870605465538816:192.168.202.48@tcp:104: 00000100:00100000:3.0:1783952137.460824:0:8444:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee79540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952137.469725:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952137.469824:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447762560 00000100:00100000:1.0:1783952137.469835:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447762560 00010000:00010000:1.0:1783952137.469889:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb589a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 7 pid: 92525 timeout: 3952 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952137.469927:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2554 00000100:00100000:1.0:1783952137.469936:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447762560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783952137.469937:0:8444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8444:1870605465538816:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783952137.469955:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952137.469961:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb589a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 7 pid: 92525 timeout: 3952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.469967:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb5b5d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5b56 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.469972:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb589a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 7 pid: 92525 timeout: 3952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.470076:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952137.470080:0:8444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952137.470085:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb5b5d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5b56 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.470095:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216ba00, rc 0) 00010000:00010000:1.0:1783952137.470112:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb589a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3af expref: 7 pid: 92525 timeout: 3952 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.470125:0:7927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:1.0:1783952137.470129:0:7927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb5b5d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5b56 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.470138:0:7927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb5b5d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22c73c7857bb5b56 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.470148:0:7927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb5b5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22c73c7857bb5b56 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952137.470181:0:7927:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb5b5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5b56 expref: 9 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952137.470209:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66237:x1870605465538688:12345-0@lo:101:mdt00_001.0 Request processed in 9649us (10093us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952137.470212:0:7927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7927:1870605465538944:0@lo:105: 00000100:00100000:3.0:1783952137.470215:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:1.0:1783952137.470250:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952137.470287:0:7927:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952137.470338:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465538944 00000100:00100000:0.0:1783952137.470343:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465538944 00000100:00100000:0.0:1783952137.470378:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1783952137.470385:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7927:x1870605465538944:12345-0@lo:105: 00010000:00010000:0.0:1783952137.470395:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.470416:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.470425:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.470433:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.470440:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.470449:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.470463:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff97b04db70600) 00000100:00100000:0.0:1783952137.470513:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7927:x1870605465538944:12345-0@lo:105: Request processed in 129us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952137.470520:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1783952137.470922:0:7927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7927:1870605465538944:0@lo:105: 00010000:00010000:1.0:1783952137.470935:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952137.470978:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2400:x1870605447762560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1042us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952137.470985:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2554 00000100:00100000:2.0:1783952137.471162:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465538688:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1783952137.471179:0:66237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952137.471199:0:66237:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1783952137.471236:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.471244:0:66237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.471252:0:66237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952137.471268:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465539072:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1783952137.471304:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952137.471330:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952137.471482:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465539072 00000100:00100000:0.0:1783952137.471488:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465539072 00000100:00100000:0.0:1783952137.471525:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:0.0:1783952137.471532:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66237:x1870605465539072:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1783952137.471549:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952137.471565:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c400/0x22c73c7857bb5b6b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5b64 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.471619:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c400/0x22c73c7857bb5b6b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5b64 expref: 10 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.471633:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c400/0x22c73c7857bb5b6b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5b64 expref: 10 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.471640:0:8445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff97b048b52d00) 00010000:00010000:0.0:1783952137.471643:0:8445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952137.471645:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2c400, rc 0) 00000100:00100000:0.0:1783952137.471683:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66237:x1870605465539072:12345-0@lo:101:mdt00_001.0 Request processed in 152us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952137.471689:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:2.0:1783952137.472072:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465539072:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1783952137.472085:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5b6b expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.472101:0:66237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5b6b expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952137.472114:0:66237:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1783952137.472149:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465539200:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952137.472178:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952137.472242:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04905a000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952137.477520:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465539200 00000100:00100000:3.0:1783952137.477535:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465539200 00000100:00100000:2.0:1783952137.477840:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:2.0:1783952137.477851:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66237:x1870605465539200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952137.478007:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66237:x1870605465539200:12345-0@lo:1000:mdt00_001.0 Request processed in 157us (5826us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952137.478015:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:0.0:1783952137.478170:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465539200:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783952137.478241:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465539328:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783952137.478278:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952137.478307:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952137.478423:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465539328 00000100:00100000:2.0:1783952137.478429:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465539328 00000100:00100000:2.0:1783952137.478464:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:2.0:1783952137.478479:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66237:x1870605465539328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952137.478555:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66237:x1870605465539328:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (276us total) trans 0 rc 1/1 00000100:00100000:2.0:1783952137.478562:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:0.0:1783952137.478699:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465539328:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1783952137.478752:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.478762:0:66237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952137.478781:0:66237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952137.478794:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465539456:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1783952137.478832:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952137.478854:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952137.479022:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465539456 00000100:00100000:3.0:1783952137.479027:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465539456 00000100:00100000:3.0:1783952137.479051:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:3.0:1783952137.479058:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66237:x1870605465539456:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1783952137.479069:0:8444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952137.479091:0:8444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb5b79 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5b72 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.479114:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb5b79 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5b72 expref: 11 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.479135:0:8444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb5b79 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5b72 expref: 11 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.479144:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b155d9d700) 00010000:00010000:3.0:1783952137.479147:0:8444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783952137.479150:0:8444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216be00, rc 0) 00000100:00100000:3.0:1783952137.479184:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465539456:12345-0@lo:101:mdt00_001.0 Request processed in 126us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952137.479190:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:3.0:1783952137.479217:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465539456:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1783952137.479228:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.479238:0:66237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.479262:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5b80 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.479270:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5b80 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.479277:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5b80 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783952137.479748:0:66237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].4, 432 off38504 00000040:00080000:3.0:1783952137.479808:0:66237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x6:0x0].3, 512 off36784 00000004:00080000:3.0:1783952137.479815:0:66237:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97b14ee79540 with version 14 00000004:00080000:0.0:1783952137.480039:0:75700:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97b1748af6c0 version 14 rpc_version 14 00000020:00100000:0.0:1783952137.480063:0:75700:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783952137.480069:0:75700:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97b049ee0700 x1870605465539712/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952137.480083:0:75700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465539712:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783952137.480111:0:75700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952137.480130:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952137.480168:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465539712 00000100:00100000:3.0:1783952137.480173:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465539712 00000100:00100000:3.0:1783952137.480262:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:3.0:1783952137.480267:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75700:x1870605465539712:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783952137.486465:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75700:x1870605465539712:12345-0@lo:1000:osp_up0-1.0 Request processed in 6188us (6342us total) trans 120259084290 rc 0/0 00000100:00100000:1.0:1783952137.486489:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:0.0:1783952137.486724:0:75700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465539712:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1783952137.486786:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xc:0x0]: returning size 4096 00010000:00010000:3.0:1783952137.486808:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5b80 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486816:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5b80 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486824:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5b80 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486830:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ae00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952137.486836:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5b80 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486844:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5b80 lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486859:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b155d9d300) 00010000:00010000:3.0:1783952137.486862:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952137.486875:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5b80 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486881:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b18216ae00/0x22c73c7857bb5b80 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486904:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486930:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486937:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486964:0:66237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783952137.486978:0:66237:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783952137.486985:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486992:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.486998:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.487018:0:66237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1783952137.487023:0:66237:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783952137.487029:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5b6b expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952137.487035:0:66237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5b6b expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487152:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783952137.487159:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487166:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2ca00 already unused, calling callback (ffffffffc19c9ed0) 00010000:00010000:2.0:1783952137.487170:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952137.487185:0:7459:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487214:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487218:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952137.487233:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 1/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487237:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2ca00/0x22c73c7857bb5b72 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5b79 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487248:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952137.487250:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487253:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70600 already unused, calling callback (ffffffffc19c9ed0) 00010000:00010000:2.0:1783952137.487256:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952137.487260:0:7459:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487269:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487273:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952137.487281:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487285:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70600/0x22c73c7857bb5b56 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5b5d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487290:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952137.487291:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952137.487293:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952137.487303:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465539968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952137.487333:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952137.487354:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783952137.487358:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465539840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952137.487369:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952137.487399:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465539968 00000100:00100000:2.0:1783952137.487406:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465539968 00000100:00100000:2.0:1783952137.487443:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465539840 00000100:00100000:2.0:1783952137.487446:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465539840 00000100:00100000:2.0:1783952137.487479:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1783952137.487487:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3643:x1870605465539968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952137.487500:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952137.487517:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216ba00/0x22c73c7857bb5b5d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5b56 expref: 13 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487528:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:2.0:1783952137.487531:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952137.487558:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3643:x1870605465539968:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952137.487563:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1783952137.487579:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1783952137.487583:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3643:x1870605465539840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952137.487611:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952137.487620:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216be00/0x22c73c7857bb5b79 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5b72 expref: 11 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952137.487627:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0x0 (ffff97b155d9d700) 00010000:00010000:2.0:1783952137.487632:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952137.487647:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3643:x1870605465539840:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952137.487651:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1783952137.487671:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465539840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952137.487676:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465539968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952137.487844:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:71330:x1870605447762432:12345-192.168.202.48@tcp:36:rm.0 Request processed in 28414us (29275us total) trans 77309411457 rc 0/0 00000100:00100000:3.0:1783952137.487861:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1362 00010000:00010000:0.0:1783952137.487950:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952137.761045:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952137.824848:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465540096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952137.824934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952137.824994:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465540096 00000100:00100000:1.0:1783952137.825002:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465540096 00000100:00100000:1.0:1783952137.825079:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:1.0:1783952137.825089:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465540096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952137.825120:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952137.825164:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465540096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952137.825171:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00100000:1.0:1783952137.825219:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465540096:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783952137.825319:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952137.826650:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465540224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952137.826703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952137.827646:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465540224 00000100:00100000:2.0:1783952137.827656:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465540224 00000100:00080000:0.0:1783952137.827720:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952137.827726:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:2.0:1783952137.827736:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465540224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783952137.827777:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952137.827848:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465540224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952137.827855:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00100000:0.0:1783952137.828259:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465540224:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783952138.794730:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952139.809274:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952140.834669:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952140.898033:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465540352:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898202:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898251:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465540864:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898282:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898303:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465541376:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898324:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898340:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465541888:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898365:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898402:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783952140.898408:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465540480:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898429:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898443:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465540992:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898465:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898480:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465541504:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898497:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898525:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465540608:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898545:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898560:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465541120:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898616:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465541632:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898639:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898654:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783952140.898658:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465540736:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898694:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465541248:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898711:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898723:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465541760:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898753:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.898803:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465540352 00000100:00100000:0.0:1783952140.898812:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465540352 00000100:00100000:0.0:1783952140.898865:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783952140.898873:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465540352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.898929:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465540352:12345-0@lo:400:kworker.0 Request processed in 56us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.898944:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783952140.898983:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465540864 00000100:00100000:0.0:1783952140.898986:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465540864 00000100:00100000:0.0:1783952140.899017:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465541376 00000100:00100000:0.0:1783952140.899019:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465541376 00000100:00100000:0.0:1783952140.899029:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465541888 00000100:00100000:0.0:1783952140.899030:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465541888 00000100:00100000:0.0:1783952140.899038:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465540480 00000100:00100000:0.0:1783952140.899040:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465540480 00000100:00100000:0.0:1783952140.899049:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465540608 00000100:00100000:0.0:1783952140.899051:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465540608 00000100:00100000:0.0:1783952140.899059:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465540736 00000100:00100000:0.0:1783952140.899061:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465540736 00000100:00100000:0.0:1783952140.899071:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1783952140.899076:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465540864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899106:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465540864:12345-0@lo:400:kworker.0 Request processed in 30us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899111:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1783952140.899121:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1783952140.899125:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465541376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899146:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465541376:12345-0@lo:400:kworker.0 Request processed in 21us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899150:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1783952140.899158:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1783952140.899162:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465541888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899183:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465541888:12345-0@lo:400:kworker.0 Request processed in 21us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899188:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1783952140.899205:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1783952140.899210:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465540480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899238:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465540480:12345-0@lo:400:kworker.0 Request processed in 28us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899244:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1783952140.899254:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1783952140.899259:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465540608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899285:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465540608:12345-0@lo:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899290:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1783952140.899299:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1783952140.899304:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465540736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899329:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465540736:12345-0@lo:400:kworker.0 Request processed in 25us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899334:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1783952140.899365:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465540992 00000100:00100000:0.0:1783952140.899368:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465540992 00000100:00100000:0.0:1783952140.899393:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465541504 00000100:00100000:0.0:1783952140.899396:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465541504 00000100:00100000:0.0:1783952140.899412:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1783952140.899417:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3642:x1870605465540992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899452:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3642:x1870605465540992:12345-0@lo:400:kworker.0 Request processed in 34us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899457:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1783952140.899467:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:0.0:1783952140.899472:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465541504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899505:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465541504:12345-0@lo:400:kworker.0 Request processed in 32us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899511:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00100000:0.0:1783952140.899539:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465541120 00000100:00100000:0.0:1783952140.899542:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465541120 00000100:00100000:0.0:1783952140.899568:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465541632 00000100:00100000:0.0:1783952140.899570:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465541632 00000100:00100000:0.0:1783952140.899585:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465541248 00000100:00100000:0.0:1783952140.899611:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465541248 00000100:00100000:0.0:1783952140.899631:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465541760 00000100:00100000:0.0:1783952140.899633:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465541760 00000100:00100000:0.0:1783952140.899646:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:0.0:1783952140.899651:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465541120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899679:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465541120:12345-0@lo:400:kworker.0 Request processed in 27us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899684:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00100000:0.0:1783952140.899694:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1783952140.899699:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465541632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899722:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465541632:12345-0@lo:400:kworker.0 Request processed in 23us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899727:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1783952140.899750:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1783952140.899756:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465541248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899781:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465541248:12345-0@lo:400:kworker.0 Request processed in 26us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899787:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1783952140.899797:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:0.0:1783952140.899809:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465541760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899834:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465541760:12345-0@lo:400:kworker.0 Request processed in 26us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952140.899838:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000100:00080000:0.0:1783952140.899874:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952140.899878:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952140.899881:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952140.899883:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952140.899927:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465540736:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899937:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465541248:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899947:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465541760:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899958:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465540608:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899966:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465541120:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.899975:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465541632:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.900019:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465540480:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.900030:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465540992:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.900041:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465541504:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.900050:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465540352:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.900061:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465540864:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.900071:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465541376:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.900084:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465541888:0@lo:400:kworker.0 00000100:00100000:0.0:1783952140.906902:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783952140.906939:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465542144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952140.907035:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952140.909040:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465542016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952140.909121:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952140.918038:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465542144 00000100:00100000:3.0:1783952140.918061:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465542144 00000100:00100000:3.0:1783952140.918135:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465542016 00000100:00100000:3.0:1783952140.918139:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465542016 00000100:00100000:3.0:1783952140.918170:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:3.0:1783952140.918182:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465542144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952140.918239:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783952140.918347:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465542144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (11311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952140.918355:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00100000:3.0:1783952140.918376:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:3.0:1783952140.918383:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3643:x1870605465542016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783952140.918402:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1783952140.918442:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3643:x1870605465542016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (9321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952140.918448:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:3.0:1783952140.918515:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465542144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952140.918632:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465542016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952141.408952:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952141.408974:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465542272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952141.409039:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952141.409088:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465542272 00000100:00100000:0.0:1783952141.409095:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465542272 00000100:00100000:0.0:1783952141.409142:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201 00000100:00100000:0.0:1783952141.409151:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465542272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783952141.409181:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952141.409222:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465542272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952141.409229:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201 00000100:00100000:0.0:1783952141.409271:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465542272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952141.409567:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952141.409578:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465542400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952141.409638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952141.409695:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465542400 00000100:00100000:1.0:1783952141.409700:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465542400 00000100:00100000:1.0:1783952141.409756:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202 00000100:00100000:1.0:1783952141.409763:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465542400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783952141.409780:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952141.409816:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465542400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952141.409823:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202 00000100:00100000:1.0:1783952141.409859:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465542400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952141.805115:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952141.805176:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952141.805216:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952141.805286:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952141.805295:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447762688 00000100:00100000:0.0:1783952141.805310:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447762688 00000100:00100000:3.0:1783952141.805414:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447762944 00000100:00100000:3.0:1783952141.805425:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447762944 00000100:00100000:3.0:1783952141.805519:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447762816 00000100:00100000:3.0:1783952141.805523:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447762816 00000100:00100000:3.0:1783952141.805553:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1344 00000100:00100000:3.0:1783952141.805565:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:2398:x1870605447762944:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952141.805744:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:2398:x1870605447762944:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 180us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952141.805754:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1344 00000100:00100000:0.0:1783952141.805766:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00100000:0.0:1783952141.805783:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447762688:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952141.805790:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1345 00000100:00100000:3.0:1783952141.805806:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2398:x1870605447762816:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952141.805850:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2398:x1870605447762816:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 46us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952141.805857:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1345 00000100:00100000:3.0:1783952141.805883:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447763072 00000100:00100000:3.0:1783952141.805887:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447763072 00000100:00100000:3.0:1783952141.805923:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2821 00000100:00100000:3.0:1783952141.805930:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447763072:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952141.805966:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447763072:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 38us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952141.805972:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2821 00000100:00100000:0.0:1783952141.806002:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447762688:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 221us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952141.806011:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 74 00000100:00080000:3.0:1783952141.806184:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952141.806194:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783952141.806198:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783952141.860142:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783952141.927959:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968956 is committed 00010000:00010000:1.0:1783952141.930030:0:75694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5b6b expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952141.930049:0:75694:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5b6b expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952141.930096:0:75694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5b6b expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952141.930104:0:75694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952141.930140:0:75694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b175a15a00/0x22c73c7857bb5b64 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5b6b expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783952141.930162:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411457 is committed 00000004:00080000:1.0:1783952141.930179:0:75694:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00010000:00010000:0.0:1783952141.930353:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930376:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930384:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930390:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ae00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952141.930394:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930402:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930414:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xb1bed465 (ffff97b176ee0400) 00010000:00010000:0.0:1783952141.930417:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952141.930422:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930439:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ae00/0x22c73c7857bb58bd lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930458:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930464:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930470:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930476:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952141.930486:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930492:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930500:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xb1bed465 (ffff97b176ee0400) 00010000:00010000:0.0:1783952141.930503:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952141.930506:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930511:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70800/0x22c73c7857bb5b2c lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930526:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930533:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930539:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930543:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952141.930546:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930551:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930557:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xc:0x0].0xf7117594 (ffff97b151509a00) 00010000:00010000:0.0:1783952141.930560:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952141.930567:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930572:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71a00/0x22c73c7857bb5b48 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xc:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952141.930636:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465542656:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1783952141.930699:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952141.930756:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465542656 00000100:00100000:0.0:1783952141.930762:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465542656 00000100:00100000:0.0:1783952141.930802:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4950 00000100:00100000:0.0:1783952141.930809:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465542656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1783952141.930832:0:26200:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:546 count 1 00010000:00010000:0.0:1783952141.930854:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930873:0:26200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 6 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930882:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x222:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1783952141.930886:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783952141.930891:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930916:0:26200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 6 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.930928:0:26200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 6 pid: 26200 timeout: 3956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952141.930946:0:26200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26200:1870605465542784:192.168.202.48@tcp:104: 00000100:00100000:0.0:1783952141.930999:0:26200:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1533bc480 going to sleep for 11 seconds 00000001:00080000:1.0:1783952141.931332:0:92492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00000100:00100000:2.0:1783952141.931386:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952141.931398:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465542528:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1783952141.931439:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952141.932710:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465542528 00000100:00100000:0.0:1783952141.932720:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465542528 00000100:00100000:0.0:1783952141.932776:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1783952141.932784:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3642:x1870605465542528:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1783952141.932798:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952141.932819:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c400/0x22c73c7857bb5b6b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5b64 expref: 8 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.932836:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff97b048b52d00) 00010000:00010000:0.0:1783952141.932844:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952141.932888:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465542528:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 105us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952141.932894:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1783952141.933021:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465542528:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:0.0:1783952141.933521:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968955 is committed 00000001:00100000:0.0:1783952141.933562:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000100:00100000:3.0:1783952141.943515:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952141.943787:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447763200 00000100:00100000:2.0:1783952141.943795:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447763200 00010000:00010000:2.0:1783952141.943833:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 6 pid: 26200 timeout: 3956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952141.943890:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2555 00000100:00100000:2.0:1783952141.943900:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2401:x1870605447763200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783952141.943917:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952141.943922:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 6 pid: 26200 timeout: 3956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952141.943935:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 6 pid: 26200 timeout: 3956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952141.943960:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f818895/0x22c73c7857bb58e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a403 expref: 6 pid: 26200 timeout: 3956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952141.943975:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783952141.943980:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783952141.943986:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952141.944007:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952141.944029:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952141.944084:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447763200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 185us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952141.944092:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2555 00000100:00100000:0.0:1783952141.944413:0:26200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:26200:1870605465542784:192.168.202.48@tcp:104: 00010000:00010000:0.0:1783952141.944443:0:26200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.944453:0:26200:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.944473:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.944483:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.944490:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952141.944515:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783952141.944750:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465542656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 13940us (14050us total) trans 4294968956 rc 0/0 00000100:00100000:0.0:1783952141.944758:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4950 00000004:00080000:1.0:1783952141.944858:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97b1762f3100/2, rc 0, transno 4294968956 00000100:00100000:1.0:1783952141.944866:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465542656:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1783952141.945133:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952141.945140:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952141.945148:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2c000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952141.945152:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952141.945161:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952141.945176:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952141.945183:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009870e729/0x22c73c7857bb5b87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952141.945201:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952141.945211:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952141.945212:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952142.886614:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952142.945243:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952142.945268:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465542912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952142.945336:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952142.945480:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465542912 00000100:00100000:3.0:1783952142.945489:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465542912 00000100:00100000:3.0:1783952142.945569:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203 00000100:00100000:3.0:1783952142.945579:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465542912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783952142.945631:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783952142.945668:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952142.945682:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465542912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952142.945689:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203 00000100:00100000:3.0:1783952142.945747:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465542912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952142.950077:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952142.950101:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465543040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952142.950170:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952142.950257:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465543040 00000100:00100000:0.0:1783952142.950265:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465543040 00000100:00080000:2.0:1783952142.950333:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952142.950345:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00100000:0.0:1783952142.950354:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465543040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952142.950380:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952142.950434:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465543040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952142.950441:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00100000:2.0:1783952142.950532:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465543040:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783952143.905813:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952144.941015:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783952145.690566:0:93077:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 10:15:44 (1783952144) 00010000:00010000:0.0:1783952145.953256:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952146.018766:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465543168:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.018875:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952146.018926:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465543680:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.018958:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952146.018977:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465544192:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.018998:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952146.019015:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465544704:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019044:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952146.019071:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783952146.019077:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465543552:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019099:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952146.019115:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465544064:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019140:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952146.019160:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14474d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465544576:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952146.019218:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465543168 00000100:00100000:2.0:1783952146.019241:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465543168 00000100:00100000:2.0:1783952146.019300:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783952146.019310:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465543168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019375:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465543168:12345-0@lo:400:kworker.0 Request processed in 66us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952146.019384:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783952146.019443:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465543680 00000100:00100000:2.0:1783952146.019447:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465543680 00000100:00100000:2.0:1783952146.019486:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465544192 00000100:00100000:2.0:1783952146.019489:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465544192 00000100:00100000:2.0:1783952146.019510:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465544704 00000100:00100000:2.0:1783952146.019513:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465544704 00000100:00100000:2.0:1783952146.019525:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465543552 00000100:00100000:2.0:1783952146.019527:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465543552 00000100:00100000:2.0:1783952146.019544:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1783952146.019550:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465543680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019613:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465543680:12345-0@lo:400:kworker.0 Request processed in 37us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952146.019620:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1783952146.019633:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1783952146.019639:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465544192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019668:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465544192:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952146.019675:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1783952146.019687:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1783952146.019705:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465544704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019734:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465544704:12345-0@lo:400:kworker.0 Request processed in 42us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952146.019749:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1783952146.019762:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1783952146.019767:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465543552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019798:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465543552:12345-0@lo:400:kworker.0 Request processed in 30us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952146.019805:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1783952146.019826:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465544064 00000100:00100000:2.0:1783952146.019830:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465544064 00000100:00100000:2.0:1783952146.019857:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465544576 00000100:00100000:2.0:1783952146.019860:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465544576 00000100:00100000:2.0:1783952146.019878:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:2.0:1783952146.019884:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465544064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019918:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465544064:12345-0@lo:400:kworker.0 Request processed in 34us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952146.019925:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00100000:2.0:1783952146.019935:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823 00000100:00100000:2.0:1783952146.019941:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465544576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.019968:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465544576:12345-0@lo:400:kworker.0 Request processed in 27us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952146.019974:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823 00000100:00100000:2.0:1783952146.020019:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465543552:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.020033:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465544064:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.020042:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968956 gen 2 00000100:00100000:2.0:1783952146.020060:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14474d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465544576:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.020082:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465543168:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.020090:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465543680:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.020099:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465544192:0@lo:400:kworker.0 00000100:00100000:2.0:1783952146.020109:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465544704:0@lo:400:kworker.0 00000100:00080000:2.0:1783952146.020141:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952146.020147:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783952146.020149:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952146.020646:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465543296:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.020711:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952146.020742:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465543808:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.020772:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952146.020792:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465544320:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.020817:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952146.020838:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783952146.020845:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465543424:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.020867:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952146.020885:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465543936:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.020910:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952146.020928:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465544448:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.020949:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952146.020989:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465543296 00000100:00100000:3.0:1783952146.021007:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465543296 00000100:00100000:3.0:1783952146.021057:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465543424 00000100:00100000:3.0:1783952146.021060:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465543424 00000100:00100000:3.0:1783952146.021081:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1783952146.021088:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465543296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.021137:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465543296:12345-0@lo:400:kworker.0 Request processed in 49us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952146.021143:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1783952146.021159:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1783952146.021164:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465543424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.021188:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465543424:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952146.021194:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1783952146.021218:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465543936 00000100:00100000:3.0:1783952146.021221:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465543936 00000100:00100000:3.0:1783952146.021264:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465544448 00000100:00100000:3.0:1783952146.021268:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465544448 00000100:00100000:3.0:1783952146.021288:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00100000:3.0:1783952146.021294:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465543936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.021324:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3644:x1870605465543936:12345-0@lo:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952146.021331:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00000100:00100000:3.0:1783952146.021341:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:3.0:1783952146.021345:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465544448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.021367:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465544448:12345-0@lo:400:kworker.0 Request processed in 22us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952146.021372:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000100:00100000:3.0:1783952146.021465:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465543808 00000100:00100000:3.0:1783952146.021469:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465543808 00000100:00100000:3.0:1783952146.021495:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465544320 00000100:00100000:3.0:1783952146.021498:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465544320 00000100:00100000:3.0:1783952146.021513:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1783952146.021518:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465543808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.021552:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465543808:12345-0@lo:400:kworker.0 Request processed in 34us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952146.021559:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1783952146.021569:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1783952146.021574:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465544320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.021635:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465544320:12345-0@lo:400:kworker.0 Request processed in 61us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952146.021641:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00080000:3.0:1783952146.021675:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952146.021681:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952146.021683:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952146.021713:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952146.021724:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465544832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952146.021753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952146.021778:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465544832 00000100:00100000:3.0:1783952146.021782:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465544832 00000100:00100000:3.0:1783952146.021801:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1783952146.021807:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465544832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952146.021839:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445523456 avail 1299283968 00000100:00100000:3.0:1783952146.021874:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465544832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952146.021881:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1783952146.021935:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465544832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952146.021966:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465543424:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.021977:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465543936:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.021985:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968955 gen 2 00000100:00100000:3.0:1783952146.021997:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465544448:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.022008:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465543296:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.022016:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:3.0:1783952146.022021:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000004:00080000:3.0:1783952146.022044:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000020:00080000:3.0:1783952146.022051:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff97b14ee79900 refcount 2 committed 0 result 0 batchid 73014444092 00000020:00080000:3.0:1783952146.022055:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97b164e39700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff97b14ee79540 00000020:00080000:3.0:1783952146.022059:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x6:0x0].3 00000020:00080000:3.0:1783952146.022062:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97b164e39b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97b14120a000 00000020:00080000:3.0:1783952146.022064:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].4 00000100:00100000:3.0:1783952146.022082:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465543808:0@lo:400:kworker.0 00000100:00100000:3.0:1783952146.022090:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465544320:0@lo:400:kworker.0 00000020:00080000:2.0:1783952146.022802:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444092 committed batchid 73014444091 00000020:00080000:2.0:1783952146.022893:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444091 00000100:00100000:0.0:1783952146.023032:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952146.023063:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465544960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952146.023120:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952146.023213:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465544960 00000100:00100000:2.0:1783952146.023220:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465544960 00000100:00100000:2.0:1783952146.023269:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:2.0:1783952146.023278:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465544960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952146.023313:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1783952146.023361:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465544960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952146.023368:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:2.0:1783952146.023793:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465544960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783952146.529903:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465545088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952146.530002:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952146.530675:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465545088 00000100:00100000:0.0:1783952146.530684:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465545088 00000100:00100000:0.0:1783952146.530758:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00100000:0.0:1783952146.530770:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465545088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783952146.530814:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952146.530881:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465545088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952146.530889:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00100000:2.0:1783952146.531050:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465545216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952146.531091:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952146.531243:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465545088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952146.531626:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465545216 00000100:00100000:0.0:1783952146.531632:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465545216 00000100:00100000:0.0:1783952146.531671:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206 00000100:00100000:0.0:1783952146.531679:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465545216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783952146.531720:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952146.531771:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465545216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952146.531779:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206 00000100:00100000:0.0:1783952146.531816:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465545216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952146.925049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952146.925653:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447763456 00000100:00100000:1.0:1783952146.925671:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447763456 00000100:00100000:1.0:1783952146.925803:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1352 00000100:00100000:1.0:1783952146.925816:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2401:x1870605447763456:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952146.925938:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2401:x1870605447763456:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 124us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952146.925949:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1352 00000100:00080000:3.0:1783952146.925965:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952146.938673:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952146.938730:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952146.938766:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952146.938801:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447763712 00000100:00100000:0.0:1783952146.938809:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447763712 00000100:00100000:1.0:1783952146.938875:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447763328 00000100:00100000:0.0:1783952146.938878:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2826 00000100:00100000:1.0:1783952146.938893:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447763328 00000100:00100000:0.0:1783952146.938893:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447763712:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952146.938971:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00100000:1.0:1783952146.938984:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447763328:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952146.939006:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447763712:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 111us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952146.939016:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2826 00000100:00100000:1.0:1783952146.939061:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447763328:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 78us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952146.939072:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 76 00000100:00080000:0.0:1783952146.939173:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952146.939189:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447763584 00000100:00100000:2.0:1783952146.939197:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447763584 00000100:00100000:2.0:1783952146.939285:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1353 00000100:00100000:2.0:1783952146.939295:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447763584:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952146.939353:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447763584:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 61us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952146.939361:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1353 00000100:00080000:0.0:1783952146.939991:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783952146.979124:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783952147.040090:0:93125:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffef2ca8910 20000000:00000080:2.0:1783952147.040113:0:93125:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff97b049e73000 uarg=0000000000000000 00000040:00100000:2.0:1783952147.042065:0:93125:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 49 00000040:00100000:2.0:1783952147.042074:0:93125:0:(llog.c:1072:llog_reverse_process()) index 47 : idx 1 00000040:00080000:2.0:1783952147.042192:0:93125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:2.0:1783952147.042212:0:93125:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:2.0:1783952147.042231:0:93125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:2.0:1783952147.042248:0:93125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:2.0:1783952147.042321:0:93125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:2.0:1783952147.042330:0:93125:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:2.0:1783952147.042343:0:93125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:2.0:1783952147.042499:0:93125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:0.0:1783952147.046739:0:93125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:0.0:1783952147.046786:0:93125:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1783952147.046833:0:93125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:0.0:1783952147.047029:0:93125:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:0.0:1783952147.047055:0:93125:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783952147.047074:0:93125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047092:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb5694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb568d expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047100:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb577b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5774 expref: 23 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047107:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb57ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57a5 expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047113:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb57c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57c1 expref: 23 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047119:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b14d86a000/0x22c73c7857bb57f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57eb expref: 23 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047125:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b1762af200/0x22c73c7857bb5800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb57f9 expref: 23 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047138:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb581c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5815 expref: 23 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047145:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb582a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5823 expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047151:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb5854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb584d expref: 23 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047160:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbd400/0x22c73c7857bb5869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e0 expref: 9 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047167:0:93125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3ee expref: 9 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047175:0:93125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047217:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3ee expref: 9 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047231:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3ee expref: 9 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952147.047246:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14474ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465545344:192.168.202.48@tcp:104: 00010000:00010000:0.0:1783952147.047454:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbd400/0x22c73c7857bb5869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e0 expref: 9 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047463:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbd400/0x22c73c7857bb5869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e0 expref: 9 pid: 92502 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952147.047482:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465545472:192.168.202.48@tcp:104: 00010000:00010000:0.0:1783952147.047552:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb5854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb584d expref: 23 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047562:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb5854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb584d expref: 23 pid: 92502 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952147.047573:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465545600:0@lo:104: 00000100:00100000:0.0:1783952147.047640:0:93125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952147.047692:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783952147.047711:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465545600 00000100:00100000:0.0:1783952147.047717:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465545600 00000100:00100000:0.0:1783952147.047758:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1783952147.047766:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:93125:x1870605465545600:12345-0@lo:104: 00010000:00010000:0.0:1783952147.047779:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047823:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783952147.047829:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:93125:x1870605465545600:12345-0@lo:104: Request processed in 65us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952147.047835:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00010000:0.0:1783952147.047898:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb582a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5823 expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.047907:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb582a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5823 expref: 23 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952147.047927:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465545728:0@lo:104: 00000100:00100000:0.0:1783952147.047954:0:93125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952147.047978:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465545728 00000100:00100000:0.0:1783952147.047982:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465545728 00000100:00100000:0.0:1783952147.048005:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1783952147.048011:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:93125:x1870605465545728:12345-0@lo:104: 00010000:00010000:0.0:1783952147.048019:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.048057:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783952147.048062:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:93125:x1870605465545728:12345-0@lo:104: Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952147.048067:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:2.0:1783952147.049384:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783952147.049397:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.049408:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952147.049412:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.049422:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952147.049430:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952147.049436:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783952147.049912:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb581c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5815 expref: 23 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.050078:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.050086:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952147.050110:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.050118:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86a400/0x22c73c7857bb584d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5854 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.050134:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952147.050137:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.050143:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af600 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952147.050147:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.050155:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952147.050162:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952147.050168:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1783952147.050322:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465545984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.050379:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952147.050437:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465545984 00000100:00100000:3.0:1783952147.050443:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465545984 00010000:00010000:2.0:1783952147.050785:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.050793:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952147.050806:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.050827:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762af600/0x22c73c7857bb5823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb582a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.050840:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952147.050842:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952147.050845:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952147.050856:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465546112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952147.050889:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783952147.051202:0:22092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb5854 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb584d expref: 24 pid: 92502 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952147.051238:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465546112 00000100:00100000:3.0:1783952147.051242:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465546112 00010000:00010000:3.0:1783952147.051256:0:22092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb582a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5823 expref: 25 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952147.051278:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1783952147.051286:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1472bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3644:x1870605465545984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952147.051299:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952147.051304:0:22092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb5854 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb584d expref: 25 pid: 92502 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.051359:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb581c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5815 expref: 23 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952147.051375:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465545856:0@lo:104: 00000100:00100000:1.0:1783952147.051404:0:93125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952147.051463:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:2.0:1783952147.051472:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3645:x1870605465546112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952147.051482:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952147.051487:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb582a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5823 expref: 25 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.051512:0:22092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb5854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb584d expref: 25 pid: 92502 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.051529:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952147.051565:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1472bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3644:x1870605465545984:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.051571:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1783952147.051660:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465545984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952147.051920:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b1762af200/0x22c73c7857bb5800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb57f9 expref: 24 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.051941:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b1762af200/0x22c73c7857bb5800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb57f9 expref: 24 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952147.051967:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546240:0@lo:104: 00000100:00100000:1.0:1783952147.051995:0:93125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783952147.052027:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952147.052045:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b14d86a000/0x22c73c7857bb57f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb57eb expref: 24 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.052056:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b14d86a000/0x22c73c7857bb57f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb57eb expref: 24 pid: 92499 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952147.052065:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546368:0@lo:104: 00000100:00100000:1.0:1783952147.052096:0:93125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952147.052123:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465545856 00010000:00010000:1.0:1783952147.052126:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb57c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb57c1 expref: 24 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952147.052129:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465545856 00010000:00010000:1.0:1783952147.052141:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb57c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb57c1 expref: 24 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952147.052152:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546496:0@lo:104: 00000100:00100000:0.0:1783952147.052157:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465546240 00000100:00100000:0.0:1783952147.052161:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465546240 00000100:00100000:0.0:1783952147.052176:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1783952147.052183:0:93125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952147.052204:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb57ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb57a5 expref: 24 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.052212:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb57ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb57a5 expref: 24 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952147.052221:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546624:0@lo:104: 00000100:00100000:1.0:1783952147.052240:0:93125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952147.052257:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb577b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5774 expref: 24 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.052277:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb577b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5774 expref: 24 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952147.052286:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546752:0@lo:104: 00000100:00100000:0.0:1783952147.052310:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:93125:x1870605465545856:12345-0@lo:104: 00000100:00100000:1.0:1783952147.052312:0:93125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783952147.052326:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.052334:0:93125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb5694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb568d expref: 24 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.052345:0:93125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb5694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb568d expref: 24 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952147.052354:0:93125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546880:0@lo:104: 00010000:00010000:0.0:1783952147.052376:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783952147.052380:0:93125:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783952147.052384:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:93125:x1870605465545856:12345-0@lo:104: Request processed in 199us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952147.052393:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1783952147.052403:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14474ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465545344:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783952147.052421:0:93125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbde00/0x22c73c7857bb5854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb584d expref: 24 pid: 92502 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952147.052428:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783952147.052434:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465545600:0@lo:104: 00000100:00100000:1.0:1783952147.052450:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465545728:0@lo:104: 00000100:00100000:0.0:1783952147.052451:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952147.052467:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465545856:0@lo:104: 00000100:00100000:0.0:1783952147.052468:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465546368 00000100:00100000:0.0:1783952147.052474:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465546368 00000100:00100000:0.0:1783952147.052492:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465546496 00000100:00100000:0.0:1783952147.052495:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465546496 00000100:00100000:0.0:1783952147.052503:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465546624 00000100:00100000:0.0:1783952147.052505:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465546624 00000100:00100000:0.0:1783952147.052513:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465546752 00000100:00100000:0.0:1783952147.052515:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465546752 00000100:00100000:0.0:1783952147.052523:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465546880 00000100:00100000:0.0:1783952147.052525:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465546880 00000100:00100000:0.0:1783952147.052535:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1783952147.052540:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:93125:x1870605465546240:12345-0@lo:104: 00000100:00100000:3.0:1783952147.052643:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1783952147.052651:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:93125:x1870605465546368:12345-0@lo:104: 00010000:00010000:3.0:1783952147.052659:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.052721:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783952147.052726:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:93125:x1870605465546368:12345-0@lo:104: Request processed in 77us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.052741:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1783952147.052757:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1783952147.052763:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:93125:x1870605465546496:12345-0@lo:104: 00010000:00010000:3.0:1783952147.052770:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.052803:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783952147.052807:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:93125:x1870605465546496:12345-0@lo:104: Request processed in 46us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.052812:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1783952147.052824:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1783952147.052830:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:93125:x1870605465546624:12345-0@lo:104: 00010000:00010000:3.0:1783952147.052837:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.052869:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783952147.052876:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:93125:x1870605465546624:12345-0@lo:104: Request processed in 45us (634us total) trans 0 rc 0/0 00010000:00010000:0.0:1783952147.052876:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952147.052892:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1783952147.052907:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1783952147.052915:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b63e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:93125:x1870605465546752:12345-0@lo:104: 00010000:00010000:3.0:1783952147.052924:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952147.052927:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:3.0:1783952147.052969:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1783952147.052974:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b63e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:93125:x1870605465546752:12345-0@lo:104: Request processed in 61us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.052985:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1783952147.052997:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1783952147.053004:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:93125:x1870605465546880:12345-0@lo:104: 00000100:00100000:0.0:1783952147.053011:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:93125:x1870605465546240:12345-0@lo:104: Request processed in 468us (1013us total) trans 0 rc 0/0 00010000:00010000:3.0:1783952147.053014:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952147.053023:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00010000:3.0:1783952147.053054:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1783952147.053062:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:93125:x1870605465546880:12345-0@lo:104: Request processed in 58us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.053068:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:3.0:1783952147.053101:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1783952147.053107:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.053114:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aec00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952147.053118:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.053126:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952147.053132:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952147.053138:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952147.053161:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.053168:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783952147.053252:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546240:0@lo:104: 00000100:00100000:1.0:1783952147.053260:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546368:0@lo:104: 00000100:00100000:1.0:1783952147.053266:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546496:0@lo:104: 00000100:00100000:1.0:1783952147.053273:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546624:0@lo:104: 00000100:00100000:1.0:1783952147.053279:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546752:0@lo:104: 00000100:00100000:1.0:1783952147.053295:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465546880:0@lo:104: 00010000:00010000:3.0:1783952147.053849:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.053857:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762aec00/0x22c73c7857bb5815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb581c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.053870:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1783952147.053873:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.053879:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afc00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952147.053883:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.053890:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952147.053896:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952147.053900:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952147.053919:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.053936:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952147.053943:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.053949:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762afc00/0x22c73c7857bb57eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb57f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054205:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783952147.054216:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054222:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952147.054225:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054242:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952147.054249:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952147.054254:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952147.054268:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054274:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952147.054297:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054304:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb57c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb57c8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054315:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783952147.054318:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054324:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952147.054327:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054344:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952147.054350:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952147.054355:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952147.054369:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054375:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952147.054382:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054388:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762ae400/0x22c73c7857bb57a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb57ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054397:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783952147.054400:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054406:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ac00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952147.054409:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054415:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952147.054421:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952147.054433:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952147.054447:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054807:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952147.054814:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054821:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86ac00/0x22c73c7857bb57f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5800 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054832:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952147.054835:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054841:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aea00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952147.054844:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054850:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952147.054857:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952147.054861:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952147.054876:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054881:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952147.054892:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054899:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762aea00/0x22c73c7857bb5774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb577b expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054909:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952147.054912:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054918:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b800 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952147.054920:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.054939:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952147.054946:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952147.054951:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952147.055083:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.055089:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952147.055095:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.055101:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb568d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5694 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.055126:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952147.055128:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952147.055131:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952147.055161:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465547008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.055216:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952147.055271:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465547520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.055293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952147.055319:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783952147.055325:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465547136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.055344:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952147.055359:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465547648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.055379:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952147.055411:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465547008 00000100:00100000:3.0:1783952147.055418:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465547008 00010000:00010000:3.0:1783952147.055442:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb581c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5815 expref: 24 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.055617:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb582a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5823 expref: 23 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.055637:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc600/0x22c73c7857bb582a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5823 expref: 24 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.055651:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952147.055707:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3645:x1870605465546112:12345-0@lo:103:ldlm_bl.0 Request processed in 4235us (4816us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952147.055716:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:2.0:1783952147.055737:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465547520 00000100:00100000:2.0:1783952147.055740:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465547520 00010000:00010000:2.0:1783952147.055754:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b1762af200/0x22c73c7857bb5800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb57f9 expref: 23 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952147.056083:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465547136 00000100:00100000:3.0:1783952147.056087:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465547136 00010000:00010000:3.0:1783952147.056102:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b14d86a000/0x22c73c7857bb57f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb57eb expref: 24 pid: 92499 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952147.056613:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465547648 00000100:00100000:2.0:1783952147.056618:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465547648 00010000:00010000:2.0:1783952147.056636:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb577b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5774 expref: 25 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952147.056651:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:2.0:1783952147.056659:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3642:x1870605465547008:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.056773:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1783952147.056782:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3642:x1870605465547520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952147.056797:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952147.056802:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b1762af200/0x22c73c7857bb5800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb57f9 expref: 25 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.056820:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b1762af200/0x22c73c7857bb5800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb57f9 expref: 25 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.056834:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762af200/0x22c73c7857bb5800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb57f9 expref: 25 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.056845:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952147.056887:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465547520:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.056893:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1783952147.056910:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1783952147.056916:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3642:x1870605465547136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952147.056923:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952147.056941:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b14d86a000/0x22c73c7857bb57f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb57eb expref: 23 pid: 92499 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.056949:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b14d86a000/0x22c73c7857bb57f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb57eb expref: 23 pid: 92499 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057073:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86a000/0x22c73c7857bb57f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb57eb expref: 23 pid: 92499 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057083:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952147.057109:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3642:x1870605465547136:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.057115:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1783952147.057130:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1783952147.057137:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3642:x1870605465547648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952147.057150:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952147.057154:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb577b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5774 expref: 21 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057161:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb577b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5774 expref: 21 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057170:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc200/0x22c73c7857bb577b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5774 expref: 21 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057179:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952147.057201:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3642:x1870605465547648:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.057207:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1783952147.057329:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465547136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.057341:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465547648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.057347:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465547520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.057398:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465547392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.057426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952147.057462:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465546112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.057473:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783952147.057479:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465547264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.057499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952147.057513:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465547776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.057532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952147.057563:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465547392 00000100:00100000:3.0:1783952147.057568:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465547392 00010000:00010000:3.0:1783952147.057583:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb57ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb57a5 expref: 20 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952147.057625:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465547264 00000100:00100000:3.0:1783952147.057628:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465547264 00010000:00010000:3.0:1783952147.057641:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb57c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb57c1 expref: 21 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952147.057652:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465547776 00000100:00100000:3.0:1783952147.057654:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465547776 00010000:00010000:3.0:1783952147.057750:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb5694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb568d expref: 22 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952147.057767:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1783952147.057773:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3645:x1870605465547392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952147.057781:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952147.057785:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb57ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb57a5 expref: 22 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057792:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb57ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb57a5 expref: 22 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057801:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb57ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb57a5 expref: 22 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057812:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952147.057841:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3645:x1870605465547392:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.057848:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1783952147.057869:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1783952147.057875:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1472be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3645:x1870605465547264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952147.057885:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952147.057889:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb57c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb57c1 expref: 20 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057896:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb57c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb57c1 expref: 20 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057906:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb57c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb57c1 expref: 20 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.057915:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952147.058079:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1472be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3645:x1870605465547264:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.058085:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1783952147.058099:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1783952147.058105:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:3645:x1870605465547776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952147.058113:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952147.058117:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb5694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb568d expref: 18 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.058124:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb5694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb568d expref: 18 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.058135:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb5694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb568d expref: 18 pid: 92498 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952147.058145:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952147.058172:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:3645:x1870605465547776:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952147.058178:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1783952147.058210:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465547264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.058216:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465547776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.058223:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465547392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952147.058341:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952147.058348:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952147.058423:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952147.058429:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb581c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5815 expref: 16 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.058439:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb581c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5815 expref: 16 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.058449:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb581c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5815 expref: 16 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952147.058470:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952147.058506:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:3642:x1870605465547008:12345-0@lo:103:ldlm_bl.0 Request processed in 1849us (3290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952147.058513:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:3.0:1783952147.059184:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465547008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952147.059877:0:93125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93125:1870605465545472:192.168.202.48@tcp:104: 00010000:00010000:0.0:1783952147.060082:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952147.060749:0:93125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952147.061779:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952147.061813:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952147.061890:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447763840 00000100:00100000:1.0:1783952147.061898:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447763840 00010000:00010000:1.0:1783952147.061934:0:22092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3ee expref: 10 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952147.061975:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447763968 00000100:00100000:1.0:1783952147.061979:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447763968 00010000:00010000:1.0:1783952147.061992:0:22092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbd400/0x22c73c7857bb5869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e0 expref: 11 pid: 92502 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952147.062023:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2565 00000100:00100000:1.0:1783952147.062032:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e617e28a-7c0f-459e-8765-f628898cec50+11:2400:x1870605447763840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783952147.062047:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952147.062053:0:22092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3ee expref: 11 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062065:0:22092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3ee expref: 11 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062081:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3ee expref: 11 pid: 92497 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062096:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952147.062143:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447763840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952147.062150:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2565 00000100:00100000:1.0:1783952147.062168:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2566 00000100:00100000:1.0:1783952147.062175:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e617e28a-7c0f-459e-8765-f628898cec50+9:2400:x1870605447763968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783952147.062197:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952147.062202:0:22092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff97b050cbd400/0x22c73c7857bb5869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e0 expref: 9 pid: 92502 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062210:0:22092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbd400/0x22c73c7857bb5869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e0 expref: 9 pid: 92502 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062226:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbd400/0x22c73c7857bb5869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e0 expref: 9 pid: 92502 timeout: 3961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062242:0:22092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062251:0:22092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062265:0:22092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062271:0:22092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062277:0:22092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062283:0:22092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062289:0:22092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952147.062292:0:22092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062313:0:22092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062329:0:22092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062338:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952147.062360:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e617e28a-7c0f-459e-8765-f628898cec50+8:2400:x1870605447763968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 186us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952147.062366:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2566 00010000:00010000:1.0:1783952147.062389:0:93125:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062396:0:93125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952147.062402:0:93125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb5b8e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.000847:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952148.068508:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465547904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952148.068605:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952148.068800:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465547904 00000100:00100000:1.0:1783952148.068808:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465547904 00000100:00100000:1.0:1783952148.068864:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207 00000100:00100000:1.0:1783952148.068872:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465547904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952148.068901:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783952148.068915:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952148.068964:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870605465547904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952148.068972:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207 00000100:00100000:3.0:1783952148.069056:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465547904:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1783952148.069536:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968956 is committed 00000100:00100000:2.0:1783952148.069987:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465548032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952148.070042:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.070175:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465548032 00000100:00100000:0.0:1783952148.070181:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465548032 00000100:00100000:0.0:1783952148.070225:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208 00000100:00100000:0.0:1783952148.070234:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465548032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952148.070256:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952148.070302:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465548032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952148.070309:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208 00000100:00080000:2.0:1783952148.070393:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952148.070421:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465548032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952148.463280:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952148.463392:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447764096 00000100:00100000:0.0:1783952148.463402:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447764096 00000100:00100000:0.0:1783952148.463457:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:0.0:1783952148.463476:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447764096:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952148.463493:0:92497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952148.463513:0:92497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb5b95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a43b expref: -99 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.463540:0:92497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb5b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a43b expref: 9 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.463551:0:92497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb5b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a43b expref: 9 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.463560:0:92497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d200, rc 0) 00000100:00100000:0.0:1783952148.463648:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447764096:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 183us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952148.463655:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:0.0:1783952148.474134:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952148.474238:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447764224 00000100:00100000:2.0:1783952148.474260:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447764224 00000100:00100000:2.0:1783952148.474326:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:2.0:1783952148.474336:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447764224:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.474517:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447764224:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 181us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.474526:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 78 00000100:00100000:1.0:1783952148.480701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952148.481487:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447764352 00000100:00100000:2.0:1783952148.481497:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447764352 00000100:00100000:2.0:1783952148.481557:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:2.0:1783952148.481568:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447764352:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.482047:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447764352:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 479us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.482056:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:0.0:1783952148.491080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952148.491620:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447764480 00000100:00100000:2.0:1783952148.491630:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447764480 00000100:00100000:2.0:1783952148.491702:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:2.0:1783952148.491714:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+9:71923:x1870605447764480:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783952148.491954:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+9:71923:x1870605447764480:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 240us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.491964:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 80 00000100:00100000:0.0:1783952148.504773:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952148.505901:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447764608 00000100:00100000:1.0:1783952148.505913:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447764608 00000100:00100000:1.0:1783952148.505981:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:1.0:1783952148.505991:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:71923:x1870605447764608:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783952148.506168:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:71923:x1870605447764608:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 177us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952148.506176:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:1.0:1783952148.512343:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952148.512697:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447764736 00000100:00100000:2.0:1783952148.512708:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447764736 00000100:00100000:2.0:1783952148.512768:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:2.0:1783952148.512779:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447764736:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952148.512796:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952148.512826:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5b9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a442 expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.512858:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a442 expref: 10 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.512870:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a442 expref: 10 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.512879:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a15c00, rc 0) 00000100:00100000:2.0:1783952148.512946:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447764736:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 169us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.512953:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 82 00000100:00100000:2.0:1783952148.518413:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952148.518616:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447764864 00000100:00100000:0.0:1783952148.518625:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447764864 00000100:00100000:0.0:1783952148.518731:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:0.0:1783952148.518743:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447764864:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.518884:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447764864:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 142us (478us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783952148.518893:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 83 10000000:01000000:3.0:1783952148.704724:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783952148.704733:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174b36000 from 52 10000000:01000000:3.0:1783952148.704738:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783952148.704801:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.704812:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.704841:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952148.704868:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465548160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.704939:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.704981:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952148.705211:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465548160 00000100:00100000:0.0:1783952148.705219:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465548160 00000100:00100000:0.0:1783952148.705274:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783952148.705283:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465548160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952148.705305:0:92497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952148.705319:0:92497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb5baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5ba3 expref: -99 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.705340:0:92497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb5baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5ba3 expref: 16 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.705351:0:92497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb5baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5ba3 expref: 16 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.705360:0:92497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2c000, rc 0) 00000100:00100000:0.0:1783952148.705412:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465548160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952148.705420:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783952148.705920:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465548160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952148.705936:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.705946:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952148.706012:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465548288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.706056:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.706088:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.706124:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465548288 00000100:00100000:2.0:1783952148.706130:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465548288 00000100:00100000:2.0:1783952148.706169:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783952148.706177:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465548288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.706305:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465548288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.706313:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783952148.706393:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465548288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.706440:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465548416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.706484:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.706503:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.706637:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465548416 00000100:00100000:2.0:1783952148.706641:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465548416 00000100:00100000:2.0:1783952148.706681:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783952148.706689:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465548416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.706765:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465548416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.706772:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783952148.706902:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465548416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.707388:0:93126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93126:1870605465548544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.707426:0:93126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.707457:0:93126:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.707620:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465548544 00000100:00100000:2.0:1783952148.707624:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465548544 00000100:00100000:2.0:1783952148.707650:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783952148.707657:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:93126:x1870605465548544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952148.707753:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:93126:x1870605465548544:12345-0@lo:502:llog_process_th.0 Request processed in 94us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.707760:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783952148.707894:0:93126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93126:1870605465548544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.707933:0:93126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93126:1870605465548672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.707964:0:93126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.707990:0:93126:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.708041:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465548672 00000100:00100000:2.0:1783952148.708046:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465548672 00000100:00100000:2.0:1783952148.708076:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783952148.708083:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:93126:x1870605465548672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952148.708141:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:93126:x1870605465548672:12345-0@lo:502:llog_process_th.0 Request processed in 59us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.708147:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783952148.709915:0:93126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93126:1870605465548672:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783952148.709958:0:93126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1783952148.710974:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1783952148.711009:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783952148.711020:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.711031:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952148.711042:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783952148.711044:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:2.0:1783952148.711047:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783952148.711082:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.711089:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.711115:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952148.711139:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465548800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.711202:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952148.711251:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e7fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783952148.711326:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465548800 00000100:00100000:0.0:1783952148.711333:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465548800 00000100:00100000:0.0:1783952148.711390:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783952148.711398:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465548800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952148.711413:0:92499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952148.711425:0:92499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b047b2c400/0x22c73c7857bb5bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5bb1 expref: -99 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.711455:0:92499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2c400/0x22c73c7857bb5bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5bb1 expref: 17 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.711475:0:92499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b047b2c400/0x22c73c7857bb5bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5bb1 expref: 17 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.711484:0:92499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2c400, rc 0) 00000100:00100000:0.0:1783952148.711526:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465548800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952148.711534:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783952148.711823:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465548800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952148.711837:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.711847:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952148.711905:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465548928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.711932:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.711961:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.714515:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465548928 00000100:00100000:2.0:1783952148.714530:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465548928 00000100:00100000:2.0:1783952148.714622:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783952148.714631:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465548928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.714804:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465548928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.714812:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783952148.715086:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465548928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.715134:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465549056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.715182:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.715219:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.715495:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465549056 00000100:00100000:2.0:1783952148.715500:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465549056 00000100:00100000:2.0:1783952148.715530:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783952148.715536:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465549056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.715649:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465549056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.715655:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783952148.715778:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465549056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.722524:0:93127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93127:1870605465549184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952148.722626:0:93127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.722678:0:93127:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf600 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.722845:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465549184 00000100:00100000:2.0:1783952148.722852:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465549184 00000100:00100000:2.0:1783952148.722901:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783952148.722909:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:93127:x1870605465549184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952148.723040:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:93127:x1870605465549184:12345-0@lo:502:llog_process_th.0 Request processed in 131us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.723053:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783952148.723331:0:93127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93127:1870605465549184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783952148.723357:0:93127:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952148.723456:0:93127:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952148.723459:0:93127:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:0.0:1783952148.723472:0:93127:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1783952148.723526:0:93127:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:0.0:1783952148.728012:0:93127:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:1.0:1783952148.740224:0:93127:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00080000:10000000:1.0:1783952148.746239:0:93127:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000100:00100000:0.0:1783952148.748853:0:93127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93127:1870605465549312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952148.748931:0:93127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.748968:0:93127:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf480 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.749043:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465549312 00000100:00100000:3.0:1783952148.749049:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465549312 00000100:00100000:3.0:1783952148.749098:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783952148.749107:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:93127:x1870605465549312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.749224:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:93127:x1870605465549312:12345-0@lo:502:llog_process_th.0 Request processed in 118us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.749232:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783952148.749313:0:93127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93127:1870605465549312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952148.749348:0:93127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93127:1870605465549440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952148.749390:0:93127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.749407:0:93127:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf480 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.749612:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465549440 00000100:00100000:2.0:1783952148.749616:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465549440 00000100:00100000:2.0:1783952148.749642:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783952148.749648:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:93127:x1870605465549440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952148.749724:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:93127:x1870605465549440:12345-0@lo:502:llog_process_th.0 Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.749730:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783952148.749907:0:93127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93127:1870605465549440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783952148.749925:0:93127:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783952148.749932:0:93127:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952148.749934:0:93127:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:0.0:1783952148.749939:0:93127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:1.0:1783952148.750193:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:1.0:1783952148.750219:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783952148.750229:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952148.750240:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952148.750249:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783952148.750252:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b151231000 from 52 10000000:01000000:1.0:1783952148.750255:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783952148.750279:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952148.750286:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952148.750305:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952148.750332:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465549568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952148.750476:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952148.750509:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048e2d780 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.750628:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465549568 00000100:00100000:2.0:1783952148.750633:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465549568 00000100:00100000:2.0:1783952148.750660:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783952148.750676:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465549568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952148.750687:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952148.750698:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b175a14000/0x22c73c7857bb5bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5bbf expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.750719:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b175a14000/0x22c73c7857bb5bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5bbf expref: 18 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.750728:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b175a14000/0x22c73c7857bb5bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5bbf expref: 18 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.750736:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a14000, rc 0) 00000100:00100000:2.0:1783952148.750771:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465549568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.750777:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783952148.750885:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465549568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952148.750897:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952148.750907:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952148.750960:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465549696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952148.750984:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952148.751010:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048e2d780 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.751090:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465549696 00000100:00100000:2.0:1783952148.751100:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465549696 00000100:00100000:2.0:1783952148.751128:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783952148.751134:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465549696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.751239:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465549696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.751245:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783952148.751450:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465549696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952148.751556:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465549824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952148.751623:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952148.751642:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048e2d780 going to sleep for 11 seconds 00000100:00100000:0.0:1783952148.751762:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465549824 00000100:00100000:0.0:1783952148.751767:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465549824 00000100:00100000:0.0:1783952148.751803:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783952148.751810:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465549824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.751895:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465549824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952148.751901:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783952148.751987:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465549824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.752176:0:93128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93128:1870605465549952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.752211:0:93128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.752230:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465549952 00000100:00100000:3.0:1783952148.752234:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465549952 00000100:00100000:3.0:1783952148.752257:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783952148.752264:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:93128:x1870605465549952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.752632:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:93128:x1870605465549952:12345-0@lo:502:llog_process_th.0 Request processed in 367us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.752640:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783952148.752690:0:93128:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3840 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.752703:0:93128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93128:1870605465549952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.752740:0:93128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93128:1870605465550080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.752770:0:93128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.752783:0:93128:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3840 going to sleep for 11 seconds 00000100:00100000:1.0:1783952148.752838:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465550080 00000100:00100000:1.0:1783952148.752842:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465550080 00000100:00100000:1.0:1783952148.752874:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783952148.752880:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:93128:x1870605465550080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952148.752948:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:93128:x1870605465550080:12345-0@lo:502:llog_process_th.0 Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952148.752954:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783952148.753271:0:93128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93128:1870605465550080:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783952148.753442:0:93128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1783952148.753766:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1783952148.753793:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783952148.753804:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.753814:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952148.753823:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783952148.753825:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1783952148.753828:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783952148.753856:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.753863:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.753878:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952148.753894:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465550208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.753930:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.753993:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.756582:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465550208 00000100:00100000:3.0:1783952148.756753:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465550208 00000100:00100000:3.0:1783952148.756824:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783952148.756835:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465550208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952148.756874:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952148.756893:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216a400/0x22c73c7857bb5bd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5bcd expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.756996:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216a400/0x22c73c7857bb5bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5bcd expref: 19 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.757010:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216a400/0x22c73c7857bb5bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5bcd expref: 19 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.757020:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a400, rc 0) 00000100:00100000:3.0:1783952148.757143:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465550208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 309us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.757151:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783952148.757397:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465550208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952148.757419:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.757431:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952148.757511:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465550336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.757545:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.757584:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952148.757620:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465550336 00000100:00100000:1.0:1783952148.757626:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465550336 00000100:00100000:1.0:1783952148.757715:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783952148.757723:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465550336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952148.757867:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465550336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952148.757873:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783952148.757933:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465550336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.757960:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465550464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.758001:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.758258:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.759211:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465550464 00000100:00100000:2.0:1783952148.759219:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465550464 00000100:00100000:2.0:1783952148.759274:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783952148.759282:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465550464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.759429:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465550464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.759436:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783952148.759690:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465550464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.760435:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93129:1870605465550592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952148.760490:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.760525:0:93129:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.760785:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465550592 00000100:00100000:3.0:1783952148.760791:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465550592 00000100:00100000:3.0:1783952148.760829:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783952148.760836:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160517450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:93129:x1870605465550592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.762011:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160517450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:93129:x1870605465550592:12345-0@lo:502:llog_process_th.0 Request processed in 1172us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.762021:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783952148.762118:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93129:1870605465550592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783952148.762151:0:93129:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952148.762162:0:93129:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952148.762164:0:93129:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:0.0:1783952148.762169:0:93129:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1783952148.762230:0:93129:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:0.0:1783952148.762278:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93129:1870605465550720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952148.762331:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.762374:0:93129:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf000 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.762858:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465550720 00000100:00100000:2.0:1783952148.762865:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465550720 00000100:00100000:2.0:1783952148.762902:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783952148.762910:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:93129:x1870605465550720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952148.763028:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:93129:x1870605465550720:12345-0@lo:502:llog_process_th.0 Request processed in 119us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.763036:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783952148.763114:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93129:1870605465550720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.763155:0:93129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93129:1870605465550848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.763187:0:93129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.763217:0:93129:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.763317:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465550848 00000100:00100000:2.0:1783952148.763322:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465550848 00000100:00100000:2.0:1783952148.763353:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783952148.763659:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160514050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:93129:x1870605465550848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952148.763757:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160514050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:93129:x1870605465550848:12345-0@lo:502:llog_process_th.0 Request processed in 396us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.763773:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783952148.763839:0:93129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93129:1870605465550848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952148.763865:0:93129:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952148.763871:0:93129:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952148.763873:0:93129:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:3.0:1783952148.763877:0:93129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:2.0:1783952148.765121:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:2.0:1783952148.765160:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783952148.765170:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.765182:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952148.765192:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783952148.765194:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b046482800 from 52 10000000:01000000:2.0:1783952148.765197:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783952148.765233:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.765241:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.765250:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952148.765274:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465550976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.765334:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952148.765382:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1411caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.765435:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465550976 00000100:00100000:3.0:1783952148.765441:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465550976 00000100:00100000:3.0:1783952148.765494:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783952148.765503:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465550976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952148.765517:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952148.765530:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5be2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5bdb expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.765550:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5bdb expref: 20 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.765561:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5bdb expref: 20 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.765570:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216ae00, rc 0) 00000100:00100000:3.0:1783952148.765641:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465550976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.765648:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783952148.765760:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465550976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952148.765774:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.765784:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952148.765836:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465551104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.765860:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.765881:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.765970:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465551104 00000100:00100000:3.0:1783952148.765975:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465551104 00000100:00100000:3.0:1783952148.766003:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783952148.766009:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465551104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.766117:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465551104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.766140:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783952148.766176:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465551104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.766207:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465551232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.766240:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.766253:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.766262:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465551232 00000100:00100000:3.0:1783952148.766265:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465551232 00000100:00100000:3.0:1783952148.766283:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783952148.766289:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465551232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.766361:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465551232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.766368:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783952148.766405:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465551232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.767427:0:93130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93130:1870605465551360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952148.767547:0:93130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.767640:0:93130:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.767959:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465551360 00000100:00100000:3.0:1783952148.767966:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465551360 00000100:00100000:3.0:1783952148.768032:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783952148.768042:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:93130:x1870605465551360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.768149:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:93130:x1870605465551360:12345-0@lo:502:llog_process_th.0 Request processed in 109us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.768157:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783952148.768222:0:93130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93130:1870605465551360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952148.768265:0:93130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93130:1870605465551488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952148.768307:0:93130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952148.768615:0:93130:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1783952148.768885:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465551488 00000100:00100000:0.0:1783952148.768891:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465551488 00000100:00100000:0.0:1783952148.768957:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783952148.768966:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:93130:x1870605465551488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952148.769051:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:93130:x1870605465551488:12345-0@lo:502:llog_process_th.0 Request processed in 86us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952148.769063:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783952148.769157:0:93130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93130:1870605465551488:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783952148.769182:0:93130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1783952148.769727:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1783952148.769756:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783952148.769768:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.769791:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952148.769801:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783952148.769803:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783952148.769806:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783952148.769833:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.769841:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.769851:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952148.769869:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465551616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.769908:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.769935:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1766949c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.769949:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465551616 00000100:00100000:3.0:1783952148.769953:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465551616 00000100:00100000:3.0:1783952148.769981:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783952148.769988:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465551616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952148.770000:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952148.770012:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5be9 expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.770035:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5be9 expref: 21 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.770056:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5be9 expref: 21 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.770064:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a000, rc 0) 00000100:00100000:3.0:1783952148.770093:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465551616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.770100:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783952148.770129:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465551616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952148.770140:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.770148:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952148.770196:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465551744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.770217:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.770232:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1766949c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.770243:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465551744 00000100:00100000:3.0:1783952148.770246:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465551744 00000100:00100000:3.0:1783952148.770266:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783952148.770272:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465551744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.770395:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465551744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.770402:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783952148.770428:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465551744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.770461:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465551872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.770502:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.770514:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1766949c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.770523:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465551872 00000100:00100000:3.0:1783952148.770526:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465551872 00000100:00100000:3.0:1783952148.770544:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783952148.770549:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465551872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.770644:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465551872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.770650:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783952148.771042:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465551872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783952148.771873:0:93131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783952148.771932:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783952148.771954:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783952148.771964:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.771975:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952148.771984:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783952148.771987:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174849000 from 52 10000000:01000000:3.0:1783952148.771990:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783952148.772016:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.772024:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.772043:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952148.772062:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.772103:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.772132:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b155dad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.772148:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465552000 00000100:00100000:3.0:1783952148.772152:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465552000 00000100:00100000:3.0:1783952148.772183:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783952148.772191:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465552000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952148.772202:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952148.772214:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5bfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5bf7 expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.772233:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5bf7 expref: 22 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.772243:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5bf7 expref: 22 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.772252:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216be00, rc 0) 00000100:00100000:3.0:1783952148.772280:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465552000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.772287:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783952148.772320:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952148.772332:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952148.772346:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952148.772953:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.772986:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.773053:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.773248:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465552128 00000100:00100000:2.0:1783952148.773254:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465552128 00000100:00100000:2.0:1783952148.773279:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783952148.773299:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465552128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.773422:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465552128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.773438:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783952148.773750:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.773786:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952148.773826:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952148.773843:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f396b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783952148.773900:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465552256 00000100:00100000:1.0:1783952148.773904:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465552256 00000100:00100000:1.0:1783952148.773940:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783952148.773948:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465552256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952148.774032:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465552256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952148.774038:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783952148.774123:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.774731:0:93132:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93132:1870605465552384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952148.774768:0:93132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952148.774825:0:93132:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c7fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.775002:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465552384 00000100:00100000:3.0:1783952148.775007:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465552384 00000100:00100000:3.0:1783952148.775041:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783952148.775047:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:93132:x1870605465552384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.775178:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:93132:x1870605465552384:12345-0@lo:502:llog_process_th.0 Request processed in 131us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.775186:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783952148.775285:0:93132:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93132:1870605465552384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952148.775445:0:93132:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93132:1870605465552512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952148.775546:0:93132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952148.775619:0:93132:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f3f840 going to sleep for 11 seconds 00000100:00100000:3.0:1783952148.775861:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465552512 00000100:00100000:3.0:1783952148.775866:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465552512 00000100:00100000:3.0:1783952148.775934:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783952148.775944:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:93132:x1870605465552512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952148.776034:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:93132:x1870605465552512:12345-0@lo:502:llog_process_th.0 Request processed in 93us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952148.776052:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783952148.776114:0:93132:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93132:1870605465552512:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783952148.776135:0:93132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1783952148.776318:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1783952148.776351:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783952148.776372:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.776382:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952148.776390:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783952148.776393:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783952148.776396:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783952148.776426:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.776434:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.776443:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952148.776458:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.776497:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.776863:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf000 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.776939:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465552640 00000100:00100000:2.0:1783952148.776944:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465552640 00000100:00100000:2.0:1783952148.776983:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783952148.776991:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465552640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952148.777002:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952148.777016:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb5c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5c05 expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.777037:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb5c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5c05 expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.777048:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb5c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c05 expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.777056:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a14c00, rc 0) 00000100:00100000:2.0:1783952148.777086:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465552640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.777092:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783952148.777182:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952148.777194:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.777212:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952148.777265:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.777302:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.777323:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf000 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.777372:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465552768 00000100:00100000:2.0:1783952148.777376:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465552768 00000100:00100000:2.0:1783952148.777402:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783952148.777409:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465552768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.777508:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465552768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.777513:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783952148.777740:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.777765:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.777795:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.777806:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf000 going to sleep for 11 seconds 00000100:00100000:2.0:1783952148.777851:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465552896 00000100:00100000:2.0:1783952148.777855:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465552896 00000100:00100000:2.0:1783952148.777880:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783952148.777886:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465552896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.777954:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465552896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952148.777959:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783952148.778024:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465552896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952148.778950:0:93133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1783952148.779250:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1783952148.779271:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783952148.779280:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.779302:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952148.779313:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783952148.779316:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97b167c90000 from 1 10000000:01000000:2.0:1783952148.779318:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783952148.779347:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.779354:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952148.779381:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952148.779402:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465553024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952148.779446:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952148.779644:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f3f600 going to sleep for 11 seconds 00000100:00100000:0.0:1783952148.779733:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465553024 00000100:00100000:0.0:1783952148.779740:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465553024 00000100:00100000:0.0:1783952148.779778:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783952148.779785:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465553024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952148.779797:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952148.779809:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b047b2dc00/0x22c73c7857bb5c1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5c13 expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.779828:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2dc00/0x22c73c7857bb5c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5c13 expref: 24 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.779838:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b047b2dc00/0x22c73c7857bb5c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c13 expref: 24 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.779859:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2dc00, rc 0) 00000100:00100000:0.0:1783952148.779896:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465553024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952148.779903:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783952148.779945:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465553024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952148.779958:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.779967:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952148.780016:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465553152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.780040:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952148.780053:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952148.780065:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465553152 00000100:00100000:0.0:1783952148.780069:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465553152 00000100:00100000:0.0:1783952148.780089:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783952148.780096:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465553152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952148.780165:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465553152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (124us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783952148.780171:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783952148.780199:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465553152:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783952148.780218:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783952148.780223:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952148.780236:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952149.024790:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952150.048812:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952151.074840:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952151.137153:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465553280:0@lo:400:kworker.0 00000100:00100000:1.0:1783952151.137269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952151.137849:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952151.137859:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465553664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952151.137899:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952151.137938:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465553664 00000100:00100000:1.0:1783952151.137947:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465553664 00000100:00100000:1.0:1783952151.138006:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:1.0:1783952151.138016:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465553664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783952151.138076:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445523456 avail 1299283968 00000100:00100000:1.0:1783952151.138132:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465553664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952151.138140:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:1.0:1783952151.138194:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465553664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952151.139191:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465553280 00000100:00100000:1.0:1783952151.139201:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465553280 00000100:00100000:1.0:1783952151.139326:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783952151.139336:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465553280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952151.139414:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465553280:12345-0@lo:400:kworker.0 Request processed in 79us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952151.139421:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783952151.139824:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465553280:0@lo:400:kworker.0 00000100:00100000:1.0:1783952151.139993:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465553792:0@lo:400:kworker.0 00000100:00100000:1.0:1783952151.140040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952151.140217:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465553536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952151.140268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952151.140290:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465554048:0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.140314:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952151.140545:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783952151.140554:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465553408:0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.140584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952151.140635:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465553920:0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.140669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952151.140711:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465553536 00000100:00100000:3.0:1783952151.140717:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465553536 00000100:00100000:0.0:1783952151.140825:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465553792 00000100:00100000:0.0:1783952151.140831:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465553792 00000100:00100000:0.0:1783952151.140890:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465554048 00000100:00100000:0.0:1783952151.140894:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465554048 00000100:00100000:0.0:1783952151.140915:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465553408 00000100:00100000:0.0:1783952151.140918:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465553408 00000100:00100000:0.0:1783952151.140931:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465553920 00000100:00100000:0.0:1783952151.140933:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465553920 00000100:00100000:0.0:1783952151.140947:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1783952151.140955:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465553792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.141053:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:3.0:1783952151.141072:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465553536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783952151.141107:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445179392 avail 1298939904 00000100:00100000:3.0:1783952151.141149:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465553536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952151.141156:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00100000:3.0:1783952151.141183:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1783952151.141190:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465554048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.141490:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465554048:12345-0@lo:400:kworker.0 Request processed in 299us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952151.141498:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1783952151.141534:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1783952151.141540:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465553408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.141571:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465553408:12345-0@lo:400:kworker.0 Request processed in 32us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952151.141576:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1783952151.141615:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1783952151.141622:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465553920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.141667:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465553920:12345-0@lo:400:kworker.0 Request processed in 45us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952151.141672:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1783952151.141755:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465553408:0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.141767:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465553920:0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.141785:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465553536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952151.141796:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465554048:0@lo:400:kworker.0 00000100:00100000:2.0:1783952151.142803:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465554176:0@lo:400:kworker.0 00000100:00100000:2.0:1783952151.142868:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.142898:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465554688:0@lo:400:kworker.0 00000100:00100000:2.0:1783952151.142925:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.142951:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783952151.142956:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465554304:0@lo:400:kworker.0 00000100:00100000:2.0:1783952151.142978:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.142995:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465554816:0@lo:400:kworker.0 00000100:00100000:2.0:1783952151.143016:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.143044:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465554432:0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.143218:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465554560:0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.143265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952151.143305:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465554688 00000100:00100000:3.0:1783952151.143314:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465554688 00000100:00100000:3.0:1783952151.143364:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465554304 00000100:00100000:3.0:1783952151.143368:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465554304 00000100:00100000:3.0:1783952151.143388:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465554816 00000100:00100000:3.0:1783952151.143391:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465554816 00000100:00100000:3.0:1783952151.143416:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827 00000100:00100000:3.0:1783952151.143424:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465554688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.143493:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465554688:12345-0@lo:400:kworker.0 Request processed in 69us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952151.143511:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00000100:00100000:3.0:1783952151.143529:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:3.0:1783952151.143535:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465554304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.143569:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465554304:12345-0@lo:400:kworker.0 Request processed in 33us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952151.143574:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00100000:3.0:1783952151.143603:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:3.0:1783952151.143611:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465554816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.143641:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465554816:12345-0@lo:400:kworker.0 Request processed in 31us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952151.143657:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:3.0:1783952151.143681:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465554560 00000100:00100000:3.0:1783952151.143684:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465554560 00000100:00100000:3.0:1783952151.143706:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1783952151.143712:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465554560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.143761:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465554560:12345-0@lo:400:kworker.0 Request processed in 48us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952151.143767:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1783952151.143815:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968956 gen 2 00000004:00080000:3.0:1783952151.143822:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97b1762f3100, transno 4294968956 00000100:00100000:3.0:1783952151.143841:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465554304:0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.143854:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465554816:0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.143864:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465554688:0@lo:400:kworker.0 00000100:00100000:3.0:1783952151.143899:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465554560:0@lo:400:kworker.0 00000100:00100000:2.0:1783952151.146287:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.146341:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04671e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465554944:0@lo:400:kworker.0 00000100:00100000:2.0:1783952151.146384:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.146446:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465554432 00000100:00100000:2.0:1783952151.146455:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465554432 00000100:00100000:2.0:1783952151.146525:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830 00000100:00100000:2.0:1783952151.146534:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465554432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952151.146612:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465554432:12345-0@lo:400:kworker.0 Request processed in 79us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952151.146629:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830 00000100:00100000:2.0:1783952151.146670:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465554944 00000100:00100000:2.0:1783952151.146675:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465554944 00000100:00100000:2.0:1783952151.146702:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1783952151.146710:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465554944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952151.146762:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465554944:12345-0@lo:400:kworker.0 Request processed in 54us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952151.146767:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1783952151.146810:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465554432:0@lo:400:kworker.0 00000100:00100000:2.0:1783952151.146822:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04671e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465554944:0@lo:400:kworker.0 00000100:00100000:0.0:1783952151.147325:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465553792:12345-0@lo:400:kworker.0 Request processed in 6367us (7281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.147336:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1783952151.151892:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465553792:0@lo:400:kworker.0 00000100:00100000:1.0:1783952151.152152:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465554176 00000100:00100000:1.0:1783952151.152163:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465554176 00000100:00100000:1.0:1783952151.152245:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1783952151.152255:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465554176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952151.152381:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465554176:12345-0@lo:400:kworker.0 Request processed in 128us (9512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952151.152389:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00080000:3.0:1783952151.153423:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952151.153434:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952151.153438:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783952151.153441:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00080000:3.0:1783952151.164579:0:75694:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444092 batchid updated 00000020:00080000:2.0:1783952151.164864:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444092 00000004:00080000:2.0:1783952151.164954:0:75714:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97b049c7f180 with version 15 00000020:00080000:2.0:1783952151.164979:0:75714:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444092 cancel update log [0x2000090a1:0x6:0x0].3: rc = 0 00000020:00080000:2.0:1783952151.165100:0:75714:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444092 cancel update log [0x2400088d0:0x2:0x0].4: rc = 0 00000020:00080000:2.0:1783952151.165113:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444092 00000004:00080000:3.0:1783952151.165211:0:75700:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97b1748af6c0 version 15 rpc_version 15 00000020:00100000:3.0:1783952151.165361:0:75700:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783952151.165376:0:75700:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97b04ab02300 x1870605465555200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952151.165407:0:75700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465555200:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783952151.165840:0:75700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952151.165883:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b16f3969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952151.165958:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465555200 00000100:00100000:2.0:1783952151.165967:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465555200 00000100:00100000:2.0:1783952151.166027:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:2.0:1783952151.166036:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75700:x1870605465555200:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783952151.166463:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75700:x1870605465555200:12345-0@lo:1000:osp_up0-1.0 Request processed in 426us (622us total) trans 120259084291 rc 0/0 00000100:00100000:2.0:1783952151.166564:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:3.0:1783952151.167003:0:75700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465555200:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783952151.167124:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465554176:0@lo:400:kworker.0 00000020:00000080:3.0:1783952151.190704:0:93230:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fffa6e28b50 20000000:00000080:3.0:1783952151.190733:0:93230:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff97b15154e800 uarg=0000000000000000 00000040:00100000:3.0:1783952151.191568:0:93230:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 49 20000000:01000000:3.0:1783952151.191579:0:93230:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:3.0:1783952151.191829:0:93230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:3.0:1783952151.191855:0:93230:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1783952151.191873:0:93230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:3.0:1783952151.191889:0:93230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:3.0:1783952151.191962:0:93230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:3.0:1783952151.191971:0:93230:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1783952151.191986:0:93230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:3.0:1783952151.192000:0:93230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:3.0:1783952151.192134:0:93230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:3.0:1783952151.192144:0:93230:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1783952151.192162:0:93230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:3.0:1783952151.192179:0:93230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:3.0:1783952151.192209:0:93230:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783952151.192347:0:93230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192373:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb5b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a43b expref: 9 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192382:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a442 expref: 9 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192392:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb5baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5ba3 expref: 23 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192399:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b047b2c400/0x22c73c7857bb5bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5bb1 expref: 23 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192406:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b175a14000/0x22c73c7857bb5bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5bbf expref: 23 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192413:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b18216a400/0x22c73c7857bb5bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5bcd expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192419:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5bdb expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192427:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5be9 expref: 23 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192435:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5bf7 expref: 23 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192441:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb5c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c05 expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192455:0:93230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b047b2dc00/0x22c73c7857bb5c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c13 expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192464:0:93230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192677:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b047b2dc00/0x22c73c7857bb5c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5c13 expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192701:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b047b2dc00/0x22c73c7857bb5c1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5c13 expref: 23 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.192720:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465555328:0@lo:104: 00000100:00100000:3.0:1783952151.192812:0:93230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783952151.192955:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb5c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5c05 expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.192964:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb5c0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5c05 expref: 23 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.192973:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465555456:0@lo:104: 00000100:00100000:3.0:1783952151.192999:0:93230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783952151.193127:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5bf7 expref: 23 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.193135:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5bfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5bf7 expref: 23 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.193143:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465555584:0@lo:104: 00000100:00100000:3.0:1783952151.193176:0:93230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952151.193419:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465555328 00000100:00100000:0.0:1783952151.193428:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465555328 00000100:00100000:0.0:1783952151.193504:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465555456 00000100:00100000:0.0:1783952151.193508:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465555456 00000100:00100000:0.0:1783952151.193527:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1783952151.193538:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:93230:x1870605465555328:12345-0@lo:104: 00010000:00010000:0.0:1783952151.193555:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.193666:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783952151.193672:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:93230:x1870605465555328:12345-0@lo:104: Request processed in 138us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.193688:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1783952151.193710:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1783952151.193716:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:93230:x1870605465555456:12345-0@lo:104: 00010000:00010000:0.0:1783952151.193725:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.193761:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783952151.193766:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:93230:x1870605465555456:12345-0@lo:104: Request processed in 51us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.193772:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00010000:0.0:1783952151.193794:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952151.193800:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.193808:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15000 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952151.193813:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.193823:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952151.193831:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952151.193838:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952151.193873:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.193881:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952151.193915:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.193922:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a15000/0x22c73c7857bb5c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5c1a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.193938:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952151.193941:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.193947:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2ce00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952151.193950:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.193956:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952151.193961:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952151.193966:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952151.193980:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.193986:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952151.194005:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.194011:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5c0c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.194020:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952151.194026:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952151.194028:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952151.194035:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952151.194191:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465555712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952151.194229:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952151.194627:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465555840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952151.194667:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.194760:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465555712 00000100:00100000:2.0:1783952151.194768:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465555712 00010000:00010000:2.0:1783952151.194803:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b047b2dc00/0x22c73c7857bb5c1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5c13 expref: 24 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.194849:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465555840 00000100:00100000:2.0:1783952151.194853:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465555840 00010000:00010000:2.0:1783952151.194870:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb5c0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5c05 expref: 25 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.194891:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1783952151.194899:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3645:x1870605465555712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952151.194914:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952151.194920:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b047b2dc00/0x22c73c7857bb5c1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5c13 expref: 25 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.194931:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b047b2dc00/0x22c73c7857bb5c1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5c13 expref: 25 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.194954:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952151.194992:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3645:x1870605465555712:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952151.194998:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1783952151.195016:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1783952151.195021:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465555840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952151.195028:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952151.195033:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb5c0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5c05 expref: 24 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.195040:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb5c0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5c05 expref: 24 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.195049:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952151.195096:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465555840:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952151.195103:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1783952151.195151:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465555840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.195181:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465555712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952151.195521:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5be9 expref: 23 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.195534:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5be9 expref: 23 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.195545:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14474ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465555968:0@lo:104: 00000100:00100000:3.0:1783952151.195579:0:93230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783952151.195629:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5bdb expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.195638:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5be2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5bdb expref: 23 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.195657:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556096:0@lo:104: 00000100:00100000:3.0:1783952151.195678:0:93230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783952151.195696:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b18216a400/0x22c73c7857bb5bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5bcd expref: 23 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.195704:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b18216a400/0x22c73c7857bb5bd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5bcd expref: 23 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.195712:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556224:0@lo:104: 00000100:00100000:3.0:1783952151.195740:0:93230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783952151.195758:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b175a14000/0x22c73c7857bb5bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5bbf expref: 23 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.195766:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b175a14000/0x22c73c7857bb5bc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5bbf expref: 23 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.195788:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556352:0@lo:104: 00010000:00010000:3.0:1783952151.195819:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b047b2c400/0x22c73c7857bb5bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5bb1 expref: 23 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.195828:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b047b2c400/0x22c73c7857bb5bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5bb1 expref: 23 pid: 92499 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.195836:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556480:0@lo:104: 00010000:00010000:3.0:1783952151.195863:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb5baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5ba3 expref: 23 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.195871:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb5baa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5ba3 expref: 23 pid: 92497 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.195878:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556608:0@lo:104: 00010000:00010000:3.0:1783952151.195906:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a442 expref: 9 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.195913:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5b9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a442 expref: 9 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.195923:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556736:192.168.202.48@tcp:104: 00010000:00010000:3.0:1783952151.195989:0:93230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb5b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a43b expref: 9 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.195997:0:93230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb5b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a43b expref: 9 pid: 92497 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.196016:0:93230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556864:192.168.202.48@tcp:104: 00000100:00100000:3.0:1783952151.196043:0:93230:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b160019900 going to sleep for 11 seconds 00000100:00100000:0.0:1783952151.196501:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783952151.196523:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952151.196535:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952151.196543:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952151.196551:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465555584 00000100:00100000:0.0:1783952151.196555:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465555584 00000100:00100000:0.0:1783952151.196604:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465555968 00000100:00100000:0.0:1783952151.196607:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465555968 00000100:00100000:0.0:1783952151.196619:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465556096 00000100:00100000:0.0:1783952151.196622:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465556096 00000100:00100000:0.0:1783952151.196635:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465556224 00000100:00100000:0.0:1783952151.196638:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465556224 00000100:00100000:0.0:1783952151.196662:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465556352 00000100:00100000:0.0:1783952151.196666:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465556352 00000100:00100000:0.0:1783952151.196679:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465556480 00000100:00100000:0.0:1783952151.196682:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465556480 00000100:00100000:0.0:1783952151.196691:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465556608 00000100:00100000:0.0:1783952151.196693:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465556608 00000100:00100000:0.0:1783952151.196705:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1783952151.196712:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:93230:x1870605465555584:12345-0@lo:104: 00010000:00010000:0.0:1783952151.196726:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.196779:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783952151.196793:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:93230:x1870605465555584:12345-0@lo:104: Request processed in 82us (3616us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.196800:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1783952151.196817:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783952151.196823:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:93230:x1870605465555968:12345-0@lo:104: 00010000:00010000:0.0:1783952151.196830:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.196865:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783952151.196870:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:93230:x1870605465555968:12345-0@lo:104: Request processed in 49us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.196877:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783952151.196889:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783952151.196894:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:93230:x1870605465556096:12345-0@lo:104: 00010000:00010000:0.0:1783952151.196902:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.196934:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783952151.196939:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:93230:x1870605465556096:12345-0@lo:104: Request processed in 45us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.196945:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783952151.196958:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1783952151.196964:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b63c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:93230:x1870605465556224:12345-0@lo:104: 00010000:00010000:0.0:1783952151.196971:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197001:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783952151.197012:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b63c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:93230:x1870605465556224:12345-0@lo:104: Request processed in 49us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.197017:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1783952151.197053:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1783952151.197060:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:93230:x1870605465556352:12345-0@lo:104: 00010000:00010000:0.0:1783952151.197069:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197096:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783952151.197100:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:93230:x1870605465556352:12345-0@lo:104: Request processed in 42us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.197107:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1783952151.197118:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1783952151.197123:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:93230:x1870605465556480:12345-0@lo:104: 00010000:00010000:0.0:1783952151.197131:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197159:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1783952151.197164:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:93230:x1870605465556480:12345-0@lo:104: Request processed in 41us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.197169:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1783952151.197180:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1783952151.197185:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:93230:x1870605465556608:12345-0@lo:104: 00010000:00010000:0.0:1783952151.197193:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197219:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1783952151.197228:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:93230:x1870605465556608:12345-0@lo:104: Request processed in 43us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.197412:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00010000:0.0:1783952151.197437:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783952151.197444:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197452:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a800 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952151.197457:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197522:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952151.197532:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952151.197539:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952151.197579:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197608:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952151.197632:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197639:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a800/0x22c73c7857bb5bf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bfe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197665:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783952151.197668:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197685:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b200 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952151.197688:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197695:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952151.197700:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952151.197705:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952151.197720:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197726:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952151.197737:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197744:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216b200/0x22c73c7857bb5be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197754:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783952151.197757:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197763:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15800 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952151.197766:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197783:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952151.197790:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952151.197795:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952151.197809:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197816:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952151.197822:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197829:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb5bdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5be2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197840:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783952151.197844:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197849:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2de00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952151.197852:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197859:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952151.197865:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952151.197877:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952151.197890:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197896:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952151.197902:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197909:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197919:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783952151.197922:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197927:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952151.197930:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197938:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952151.197943:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952151.197948:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952151.197960:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197966:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952151.197978:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197983:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb5bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bc6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.197991:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952151.197994:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.198000:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15600 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952151.198003:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.198009:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952151.198016:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952151.198021:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952151.198033:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.198038:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952151.198043:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.198049:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5bb8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.198057:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952151.198067:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.198074:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b800 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952151.198077:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.198084:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952151.198090:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952151.198096:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952151.198109:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.198115:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952151.198119:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.198126:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216b800/0x22c73c7857bb5ba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5baa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.198140:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952151.198142:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952151.198145:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952151.198155:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952151.198162:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952151.198181:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952151.198199:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465556992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952151.198581:0:93230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b047b2dc00/0x22c73c7857bb5c1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5c13 expref: 23 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.198616:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465555328:0@lo:104: 00010000:00010000:3.0:1783952151.198680:0:93230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb5c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5c05 expref: 22 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952151.198689:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465555456:0@lo:104: 00000100:00100000:3.0:1783952151.198702:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465555584:0@lo:104: 00000100:00100000:3.0:1783952151.198711:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14474ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465555968:0@lo:104: 00000100:00100000:3.0:1783952151.198720:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556096:0@lo:104: 00000100:00100000:3.0:1783952151.198729:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556224:0@lo:104: 00000100:00100000:3.0:1783952151.198737:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556352:0@lo:104: 00000100:00100000:3.0:1783952151.198745:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556480:0@lo:104: 00000100:00100000:3.0:1783952151.198754:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556608:0@lo:104: 00000100:00100000:2.0:1783952151.198945:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465557120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.199001:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.199050:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465557632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.199073:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.199100:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783952151.199107:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465557248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.199130:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.199146:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465557760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.199165:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.199196:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465557120 00000100:00100000:2.0:1783952151.199203:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465557120 00010000:00010000:2.0:1783952151.199251:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5be9 expref: 22 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.199346:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465557632 00000100:00100000:2.0:1783952151.199351:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465557632 00010000:00010000:2.0:1783952151.199364:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b047b2c400/0x22c73c7857bb5bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5bb1 expref: 23 pid: 92499 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.199383:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465557248 00000100:00100000:2.0:1783952151.199386:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465557248 00010000:00010000:2.0:1783952151.199397:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5be2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5bdb expref: 24 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.199422:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465557760 00000100:00100000:2.0:1783952151.199425:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465557760 00010000:00010000:2.0:1783952151.199439:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb5baa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5ba3 expref: 25 pid: 92497 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.199453:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1783952151.199461:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3644:x1870605465557120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952151.199488:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952151.199494:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5be9 expref: 25 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199504:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5be9 expref: 25 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199522:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a000/0x22c73c7857bb5bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5be9 expref: 25 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199537:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952151.199573:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465557120:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952151.199580:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1783952151.199628:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1783952151.199634:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1472bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3644:x1870605465557632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952151.199652:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952151.199657:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b047b2c400/0x22c73c7857bb5bb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5bb1 expref: 23 pid: 92499 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199666:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b047b2c400/0x22c73c7857bb5bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5bb1 expref: 23 pid: 92499 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199683:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b047b2c400/0x22c73c7857bb5bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5bb1 expref: 23 pid: 92499 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199693:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952151.199716:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1472bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3644:x1870605465557632:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952151.199722:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1783952151.199770:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:2.0:1783952151.199775:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3644:x1870605465557248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952151.199784:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952151.199788:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5be2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5bdb expref: 21 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199797:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5bdb expref: 21 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199806:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5be2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5bdb expref: 21 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199815:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952151.199836:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3644:x1870605465557248:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952151.199842:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:2.0:1783952151.199854:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:2.0:1783952151.199860:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3644:x1870605465557760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952151.199867:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952151.199871:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb5baa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5ba3 expref: 19 pid: 92497 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199885:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb5baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5ba3 expref: 19 pid: 92497 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199895:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb5baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5ba3 expref: 19 pid: 92497 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.199904:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952151.199927:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:3644:x1870605465557760:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952151.199933:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:2.0:1783952151.199973:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465557376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.200000:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.200052:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465557248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.200062:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465557760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.200068:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465557120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.200075:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465557632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.200103:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465557376 00000100:00100000:2.0:1783952151.200106:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465557376 00010000:00010000:2.0:1783952151.200121:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b18216a400/0x22c73c7857bb5bd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5bcd expref: 18 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.200140:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:2.0:1783952151.200146:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:3642:x1870605465557376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952151.200153:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952151.200162:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b18216a400/0x22c73c7857bb5bd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5bcd expref: 18 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.200169:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b18216a400/0x22c73c7857bb5bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5bcd expref: 18 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.200179:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a400/0x22c73c7857bb5bd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5bcd expref: 18 pid: 92498 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.200186:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952151.200214:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:3642:x1870605465557376:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952151.200220:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:2.0:1783952151.200245:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465557376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952151.201970:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952151.202018:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465557504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952151.202051:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.202464:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465556992 00000100:00100000:2.0:1783952151.202520:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465556992 00010000:00010000:2.0:1783952151.202555:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5bfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5bf7 expref: 17 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.202584:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465557504 00000100:00100000:2.0:1783952151.202602:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465557504 00010000:00010000:2.0:1783952151.202609:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b175a14000/0x22c73c7857bb5bc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5bbf expref: 18 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.202623:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:2.0:1783952151.202629:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:3643:x1870605465556992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952151.202641:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952151.202659:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5bfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5bf7 expref: 18 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.202691:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5bf7 expref: 18 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.202711:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5bfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5bf7 expref: 18 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952151.202726:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952151.203668:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:0.0:1783952151.203687:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:3643:x1870605465557504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952151.203703:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952151.203711:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b175a14000/0x22c73c7857bb5bc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5bbf expref: 17 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.203724:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b175a14000/0x22c73c7857bb5bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5bbf expref: 17 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.203738:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b175a14000/0x22c73c7857bb5bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5bbf expref: 17 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.203814:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952151.203869:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:3643:x1870605465557504:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.203877:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:0.0:1783952151.203935:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465557504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.204032:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:3643:x1870605465556992:12345-0@lo:103:ldlm_bl.0 Request processed in 1401us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952151.204039:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:0.0:1783952151.204453:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465556992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952151.204671:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952151.204827:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556864:192.168.202.48@tcp:104: 00000100:00100000:0.0:1783952151.205108:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447764992 00000100:00100000:0.0:1783952151.205115:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447764992 00010000:00010000:0.0:1783952151.205148:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb5b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a43b expref: 10 pid: 92497 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952151.205183:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2576 00000100:00100000:0.0:1783952151.205208:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447764992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783952151.205222:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952151.205228:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb5b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a43b expref: 10 pid: 92497 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.205396:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb5b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a43b expref: 10 pid: 92497 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.205414:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb5b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a43b expref: 10 pid: 92497 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.205430:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952151.205560:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e617e28a-7c0f-459e-8765-f628898cec50+9:2400:x1870605447764992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 352us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.205570:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2576 00000100:00100000:3.0:1783952151.207081:0:93230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93230:1870605465556736:192.168.202.48@tcp:104: 00010000:00010000:3.0:1783952151.207204:0:93230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.209994:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952151.210926:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447765120 00000100:00100000:0.0:1783952151.210944:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447765120 00010000:00010000:0.0:1783952151.211002:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5b9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a442 expref: 9 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952151.211086:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2577 00000100:00100000:0.0:1783952151.211098:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15628d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e617e28a-7c0f-459e-8765-f628898cec50+9:2401:x1870605447765120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783952151.211120:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952151.211128:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5b9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a442 expref: 9 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211142:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a442 expref: 9 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211198:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5b9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a442 expref: 9 pid: 92502 timeout: 3966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211220:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211238:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211424:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211432:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211439:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211446:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211452:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952151.211457:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211475:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211498:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952151.211524:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952151.211694:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15628d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e617e28a-7c0f-459e-8765-f628898cec50+8:2401:x1870605447765120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 596us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952151.211702:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2577 00010000:00010000:3.0:1783952151.211828:0:93230:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.211849:0:93230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952151.211856:0:93230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c21 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952151.648950:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465557888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952151.649071:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952151.649690:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952151.649704:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465558016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952151.649742:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952151.650000:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465557888 00000100:00100000:0.0:1783952151.650011:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465557888 00000100:00100000:0.0:1783952151.654657:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465558016 00000100:00100000:0.0:1783952151.654683:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465558016 00000100:00100000:1.0:1783952151.654826:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:1.0:1783952151.654847:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465557888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783952151.654899:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952151.655035:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465557888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (5963us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952151.655044:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:1.0:1783952151.655067:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210 00000100:00100000:1.0:1783952151.655074:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465558016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952151.655106:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952151.655137:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465558016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (5395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952151.655153:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210 00000100:00100000:3.0:1783952151.655262:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465558016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952151.655283:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465557888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952152.047063:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952152.047111:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952152.047152:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952152.047188:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952152.047314:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447765248 00000100:00100000:3.0:1783952152.047335:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447765248 00000100:00100000:3.0:1783952152.047397:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 125 00000100:00100000:3.0:1783952152.047407:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+8:2399:x1870605447765248:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952152.047484:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+8:2399:x1870605447765248:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952152.047491:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 125 00000100:00100000:0.0:1783952152.048120:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447765632 00000100:00100000:0.0:1783952152.048128:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447765632 00000100:00100000:0.0:1783952152.048192:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2831 00000100:00100000:0.0:1783952152.048200:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447765632:12345-192.168.202.48@tcp:400:kworker.0 00000100:00080000:3.0:1783952152.048490:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952152.048522:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447765376 00000100:00100000:3.0:1783952152.048526:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447765376 00000100:00100000:3.0:1783952152.048665:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447765504 00000100:00100000:3.0:1783952152.048669:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447765504 00000100:00100000:3.0:1783952152.048694:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1360 00000100:00100000:3.0:1783952152.048701:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2399:x1870605447765376:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952152.048756:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2399:x1870605447765376:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 55us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952152.048764:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1360 00000100:00100000:3.0:1783952152.048791:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1361 00000100:00100000:3.0:1783952152.048796:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447765504:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952152.048822:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447765504:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952152.048827:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1361 00000100:00080000:3.0:1783952152.048841:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952152.048843:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952152.049310:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447765632:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 1110us (2197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952152.049318:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2831 00010000:00010000:0.0:1783952152.096990:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952152.622279:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952152.622525:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447765760 00000100:00100000:1.0:1783952152.622535:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447765760 00000100:00100000:1.0:1783952152.622652:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 126 00000100:00100000:1.0:1783952152.622664:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447765760:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952152.622696:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952152.622717:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70600/0x22c73c7857bb5c28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a449 expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952152.622761:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70600/0x22c73c7857bb5c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a449 expref: 9 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952152.622774:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70600/0x22c73c7857bb5c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a449 expref: 9 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952152.622783:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70600, rc 0) 00000100:00100000:1.0:1783952152.622850:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447765760:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 188us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952152.622858:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 126 00000100:00100000:1.0:1783952152.625658:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952152.625755:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447765888 00000100:00100000:0.0:1783952152.625765:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447765888 00000100:00100000:0.0:1783952152.625820:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 127 00000100:00100000:0.0:1783952152.625830:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447765888:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952152.626017:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447765888:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 188us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952152.626292:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 127 00000100:00100000:2.0:1783952152.633458:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952152.633564:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447766016 00000100:00100000:0.0:1783952152.633573:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447766016 00000100:00100000:1.0:1783952152.638518:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 128 00000100:00100000:1.0:1783952152.638537:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447766016:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952152.640252:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447766016:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 1712us (6794us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952152.640267:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 128 00000100:00100000:2.0:1783952152.655505:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952152.656143:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447766144 00000100:00100000:0.0:1783952152.656192:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447766144 00000100:00100000:0.0:1783952152.656257:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 129 00000100:00100000:0.0:1783952152.656269:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+9:71967:x1870605447766144:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783952152.656508:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e617e28a-7c0f-459e-8765-f628898cec50+9:71967:x1870605447766144:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 240us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952152.656518:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 129 00000100:00100000:0.0:1783952152.664507:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952152.664665:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447766272 00000100:00100000:3.0:1783952152.664676:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447766272 00000100:00100000:3.0:1783952152.664789:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 130 00000100:00100000:3.0:1783952152.664799:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:71967:x1870605447766272:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783952152.664957:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:71967:x1870605447766272:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 159us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952152.664964:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 130 00000100:00100000:2.0:1783952152.674862:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952152.675259:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447766400 00000100:00100000:1.0:1783952152.675270:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447766400 00000100:00100000:1.0:1783952152.675335:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 131 00000100:00100000:1.0:1783952152.675347:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447766400:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952152.675368:0:92499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952152.675390:0:92499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71c00/0x22c73c7857bb5c2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a450 expref: -99 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952152.675437:0:92499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71c00/0x22c73c7857bb5c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a450 expref: 10 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952152.675448:0:92499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71c00/0x22c73c7857bb5c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a450 expref: 10 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952152.675457:0:92499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71c00, rc 0) 00000100:00100000:1.0:1783952152.675524:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447766400:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 180us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952152.675533:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 131 00000100:00100000:2.0:1783952152.680099:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952152.680463:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447766528 00000100:00100000:1.0:1783952152.680473:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447766528 00000100:00100000:1.0:1783952152.680578:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 132 00000100:00100000:1.0:1783952152.680645:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447766528:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952152.680773:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447766528:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 187us (684us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783952152.680782:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 132 00010000:00010000:0.0:1783952153.120886:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783952153.184749:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783952153.184757:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174b36000 from 55 10000000:01000000:0.0:1783952153.184762:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783952153.184814:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952153.184826:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952153.184838:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952153.184864:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465558144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952153.185076:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952153.185115:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522af000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.185260:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465558144 00000100:00100000:3.0:1783952153.185268:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465558144 00000100:00100000:3.0:1783952153.185530:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783952153.185539:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465558144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.185553:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1783952153.185557:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783952153.185566:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5c36 expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952153.185574:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465558272:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783952153.185614:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5c36 expref: 16 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.185634:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c36 expref: 16 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952153.185644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783952153.185661:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216a600, rc 0) 00000100:00100000:2.0:1783952153.185682:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465558272 00000100:00100000:2.0:1783952153.185687:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465558272 00000100:00100000:3.0:1783952153.185702:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465558144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.185709:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783952153.185738:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211 00000100:00100000:2.0:1783952153.185747:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465558272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952153.185771:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783952153.185806:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952153.185815:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465558272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952153.185824:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211 00000100:00100000:3.0:1783952153.185861:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465558272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952153.185963:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783952153.185974:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465558400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952153.186003:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952153.186035:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465558144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952153.186050:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465558400 00010000:00010000:0.0:1783952153.186053:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952153.186056:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465558400 00010000:00010000:0.0:1783952153.186066:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952153.186092:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212 00000100:00100000:1.0:1783952153.186100:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465558400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952153.186119:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952153.186133:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465558528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952153.186173:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952153.186174:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465558400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952153.186182:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212 00000100:00080000:1.0:1783952153.186201:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952153.186201:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522af000 going to sleep for 11 seconds 00000100:00100000:0.0:1783952153.186226:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465558528 00000100:00100000:0.0:1783952153.186230:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465558528 00000100:00100000:1.0:1783952153.186234:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465558400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952153.186258:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783952153.186265:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465558528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952153.186795:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465558528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 528us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952153.186802:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783952153.187298:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465558528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952153.187345:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465558656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952153.187396:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952153.188188:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b142e676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952153.188603:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465558656 00000100:00100000:0.0:1783952153.188611:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465558656 00000100:00100000:0.0:1783952153.188682:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783952153.188691:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465558656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952153.188827:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465558656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952153.188835:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783952153.190152:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465558656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952153.201223:0:93232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93232:1870605465558784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952153.201321:0:93232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952153.201425:0:93232:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f3f840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952153.201475:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465558784 00000100:00100000:2.0:1783952153.201484:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465558784 00000100:00100000:2.0:1783952153.201621:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783952153.201642:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:93232:x1870605465558784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952153.201785:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:93232:x1870605465558784:12345-0@lo:502:llog_process_th.0 Request processed in 145us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952153.201794:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783952153.201894:0:93232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93232:1870605465558784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952153.201939:0:93232:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93232:1870605465558912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952153.201972:0:93232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952153.202477:0:93232:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f3f840 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.202558:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465558912 00000100:00100000:3.0:1783952153.202564:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465558912 00000100:00100000:3.0:1783952153.202619:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783952153.202636:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:93232:x1870605465558912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.202717:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:93232:x1870605465558912:12345-0@lo:502:llog_process_th.0 Request processed in 90us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.202723:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783952153.202975:0:93232:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93232:1870605465558912:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783952153.203010:0:93232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1783952153.203244:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1783952153.203266:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783952153.203275:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.203286:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952153.203296:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783952153.203298:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:3.0:1783952153.203301:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783952153.203328:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.203347:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.203358:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952153.203376:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.203408:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.203440:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1530b5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952153.203493:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465559040 00000100:00100000:1.0:1783952153.203499:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465559040 00000100:00100000:1.0:1783952153.203532:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783952153.203539:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465559040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952153.203549:0:92498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952153.203567:0:92498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70000/0x22c73c7857bb5c4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5c44 expref: -99 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952153.203634:0:92498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70000/0x22c73c7857bb5c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5c44 expref: 17 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952153.203645:0:92498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70000/0x22c73c7857bb5c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c44 expref: 17 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952153.203652:0:92498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70000, rc 0) 00000100:00100000:1.0:1783952153.203682:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465559040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952153.203688:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783952153.203838:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.203851:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.203861:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952153.203914:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.203940:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.203964:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1530b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.203977:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465559168 00000100:00100000:3.0:1783952153.203980:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465559168 00000100:00100000:3.0:1783952153.204015:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783952153.204021:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465559168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.204117:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465559168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.204123:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783952153.204157:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.204184:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.204217:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.204230:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1530b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.204240:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465559296 00000100:00100000:3.0:1783952153.204243:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465559296 00000100:00100000:3.0:1783952153.204259:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783952153.204264:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465559296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.204334:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465559296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.204340:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783952153.204374:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.204640:0:93233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93233:1870605465559424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.204677:0:93233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.204694:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465559424 00000100:00100000:3.0:1783952153.204698:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465559424 00000100:00100000:3.0:1783952153.204716:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783952153.204722:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:93233:x1870605465559424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.204796:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:93233:x1870605465559424:12345-0@lo:502:llog_process_th.0 Request processed in 74us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.204802:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783952153.204829:0:93233:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.204840:0:93233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93233:1870605465559424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952153.204860:0:93233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952153.204874:0:93233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952153.204877:0:93233:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1783952153.204881:0:93233:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1783952153.204899:0:93233:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:3.0:1783952153.205077:0:93233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93233:1870605465559552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.205108:0:93233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.205126:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465559552 00000100:00100000:3.0:1783952153.205129:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465559552 00000100:00100000:3.0:1783952153.205148:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783952153.205153:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:93233:x1870605465559552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.205207:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:93233:x1870605465559552:12345-0@lo:502:llog_process_th.0 Request processed in 53us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.205213:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783952153.205242:0:93233:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42780 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.205254:0:93233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93233:1870605465559552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952153.205270:0:93233:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952153.205274:0:93233:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952153.205275:0:93233:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1783952153.205280:0:93233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:3.0:1783952153.205319:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:3.0:1783952153.205336:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783952153.205344:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.205353:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952153.205362:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783952153.205371:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b151231000 from 55 10000000:01000000:3.0:1783952153.205374:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783952153.205392:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b400/0x22c73c7857bb5c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.205399:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216b400/0x22c73c7857bb5c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.205408:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216b400/0x22c73c7857bb5c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952153.205421:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.205445:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.205457:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42780 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.205467:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465559680 00000100:00100000:3.0:1783952153.205470:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465559680 00000100:00100000:3.0:1783952153.205489:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783952153.205494:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465559680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.205502:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952153.205512:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216b000/0x22c73c7857bb5c59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5c52 expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.205530:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216b000/0x22c73c7857bb5c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5c52 expref: 18 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.205539:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216b000/0x22c73c7857bb5c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c52 expref: 18 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.205547:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b000, rc 0) 00000100:00100000:3.0:1783952153.205573:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465559680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.205584:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783952153.205650:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.205661:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216b400/0x22c73c7857bb5c52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c59 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.205669:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216b400/0x22c73c7857bb5c52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c59 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952153.205708:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.205730:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.205744:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42780 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.205754:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465559808 00000100:00100000:3.0:1783952153.205757:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465559808 00000100:00100000:3.0:1783952153.205776:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783952153.205781:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465559808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.205862:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465559808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.205868:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783952153.205896:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.205921:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.205952:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.205964:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.205974:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465559936 00000100:00100000:3.0:1783952153.205977:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465559936 00000100:00100000:3.0:1783952153.205996:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783952153.206009:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465559936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.206073:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b68e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465559936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.206080:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783952153.206118:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465559936:0@lo:503:ll_cfg_requeue.0 00000020:01000004:3.0:1783952153.206304:0:93234:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b174b36000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783952153.206308:0:93234:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174b36000 4 00000100:00100000:3.0:1783952153.206429:0:93235:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93235:1870605465560064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.206464:0:93235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.206482:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465560064 00000100:00100000:3.0:1783952153.206485:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465560064 00000100:00100000:3.0:1783952153.206506:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783952153.206512:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:93235:x1870605465560064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.206583:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:93235:x1870605465560064:12345-0@lo:502:llog_process_th.0 Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.206616:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783952153.207861:0:93235:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42780 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.207889:0:93235:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93235:1870605465560064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.207946:0:93235:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93235:1870605465560192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.208142:0:93235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.208210:0:93235:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42780 going to sleep for 11 seconds 00000100:00100000:0.0:1783952153.208264:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465560192 00000100:00100000:0.0:1783952153.208269:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465560192 00000100:00100000:1.0:1783952153.208356:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783952153.208422:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:93235:x1870605465560192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952153.208532:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:93235:x1870605465560192:12345-0@lo:502:llog_process_th.0 Request processed in 167us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952153.208539:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783952153.208654:0:93235:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93235:1870605465560192:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783952153.208676:0:93235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1783952153.208821:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1783952153.208843:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783952153.208852:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216b400/0x22c73c7857bb5c52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c59 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.208862:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216b400/0x22c73c7857bb5c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c59 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952153.208872:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783952153.208874:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:2.0:1783952153.208885:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783952153.208909:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb5c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.208916:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb5c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.208925:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb5c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952153.208941:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465560320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952153.208970:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952153.209006:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b240 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.209188:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465560320 00000100:00100000:3.0:1783952153.209201:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465560320 00000100:00100000:3.0:1783952153.209235:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783952153.209242:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465560320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.209250:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952153.209263:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5c67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5c60 expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.209285:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5c60 expref: 19 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.209295:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c60 expref: 19 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.209304:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216be00, rc 0) 00000100:00100000:3.0:1783952153.209332:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465560320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.209338:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783952153.209412:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465560320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952153.209424:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb5c60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c67 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.209432:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb5c60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c67 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952153.209482:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465560448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952153.209507:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952153.209530:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b240 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.211055:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465560448 00000100:00100000:3.0:1783952153.211066:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465560448 00000100:00100000:3.0:1783952153.211115:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783952153.211123:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465560448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.211284:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465560448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.211291:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783952153.211345:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465560448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.211389:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465560576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.211439:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.211467:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1485a39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.211481:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465560576 00000100:00100000:3.0:1783952153.211485:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465560576 00000100:00100000:3.0:1783952153.211505:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783952153.211511:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465560576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.211632:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465560576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.211638:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783952153.211680:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465560576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.211868:0:93236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93236:1870605465560704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.211898:0:93236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.211917:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465560704 00000100:00100000:3.0:1783952153.211920:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465560704 00000100:00100000:3.0:1783952153.211940:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783952153.211946:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:93236:x1870605465560704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.212017:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:93236:x1870605465560704:12345-0@lo:502:llog_process_th.0 Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.212024:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783952153.212051:0:93236:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1485a39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.212061:0:93236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93236:1870605465560704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952153.212082:0:93236:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952153.212093:0:93236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952153.212095:0:93236:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1783952153.212100:0:93236:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1783952153.212117:0:93236:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:3.0:1783952153.212136:0:93236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93236:1870605465560832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.212170:0:93236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.212188:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465560832 00000100:00100000:3.0:1783952153.212191:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465560832 00000100:00100000:3.0:1783952153.212211:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783952153.212217:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:93236:x1870605465560832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.212272:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:93236:x1870605465560832:12345-0@lo:502:llog_process_th.0 Request processed in 54us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.212278:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783952153.212305:0:93236:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14f13eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.212316:0:93236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93236:1870605465560832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952153.212335:0:93236:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952153.212339:0:93236:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952153.212340:0:93236:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1783952153.212343:0:93236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:3.0:1783952153.212395:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:3.0:1783952153.212414:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783952153.212423:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb5c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c67 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.212433:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb5c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c67 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952153.212443:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783952153.212445:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b046482800 from 55 10000000:01000000:3.0:1783952153.212448:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783952153.212470:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb5c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.212488:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb5c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.212498:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb5c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952153.212509:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465560960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.212533:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.212546:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.212556:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465560960 00000100:00100000:3.0:1783952153.212560:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465560960 00000100:00100000:3.0:1783952153.212615:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783952153.212622:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465560960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.212646:0:92499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952153.212658:0:92499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5c75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5c6e expref: -99 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.212677:0:92499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5c6e expref: 20 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.212687:0:92499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c6e expref: 20 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.212695:0:92499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216ae00, rc 0) 00000100:00100000:3.0:1783952153.212720:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465560960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.212725:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783952153.212756:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465560960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.212766:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb5c6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c75 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.212775:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb5c6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c75 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952153.212809:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.212828:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.212838:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.212846:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465561088 00000100:00100000:3.0:1783952153.212849:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465561088 00000100:00100000:3.0:1783952153.212865:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783952153.212869:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465561088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.212938:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465561088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.212945:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783952153.212970:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.212991:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.213017:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.213028:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.213036:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465561216 00000100:00100000:3.0:1783952153.213039:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465561216 00000100:00100000:3.0:1783952153.213054:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783952153.213059:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465561216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.213115:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465561216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.213125:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783952153.213153:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.213352:0:93237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93237:1870605465561344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.213383:0:93237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.213401:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465561344 00000100:00100000:3.0:1783952153.213405:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465561344 00000100:00100000:3.0:1783952153.213427:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783952153.213433:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:93237:x1870605465561344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.213500:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:93237:x1870605465561344:12345-0@lo:502:llog_process_th.0 Request processed in 67us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.213505:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783952153.213531:0:93237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.213543:0:93237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93237:1870605465561344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.213574:0:93237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93237:1870605465561472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.213637:0:93237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.213657:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465561472 00000100:00100000:3.0:1783952153.213660:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465561472 00000100:00100000:3.0:1783952153.213680:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783952153.213685:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:93237:x1870605465561472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.213739:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:93237:x1870605465561472:12345-0@lo:502:llog_process_th.0 Request processed in 54us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.213745:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783952153.213769:0:93237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.213779:0:93237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93237:1870605465561472:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783952153.213801:0:93237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1783952153.213840:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1783952153.213856:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783952153.213864:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb5c6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c75 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.213871:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb5c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c75 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952153.213879:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783952153.213881:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783952153.213884:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783952153.213902:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb5c7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.213910:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb5c7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.213918:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb5c7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952153.213929:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.213953:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.213965:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.213975:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465561600 00000100:00100000:3.0:1783952153.213978:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465561600 00000100:00100000:3.0:1783952153.213997:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783952153.214002:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465561600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.214009:0:92499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952153.214027:0:92499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216b800/0x22c73c7857bb5c83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5c7c expref: -99 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.214045:0:92499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216b800/0x22c73c7857bb5c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5c7c expref: 21 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.214052:0:92499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216b800/0x22c73c7857bb5c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c7c expref: 21 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.214058:0:92499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b800, rc 0) 00000100:00100000:3.0:1783952153.214083:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465561600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.214088:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783952153.214118:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.214128:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb5c7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c83 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.214134:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb5c7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c83 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952153.214169:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.214193:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.214204:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.214214:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465561728 00000100:00100000:3.0:1783952153.214217:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465561728 00000100:00100000:3.0:1783952153.214235:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783952153.214240:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465561728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.214319:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465561728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.214331:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783952153.214363:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.214384:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.214416:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.214428:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694900 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.214438:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465561856 00000100:00100000:3.0:1783952153.214441:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465561856 00000100:00100000:3.0:1783952153.214460:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783952153.214465:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16586a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465561856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.214529:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16586a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465561856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.214535:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783952153.214568:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952153.219835:0:93238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1783952153.220536:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1783952153.220568:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783952153.220580:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb5c7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c83 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.220696:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb5c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c83 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952153.220713:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783952153.220716:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174849000 from 55 10000000:01000000:2.0:1783952153.220719:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783952153.220760:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15c00/0x22c73c7857bb5c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.220769:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a15c00/0x22c73c7857bb5c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.220781:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a15c00/0x22c73c7857bb5c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952153.220807:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952153.220876:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952153.220913:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b900 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.221521:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465561984 00000100:00100000:3.0:1783952153.221529:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465561984 00000100:00100000:3.0:1783952153.221692:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783952153.221704:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465561984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.221719:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952153.221733:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b18216b200/0x22c73c7857bb5c91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5c8a expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.221757:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b18216b200/0x22c73c7857bb5c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5c8a expref: 22 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.221767:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b18216b200/0x22c73c7857bb5c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c8a expref: 22 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.221782:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b18216b200, rc 0) 00000100:00100000:3.0:1783952153.221835:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465561984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.221842:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783952153.222194:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465561984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952153.222210:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a15c00/0x22c73c7857bb5c8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c91 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952153.222220:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a15c00/0x22c73c7857bb5c8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c91 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952153.222289:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465562112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952153.222318:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952153.222351:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1522af240 going to sleep for 11 seconds 00000100:00100000:2.0:1783952153.222398:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465562112 00000100:00100000:2.0:1783952153.222402:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465562112 00000100:00100000:2.0:1783952153.222438:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783952153.222444:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465562112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952153.222942:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465562112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 497us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952153.222950:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783952153.223072:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465562112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952153.223112:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465562240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952153.223156:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952153.223215:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f3f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952153.223333:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465562240 00000100:00100000:2.0:1783952153.223338:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465562240 00000100:00100000:2.0:1783952153.223370:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783952153.223377:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465562240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952153.223459:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465562240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952153.223470:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783952153.223530:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465562240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952153.224042:0:93239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93239:1870605465562368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952153.224081:0:93239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952153.224109:0:93239:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1512d3840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952153.224207:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465562368 00000100:00100000:2.0:1783952153.224212:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465562368 00000100:00100000:2.0:1783952153.224244:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783952153.224251:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:93239:x1870605465562368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952153.224336:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160517050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:93239:x1870605465562368:12345-0@lo:502:llog_process_th.0 Request processed in 86us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952153.224343:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783952153.224413:0:93239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93239:1870605465562368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.224454:0:93239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93239:1870605465562496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952153.224484:0:93239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.224505:0:93239:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952153.224544:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465562496 00000100:00100000:2.0:1783952153.224548:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465562496 00000100:00100000:2.0:1783952153.224577:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783952153.224583:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:93239:x1870605465562496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952153.224694:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:93239:x1870605465562496:12345-0@lo:502:llog_process_th.0 Request processed in 111us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952153.224701:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783952153.225070:0:93239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:93239:1870605465562496:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783952153.225091:0:93239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1783952153.226248:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1783952153.226275:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783952153.226286:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15c00/0x22c73c7857bb5c8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c91 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.226298:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a15c00/0x22c73c7857bb5c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c91 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952153.226307:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783952153.226309:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1783952153.226312:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783952153.226354:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb5c98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.226370:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb5c98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.226380:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb5c98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952153.226401:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465562624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952153.226451:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952153.226480:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144984cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952153.226770:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465562624 00000100:00100000:0.0:1783952153.226777:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465562624 00000100:00100000:0.0:1783952153.226825:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783952153.226832:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465562624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952153.226843:0:92503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952153.226855:0:92503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b047b2c600/0x22c73c7857bb5c9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5c98 expref: -99 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952153.226876:0:92503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2c600/0x22c73c7857bb5c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5c98 expref: 23 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952153.226885:0:92503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b047b2c600/0x22c73c7857bb5c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5c98 expref: 23 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952153.226893:0:92503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2c600, rc 0) 00000100:00100000:0.0:1783952153.226923:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465562624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952153.226929:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783952153.228184:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465562624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952153.228203:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb5c98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c9f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.228214:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb5c98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c9f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952153.228288:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465562752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952153.228340:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952153.228376:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144984cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952153.229126:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465562752 00000100:00100000:3.0:1783952153.229133:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465562752 00000100:00100000:3.0:1783952153.229177:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783952153.229185:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160517450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465562752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.229320:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160517450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465562752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952153.229337:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783952153.229844:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465562752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952153.229887:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465562880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952153.229928:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952153.229952:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144984cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952153.233234:0:92503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465562880 00000100:00100000:0.0:1783952153.233248:0:92503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465562880 00000100:00100000:0.0:1783952153.235281:0:92503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783952153.235300:0:92503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465562880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952153.235474:0:92503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465562880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (5544us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952153.235482:0:92503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783952153.236155:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465562880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952153.239407:0:93241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1783952153.239872:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1783952153.239907:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783952153.239917:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb5c98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c9f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.239928:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb5c98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c9f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952153.239938:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783952153.239941:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97b167c90000 from 1 10000000:01000000:2.0:1783952153.239943:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783952153.239981:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5ca6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.240071:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5ca6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952153.240082:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5ca6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952153.240107:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465563008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952153.240174:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952153.240218:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144984cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952153.240739:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465563008 00000100:00100000:1.0:1783952153.240747:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465563008 00000100:00100000:1.0:1783952153.240799:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783952153.240808:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160514050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465563008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952153.240824:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952153.240839:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71800/0x22c73c7857bb5cad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5ca6 expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952153.240865:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71800/0x22c73c7857bb5cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5ca6 expref: 24 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952153.240891:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71800/0x22c73c7857bb5cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5ca6 expref: 24 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952153.240900:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71800, rc 0) 00000100:00100000:1.0:1783952153.240951:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160514050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465563008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952153.240957:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783952153.244919:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465563008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952153.244948:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5ca6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5cad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.244961:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5ca6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5cad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952153.245919:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465563136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952153.245984:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952153.246442:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1766949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952153.246719:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465563136 00000100:00100000:1.0:1783952153.246801:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465563136 00000100:00100000:1.0:1783952153.246853:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783952153.246862:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465563136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952153.246960:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465563136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (976us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783952153.246967:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783952153.247117:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465563136:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783952153.247156:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783952153.247165:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5ca6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5cad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952153.247176:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5ca6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5cad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.147535:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952154.446191:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952154.446283:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447766656 00000100:00100000:0.0:1783952154.446294:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447766656 00000100:00100000:0.0:1783952154.446390:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1363 00000100:00100000:0.0:1783952154.446401:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71987:x1870605447766656:12345-192.168.202.48@tcp:101:mkdir.0 00010000:00010000:0.0:1783952154.446425:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952154.446449:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5cb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a457 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.446517:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5cbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.446533:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.446544:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952154.446637:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783952154.446641:0:67035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783952154.446676:0:67035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.446720:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5cb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a457 expref: 8 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.446737:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5cbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a457 expref: 7 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.446746:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:0.0:1783952154.446749:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783952154.446752:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2da00, rc 0) 00000100:00100000:0.0:1783952154.446808:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71987:x1870605447766656:12345-192.168.202.48@tcp:101:mkdir.0 Request processed in 410us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952154.446816:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1363 00000100:00080000:3.0:1783952154.447316:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952154.451038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.451111:0:66258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447766784 00000100:00100000:3.0:1783952154.451131:0:66258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447766784 00000100:00100000:3.0:1783952154.451190:0:66258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:3.0:1783952154.451200:0:66258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71987:x1870605447766784:12345-192.168.202.48@tcp:700:mkdir.0 00000100:00100000:3.0:1783952154.451297:0:66258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71987:x1870605447766784:12345-192.168.202.48@tcp:700:mkdir.0 Request processed in 98us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.451319:0:66258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 15 00000100:00100000:0.0:1783952154.456918:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.458795:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447767040 00000100:00100000:3.0:1783952154.458810:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447767040 00000100:00100000:3.0:1783952154.458887:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1364 00000100:00100000:3.0:1783952154.458898:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71987:x1870605447767040:12345-192.168.202.48@tcp:36:mkdir.0 00010000:00010000:3.0:1783952154.458959:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952154.458987:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5cbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a457 expref: 7 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.459021:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952154.459026:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952154.459090:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.459104:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.459114:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.459132:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.459139:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.459146:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463199:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463222:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463234:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952154.463251:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6583f84 reply state 00000000ef2ef980 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463264:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463271:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b164ef8c00) 00010000:00010000:0.0:1783952154.463281:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952154.463286:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783952154.463292:0:68591:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783952154.463304:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463311:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463318:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463326:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463333:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952154.463337:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463346:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463372:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:0.0:1783952154.463375:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952154.463379:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463386:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b18216a800/0x22c73c7857bb5cc2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952154.463399:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6583f84 reply state 00000000ef2ef980 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463420:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.463426:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff97b146f44a00) 00010000:00010000:0.0:1783952154.463428:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952154.463430:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783952154.463532:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71987:x1870605447767040:12345-192.168.202.48@tcp:36:mkdir.0 Request processed in 4631us (6620us total) trans 120259084292 rc 0/0 00000100:00100000:0.0:1783952154.463542:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1364 00000100:00100000:0.0:1783952154.479530:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.484499:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447767168 00000100:00100000:3.0:1783952154.484514:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447767168 00000100:00100000:3.0:1783952154.484578:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1365 00000100:00100000:3.0:1783952154.484610:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71987:x1870605447767168:12345-192.168.202.48@tcp:101:mkdir.0 00010000:00010000:3.0:1783952154.484645:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952154.484666:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a45e expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.484730:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5cde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.484752:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.484763:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952154.484806:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783952154.484810:0:66237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952154.484831:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.484857:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a45e expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.484874:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5cde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a45e expref: 9 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.484883:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952154.484886:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783952154.484889:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a400, rc 0) 00000100:00100000:3.0:1783952154.484954:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:71987:x1870605447767168:12345-192.168.202.48@tcp:101:mkdir.0 Request processed in 367us (5428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.484961:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1365 00000100:00100000:2.0:1783952154.489088:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.489645:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447767424 00000100:00100000:3.0:1783952154.489656:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447767424 00000100:00100000:3.0:1783952154.489724:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1366 00000100:00100000:3.0:1783952154.489735:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:71987:x1870605447767424:12345-192.168.202.48@tcp:101:mkdir.0 00010000:00010000:3.0:1783952154.489757:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952154.489788:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5ce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a465 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.489867:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.489881:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.489904:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.489915:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5cf3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.489922:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.489928:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952154.490033:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783952154.490111:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490119:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490124:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490130:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490146:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ba00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952154.490150:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490157:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490168:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952154.490172:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952154.490176:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490183:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5cec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490196:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490202:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5cf3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490208:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490213:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86be00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952154.490215:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490221:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490238:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff97b146f44a00) 00010000:00010000:3.0:1783952154.490242:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952154.490245:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5cf3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490252:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5cf3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490286:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5ce5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a465 expref: 11 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490295:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952154.490298:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783952154.490302:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5ce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a465 expref: 11 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.490323:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ae00, rc 0) 00000100:00100000:3.0:1783952154.493056:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71987:x1870605447767424:12345-192.168.202.48@tcp:101:mkdir.0 Request processed in 3312us (3963us total) trans 120259084293 rc 301/301 00000100:00100000:3.0:1783952154.493068:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1366 00000100:00100000:3.0:1783952154.502257:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952154.503187:0:66259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447767552 00000100:00100000:2.0:1783952154.503200:0:66259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447767552 00000100:00100000:2.0:1783952154.503264:0:66259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:2.0:1783952154.503276:0:66259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:71987:x1870605447767552:12345-192.168.202.48@tcp:900:mkdir.0 00000100:00080000:3.0:1783952154.503449:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783952154.504762:0:66259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:71987:x1870605447767552:12345-192.168.202.48@tcp:900:mkdir.0 Request processed in 1481us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952154.504773:0:66259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14 00000100:00100000:2.0:1783952154.507611:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952154.507657:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447767808 00000100:00100000:2.0:1783952154.507667:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447767808 00000100:00100000:2.0:1783952154.507717:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 240 00000100:00100000:2.0:1783952154.507738:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177062850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71987:x1870605447767808:12345-192.168.202.48@tcp:35:mkdir.0 00000100:00100000:2.0:1783952154.507970:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177062850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:71987:x1870605447767808:12345-192.168.202.48@tcp:35:mkdir.0 Request processed in 244us (390us total) trans 120259084294 rc 0/0 00000100:00100000:2.0:1783952154.507978:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 240 00000100:00100000:1.0:1783952154.519878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952154.519920:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447768064 00000100:00100000:1.0:1783952154.519930:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447768064 00000100:00100000:1.0:1783952154.519988:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1367 00000100:00100000:1.0:1783952154.520000:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:71987:x1870605447768064:12345-192.168.202.48@tcp:36:mkdir.0 00000100:00100000:1.0:1783952154.520149:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465563264:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783952154.520247:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.520286:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6300 going to sleep for 11 seconds 00000100:00100000:1.0:1783952154.520531:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465563264 00000100:00100000:1.0:1783952154.520536:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465563264 00000100:00100000:1.0:1783952154.520572:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:1.0:1783952154.520580:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:83761:x1870605465563264:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783952154.520705:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:83761:x1870605465563264:12345-0@lo:1000:mdt00_005.0 Request processed in 125us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952154.520714:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00100000:1.0:1783952154.520778:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465563264:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783952154.520841:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465563392:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783952154.520867:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.520885:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.521842:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465563392 00000100:00100000:3.0:1783952154.521850:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465563392 00000100:00100000:3.0:1783952154.521906:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:3.0:1783952154.521914:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:83761:x1870605465563392:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.522015:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:83761:x1870605465563392:12345-0@lo:1000:mdt00_005.0 Request processed in 101us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.522033:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00100000:3.0:1783952154.522073:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465563392:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.522126:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465563520:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.522159:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952154.522178:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.522191:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465563520 00000100:00100000:3.0:1783952154.522195:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465563520 00000100:00100000:3.0:1783952154.522219:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:3.0:1783952154.522224:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:83761:x1870605465563520:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.522297:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:83761:x1870605465563520:12345-0@lo:1000:mdt00_005.0 Request processed in 72us (137us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783952154.522304:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00100000:3.0:1783952154.522331:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465563520:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1783952154.522381:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.522392:0:83761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.522402:0:83761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952154.522414:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465563648:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783952154.522437:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952154.522451:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.522463:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465563648 00000100:00100000:3.0:1783952154.522466:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465563648 00000100:00100000:3.0:1783952154.522495:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:3.0:1783952154.522500:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:83761:x1870605465563648:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783952154.522509:0:23862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952154.522524:0:23862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d08 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5d01 expref: -99 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.522545:0:23862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 2/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.522553:0:23862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d08 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5d01 expref: 9 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.522569:0:23862:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1783952154.522624:0:23862:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1783952154.522658:0:23862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d08 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5d01 expref: 9 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.522667:0:23862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b164ef8c00) 00010000:00010000:3.0:1783952154.522670:0:23862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952154.522673:0:23862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d08 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5d01 expref: 9 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.522680:0:23862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86be00, rc 0) 00000100:00100000:3.0:1783952154.522711:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465563648:12345-0@lo:101:mdt00_005.0 Request processed in 210us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.522717:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00100000:3.0:1783952154.522744:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465563648:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783952154.522764:0:83761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.522772:0:83761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783952154.526048:0:92492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084294 is committed 00000001:00080000:1.0:1783952154.526089:0:92492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084291 is committed 00010000:00010000:0.0:1783952154.526288:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526301:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526309:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526315:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952154.526320:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526328:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526343:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff97b146f44a00) 00010000:00010000:0.0:1783952154.526346:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952154.526352:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526369:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb5cc9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526390:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526396:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526402:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526408:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2cc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952154.526411:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526417:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526426:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b164ef8c00) 00010000:00010000:0.0:1783952154.526428:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952154.526435:0:3629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d08 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5d01 expref: 7 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526446:0:3629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d08 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22c73c7857bb5d01 expref: 7 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526454:0:3629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d08 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x22c73c7857bb5d01 expref: 7 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.526509:0:3629:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d08 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5d01 expref: 7 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952154.526524:0:3629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3629:1870605465563776:0@lo:105: 00000100:00100000:0.0:1783952154.527164:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952154.527253:0:3629:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952154.537292:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465563776 00000100:00100000:2.0:1783952154.537310:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465563776 00000100:00100000:2.0:1783952154.537387:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1783952154.537398:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3629:x1870605465563776:12345-0@lo:105: 00010000:00010000:2.0:1783952154.537416:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.537428:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.537438:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.537448:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.537474:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.537484:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.537518:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff97b14d86ae00) 00010000:00010000:1.0:1783952154.537552:0:83761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.537564:0:83761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783952154.537611:0:83761:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:2.0:1783952154.537630:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3629:x1870605465563776:12345-0@lo:105: Request processed in 232us (11040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952154.537638:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:1.0:1783952154.537669:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.537679:0:83761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.537689:0:83761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952154.537707:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465563904:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1783952154.537758:0:3629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3629:1870605465563776:0@lo:105: 00000100:00100000:1.0:1783952154.537762:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783952154.537786:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.537796:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5cd0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952154.537797:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952154.537853:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465563904 00000100:00100000:2.0:1783952154.537858:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465563904 00000100:00100000:2.0:1783952154.538003:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:2.0:1783952154.538011:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:83761:x1870605465563904:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1783952154.538027:0:26467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952154.538042:0:26467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15a00/0x22c73c7857bb5d16 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5d0f expref: -99 pid: 26467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.538066:0:26467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15a00/0x22c73c7857bb5d16 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5d0f expref: 9 pid: 26467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.538079:0:26467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15a00/0x22c73c7857bb5d16 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5d0f expref: 9 pid: 26467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.538087:0:26467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff97b16048b600) 00010000:00010000:2.0:1783952154.538090:0:26467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952154.538100:0:26467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a15a00, rc 0) 00000100:00100000:2.0:1783952154.538144:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465563904:12345-0@lo:101:mdt00_005.0 Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952154.538151:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:1.0:1783952154.538206:0:83761:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084291 gen 3 00000004:00080000:1.0:1783952154.538213:0:83761:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084291 committed transno 120259084291 00000100:00100000:1.0:1783952154.538228:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465563904:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783952154.538240:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.538249:0:83761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783952154.538272:0:83761:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:1.0:1783952154.538517:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564032:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783952154.538546:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.542683:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952154.545969:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465564032 00000100:00100000:0.0:1783952154.545984:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465564032 00000100:00100000:0.0:1783952154.546075:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:0.0:1783952154.546085:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564032:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783952154.546212:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564032:12345-0@lo:1000:mdt00_005.0 Request processed in 128us (7663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952154.546220:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00100000:0.0:1783952154.546283:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564032:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783952154.546350:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564160:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783952154.546388:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952154.546407:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c7780 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.546471:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465564160 00000100:00100000:3.0:1783952154.546477:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465564160 00000100:00100000:3.0:1783952154.546512:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:3.0:1783952154.546519:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564160:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.546609:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564160:12345-0@lo:1000:mdt00_005.0 Request processed in 90us (220us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783952154.546623:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00100000:1.0:1783952154.546706:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564160:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783952154.546785:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564288:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783952154.546814:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.546842:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.547077:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465564288 00000100:00100000:3.0:1783952154.547081:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465564288 00000100:00100000:3.0:1783952154.547115:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:3.0:1783952154.547123:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564288:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.547183:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564288:12345-0@lo:1000:mdt00_005.0 Request processed in 61us (368us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783952154.547189:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:3.0:1783952154.547214:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564288:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.547264:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564416:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.547290:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952154.547309:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465564416 00000100:00100000:3.0:1783952154.547312:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465564416 00000100:00100000:3.0:1783952154.547328:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:3.0:1783952154.547346:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564416:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.547389:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564416:12345-0@lo:1000:mdt00_005.0 Request processed in 44us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.547395:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:3.0:1783952154.547410:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.547422:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564416:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.547457:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564544:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.547479:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952154.547497:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465564544 00000100:00100000:3.0:1783952154.547499:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465564544 00000100:00100000:3.0:1783952154.547516:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:3.0:1783952154.547520:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564544:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.547565:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564544:12345-0@lo:1000:mdt00_005.0 Request processed in 44us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.547570:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00100000:3.0:1783952154.547584:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.547636:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564544:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.547669:0:83761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564672:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.547691:0:83761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952154.547710:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465564672 00000100:00100000:3.0:1783952154.547713:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465564672 00000100:00100000:3.0:1783952154.547730:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:3.0:1783952154.547735:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564672:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783952154.547779:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:83761:x1870605465564672:12345-0@lo:1000:mdt00_005.0 Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.547794:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000100:00100000:3.0:1783952154.547809:0:83761:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176e3b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.547821:0:83761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:83761:1870605465564672:0@lo:1000:mdt00_005.0 00000040:00080000:3.0:1783952154.549652:0:83761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].5, 968 off39472 00000040:00080000:3.0:1783952154.549722:0:83761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x6:0x0].4, 1120 off37904 00000004:00080000:3.0:1783952154.549730:0:83761:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97b176e3b300 with version 16 00000004:00080000:0.0:1783952154.549805:0:75700:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97b1748af6c0 version 16 rpc_version 16 00000020:00100000:0.0:1783952154.549837:0:75700:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783952154.549855:0:75700:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97b04ef1e300 x1870605465564928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952154.549877:0:75700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465564928:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783952154.550095:0:75700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952154.550125:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.550177:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465564928 00000100:00100000:3.0:1783952154.550184:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465564928 00000100:00100000:3.0:1783952154.550221:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:3.0:1783952154.550229:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75700:x1870605465564928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783952154.550675:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75700:x1870605465564928:12345-0@lo:1000:osp_up0-1.0 Request processed in 445us (580us total) trans 120259084295 rc 0/0 00000100:00100000:3.0:1783952154.550682:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:0.0:1783952154.550847:0:75700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465564928:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1783952154.551234:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.551251:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.551265:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952154.551283:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080bfdbaa reply state 000000005f89657e transno 77309411458 ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.551294:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.551302:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44400) 00010000:00010000:3.0:1783952154.551312:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952154.551316:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783952154.551321:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00080000:3.0:1783952154.551329:0:83761:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1783952154.551338:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.551348:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.551356:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.551379:0:83761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783952154.551384:0:83761:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1783952154.551390:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.551398:0:83761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952154.551475:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71987:x1870605447768064:12345-192.168.202.48@tcp:36:mkdir.0 Request processed in 31477us (31607us total) trans 77309411458 rc 0/0 00000100:00100000:3.0:1783952154.551483:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1367 00010000:00010000:0.0:1783952154.551772:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952154.551779:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.551788:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ae00 already unused, calling callback (ffffffffc19c9ed0) 00010000:00010000:0.0:1783952154.551793:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952154.551802:0:15262:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.551833:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.551840:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952154.551863:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.551870:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86ae00/0x22c73c7857bb5d01 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5d08 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.551957:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952154.551966:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952154.551968:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952154.552008:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952154.552024:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465565056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952154.552063:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952154.552135:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465565056 00000100:00100000:2.0:1783952154.552141:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465565056 00000100:00100000:2.0:1783952154.552189:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1783952154.552197:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3643:x1870605465565056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952154.552209:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952154.552226:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d08 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5d01 expref: 10 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.552240:0:22092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b164ef8c00) 00010000:00010000:2.0:1783952154.552248:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952154.552287:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3643:x1870605465565056:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952154.552293:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1783952154.552360:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465565056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952154.555378:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.555451:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447768320 00000100:00100000:3.0:1783952154.555460:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447768320 00000100:00100000:3.0:1783952154.555519:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1368 00000100:00100000:3.0:1783952154.555530:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71987:x1870605447768320:12345-192.168.202.48@tcp:36:mkdir.0 00010000:00010000:3.0:1783952154.555636:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952154.555675:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5cde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a45e expref: 7 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.555694:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952154.555699:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952154.555821:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71987:x1870605447768320:12345-192.168.202.48@tcp:36:mkdir.0 Request processed in 293us (451us total) trans 0 rc -17/-17 00000100:00100000:3.0:1783952154.555829:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1368 00000100:00100000:2.0:1783952154.561123:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.561202:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447768448 00000100:00100000:3.0:1783952154.561212:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447768448 00000100:00100000:3.0:1783952154.561266:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1369 00000100:00100000:3.0:1783952154.561275:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71987:x1870605447768448:12345-192.168.202.48@tcp:101:mkdir.0 00010000:00010000:3.0:1783952154.561294:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952154.561311:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a46c expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.561368:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5d2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.561381:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.561393:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952154.561437:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783952154.561441:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952154.561460:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5d2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.561504:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a46c expref: 8 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.561523:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5d2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a46c expref: 7 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.561530:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952154.561533:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783952154.561536:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86b800, rc 0) 00000100:00100000:3.0:1783952154.561630:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71987:x1870605447768448:12345-192.168.202.48@tcp:101:mkdir.0 Request processed in 356us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.561637:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1369 00000100:00100000:1.0:1783952154.575386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952154.575494:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447768576 00000100:00100000:0.0:1783952154.575504:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447768576 00000100:00100000:0.0:1783952154.575566:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1370 00000100:00100000:0.0:1783952154.575576:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71987:x1870605447768576:12345-192.168.202.48@tcp:101:mkdir.0 00010000:00010000:0.0:1783952154.575646:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952154.575666:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5d32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a473 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575732:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575747:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575757:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575772:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575779:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575785:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575854:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575862:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575881:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952154.575918:0:68591:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783952154.575921:0:68591:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783952154.575936:0:68591:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575947:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575954:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575960:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575966:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575971:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2ca00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952154.575975:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575982:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.575992:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:0.0:1783952154.575995:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952154.575998:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576014:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb5d39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576027:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576032:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576037:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576041:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2da00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952154.576044:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576050:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576057:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff97b164ef8500) 00010000:00010000:0.0:1783952154.576059:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952154.576062:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576068:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576096:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5d32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a473 expref: 9 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576196:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a473 expref: 8 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.576206:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b164ef8d00) 00010000:00010000:0.0:1783952154.576208:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783952154.576211:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2c800, rc 0) 00000100:00100000:0.0:1783952154.576387:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71987:x1870605447768576:12345-192.168.202.48@tcp:101:mkdir.0 Request processed in 812us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952154.576395:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1370 00000100:00100000:2.0:1783952154.587902:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.588044:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447768832 00000100:00100000:3.0:1783952154.588055:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447768832 00000100:00100000:3.0:1783952154.588117:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1371 00000100:00100000:3.0:1783952154.588127:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71987:x1870605447768832:12345-192.168.202.48@tcp:36:mkdir.0 00000100:00100000:3.0:1783952154.588248:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465565184:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783952154.588296:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952154.588340:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783952154.588406:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465565184 00000100:00100000:0.0:1783952154.588410:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465565184 00000100:00100000:0.0:1783952154.588450:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:0.0:1783952154.588458:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66237:x1870605465565184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783952154.588537:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66237:x1870605465565184:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952154.588545:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:1.0:1783952154.588702:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465565184:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783952154.588763:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465565312:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783952154.588794:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.588835:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1783952154.588889:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465565312 00000100:00100000:0.0:1783952154.588893:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465565312 00000100:00100000:0.0:1783952154.588921:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:0.0:1783952154.588928:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66237:x1870605465565312:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783952154.588998:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66237:x1870605465565312:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (203us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783952154.589004:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00100000:0.0:1783952154.589029:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465565312:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1783952154.589077:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.589094:0:66237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.589104:0:66237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952154.589116:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465565440:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1783952154.589142:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952154.589155:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783952154.589166:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465565440 00000100:00100000:0.0:1783952154.589169:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465565440 00000100:00100000:0.0:1783952154.589189:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:0.0:1783952154.589195:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66237:x1870605465565440:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1783952154.589204:0:23862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952154.589217:0:23862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d55 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5d4e expref: -99 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.589242:0:23862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a473 expref: 7 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.589251:0:23862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d55 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5d4e expref: 10 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.589274:0:23862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a473 expref: 7 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.589287:0:23862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a473 expref: 7 pid: 68591 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952154.589320:0:23862:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23862:1870605465565568:192.168.202.48@tcp:104: 00000100:00100000:0.0:1783952154.589381:0:23862:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952154.601352:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.601485:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447768960 00000100:00100000:3.0:1783952154.601495:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447768960 00010000:00010000:3.0:1783952154.601536:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 5/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a473 expref: 8 pid: 68591 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952154.601632:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2578 00000100:00100000:3.0:1783952154.601643:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2400:x1870605447768960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783952154.601675:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952154.601682:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 5/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a473 expref: 8 pid: 68591 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.601697:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a473 expref: 8 pid: 68591 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.601719:0:26211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b164ef8d00) 00010000:00010000:3.0:1783952154.601725:0:26211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d55 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5d4e expref: 10 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.601738:0:26211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d55 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x22c73c7857bb5d4e expref: 10 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.601748:0:26211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d55 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x22c73c7857bb5d4e expref: 10 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.601782:0:26211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d55 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5d4e expref: 10 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952154.601797:0:26211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:26211:1870605465565696:0@lo:105: 00000100:00100000:3.0:1783952154.601844:0:26211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952154.601881:0:26211:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783952154.601946:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465565696 00000100:00100000:1.0:1783952154.601951:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465565696 00000100:00100000:1.0:1783952154.601988:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1783952154.601996:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:26211:x1870605465565696:12345-0@lo:105: 00010000:00010000:1.0:1783952154.602006:0:10395:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.602016:0:10395:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.602024:0:10395:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.602031:0:10395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.602037:0:10395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.602045:0:10395:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.602058:0:10395:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff97b047b2cc00) 00000100:00100000:1.0:1783952154.602094:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:26211:x1870605465565696:12345-0@lo:105: Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952154.602101:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1783952154.602188:0:26211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:26211:1870605465565696:0@lo:105: 00010000:00010000:3.0:1783952154.602205:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952154.602250:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2400:x1870605447768960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 609us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.602266:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2578 00010000:00010000:0.0:1783952154.602755:0:23862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5d47 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a473 expref: 7 pid: 68591 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952154.602773:0:23862:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23862:1870605465565568:192.168.202.48@tcp:104: 00010000:00010000:0.0:1783952154.602793:0:23862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d55 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5d4e expref: 10 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.602805:0:23862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b164ef8d00) 00010000:00010000:0.0:1783952154.602808:0:23862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952154.602812:0:23862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2da00, rc 0) 00000100:00100000:0.0:1783952154.602864:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66237:x1870605465565440:12345-0@lo:101:mdt00_001.0 Request processed in 13668us (13720us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952154.602871:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000100:00100000:1.0:1783952154.602947:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465565440:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1783952154.602970:0:66237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783952154.602992:0:66237:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:1.0:1783952154.603025:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.603032:0:66237:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.603040:0:66237:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952154.603057:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465565824:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1783952154.603087:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.603113:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952154.603162:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465565824 00000100:00100000:0.0:1783952154.603168:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465565824 00000100:00100000:0.0:1783952154.603204:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:0.0:1783952154.603212:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66237:x1870605465565824:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1783952154.603228:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952154.603243:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d400/0x22c73c7857bb5d63 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5d5c expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.603262:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d400/0x22c73c7857bb5d63 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5d5c expref: 11 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.603286:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d400/0x22c73c7857bb5d63 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5d5c expref: 11 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.603293:0:8445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff97b164ef8400) 00010000:00010000:0.0:1783952154.603295:0:8445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952154.603297:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d400, rc 0) 00000100:00100000:0.0:1783952154.603436:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465565824:12345-0@lo:101:mdt00_001.0 Request processed in 224us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952154.603442:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00100000:1.0:1783952154.603499:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465565824:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1783952154.603510:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.603520:0:66237:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783952154.603532:0:66237:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:1.0:1783952154.603565:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465565952:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783952154.603642:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.603662:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.603717:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465565952 00000100:00100000:3.0:1783952154.603721:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465565952 00000100:00100000:3.0:1783952154.603745:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:3.0:1783952154.603751:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465565952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783952154.603820:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465565952:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.603827:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000100:00100000:1.0:1783952154.605092:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465565952:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783952154.605172:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465566080:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783952154.605216:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.605254:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.605336:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465566080 00000100:00100000:3.0:1783952154.605342:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465566080 00000100:00100000:3.0:1783952154.605388:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:3.0:1783952154.605396:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465566080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783952154.605502:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465566080:12345-0@lo:1000:mdt00_001.0 Request processed in 106us (284us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783952154.605508:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:2.0:1783952154.605632:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465566080:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952154.605712:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465566208:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952154.605742:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952154.605755:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf240 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.605874:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465566208 00000100:00100000:3.0:1783952154.605878:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465566208 00000100:00100000:3.0:1783952154.605917:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:3.0:1783952154.605923:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465566208:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783952154.605975:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465566208:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (231us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783952154.605982:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:2.0:1783952154.606051:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465566208:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952154.606098:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d76a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465566336:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952154.606129:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952154.606150:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf240 going to sleep for 11 seconds 00000100:00100000:1.0:1783952154.606208:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465566336 00000100:00100000:1.0:1783952154.606212:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465566336 00000100:00100000:1.0:1783952154.606244:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:1.0:1783952154.606251:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465566336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783952154.606303:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465566336:12345-0@lo:1000:mdt00_001.0 Request processed in 53us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952154.606319:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:2.0:1783952154.606429:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d76a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465566336:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952154.606469:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d76a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465566464:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952154.606492:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952154.606513:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf240 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.606562:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465566464 00000100:00100000:3.0:1783952154.606567:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465566464 00000100:00100000:3.0:1783952154.606627:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:3.0:1783952154.606633:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465566464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783952154.606696:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465566464:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.606702:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:2.0:1783952154.606774:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d76a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465566464:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952154.606811:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465566592:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952154.606833:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952154.606855:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf240 going to sleep for 11 seconds 00000100:00100000:0.0:1783952154.606945:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465566592 00000100:00100000:0.0:1783952154.606950:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465566592 00000100:00100000:0.0:1783952154.606978:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:0.0:1783952154.606984:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465566592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783952154.607037:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66237:x1870605465566592:12345-0@lo:1000:mdt00_001.0 Request processed in 54us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952154.607044:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:0.0:1783952154.607071:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66237:1870605465566592:0@lo:1000:mdt00_001.0 00000040:00080000:2.0:1783952154.613476:0:66237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].6, 968 off40440 00000040:00080000:2.0:1783952154.613558:0:66237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x6:0x0].5, 1120 off39024 00000004:00080000:2.0:1783952154.613565:0:66237:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97b1742c7780 with version 17 00000004:00080000:0.0:1783952154.614005:0:75700:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97b1748af6c0 version 17 rpc_version 17 00000020:00100000:1.0:1783952154.621462:0:75700:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783952154.621478:0:75700:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97b04aa49180 x1870605465566848/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952154.621503:0:75700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa49180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465566848:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783952154.621570:0:75700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.621686:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952154.622469:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465566848 00000100:00100000:0.0:1783952154.622478:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465566848 00000100:00100000:0.0:1783952154.622540:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:0.0:1783952154.622550:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75700:x1870605465566848:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783952154.623517:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75700:x1870605465566848:12345-0@lo:1000:osp_up0-1.0 Request processed in 966us (1944us total) trans 120259084296 rc 0/0 00000100:00100000:1.0:1783952154.623529:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:3.0:1783952154.623720:0:75700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa49180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465566848:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783952154.623818:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.623836:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.623848:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952154.623878:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000039f1f88 reply state 0000000001018755 transno 77309411459 ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.623997:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.624005:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b14e2a2300) 00010000:00010000:1.0:1783952154.624008:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952154.624012:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783952154.624017:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00080000:1.0:1783952154.624026:0:66237:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:1.0:1783952154.624036:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.624045:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.624053:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.624078:0:66237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783952154.624083:0:66237:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:1.0:1783952154.624089:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.624096:0:66237:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.624227:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952154.624234:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.624253:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2cc00 already unused, calling callback (ffffffffc19c9ed0) 00010000:00010000:0.0:1783952154.624259:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952154.624267:0:6506:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.624296:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.624303:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783952154.624364:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465566976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952154.624473:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.624482:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b047b2cc00/0x22c73c7857bb5d4e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5d55 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.624501:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952154.624503:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952154.624505:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952154.624816:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:71987:x1870605447768832:12345-192.168.202.48@tcp:36:mkdir.0 Request processed in 36688us (36922us total) trans 77309411459 rc 0/0 00000100:00100000:1.0:1783952154.624836:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1371 00000100:00100000:2.0:1783952154.624916:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952154.624996:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465566976 00000100:00100000:3.0:1783952154.625003:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465566976 00000100:00100000:3.0:1783952154.625045:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1783952154.625051:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3643:x1870605465566976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952154.625063:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952154.625080:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5d55 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5d4e expref: 12 pid: 23862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.625093:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b164ef8d00) 00010000:00010000:3.0:1783952154.625100:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952154.625145:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3643:x1870605465566976:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.625152:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1783952154.625259:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465566976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952154.646241:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.646336:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447769088 00000100:00100000:3.0:1783952154.646346:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447769088 00000100:00100000:3.0:1783952154.646408:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1372 00000100:00100000:3.0:1783952154.646418:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71988:x1870605447769088:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952154.646442:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952154.646465:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5d71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a47a expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646524:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646549:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646561:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646577:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646634:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646644:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646723:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5d86 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646732:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5d86 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646739:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5d86 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952154.646772:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783952154.646776:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952154.646808:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5d86 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646821:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646836:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646843:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646851:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646856:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952154.646861:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646868:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646880:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952154.646883:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952154.646887:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646893:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb5d78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646907:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646914:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646920:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646930:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86be00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952154.646933:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646940:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646947:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff97b146f44c00) 00010000:00010000:3.0:1783952154.646950:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952154.646952:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646959:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5d7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646987:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5d71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a47a expref: 9 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.646999:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5d86 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a47a expref: 8 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.647007:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b146f44800) 00010000:00010000:3.0:1783952154.647009:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783952154.647011:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ae00, rc 0) 00000100:00100000:3.0:1783952154.647059:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71988:x1870605447769088:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 643us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.647066:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1372 00000100:00100000:0.0:1783952154.652253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952154.652352:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447769216 00000100:00100000:1.0:1783952154.652362:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447769216 00000100:00100000:1.0:1783952154.652425:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1373 00000100:00100000:1.0:1783952154.652436:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71988:x1870605447769216:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1783952154.652459:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952154.652481:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70200/0x22c73c7857bb5d8d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a481 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.652548:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.652562:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.652573:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.652629:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.652640:0:68591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15a00/0x22c73c7857bb5d16 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5d0f expref: 10 pid: 26467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.652649:0:68591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.652700:0:68591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15a00/0x22c73c7857bb5d16 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5d0f expref: 10 pid: 26467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952154.652717:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68591:1870605465567104:0@lo:104: 00000100:00100000:1.0:1783952154.652777:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.652811:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1783952154.652879:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465567104 00000100:00100000:0.0:1783952154.652893:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465567104 00000100:00100000:0.0:1783952154.652930:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1783952154.652937:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:68591:x1870605465567104:12345-0@lo:104: 00010000:00010000:0.0:1783952154.652949:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.653028:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783952154.653035:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:68591:x1870605465567104:12345-0@lo:104: Request processed in 99us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952154.653042:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00010000:00010000:0.0:1783952154.653063:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952154.653069:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952154.653075:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:68591:1870605465567104:0@lo:104: 00010000:00010000:0.0:1783952154.653076:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71600 already unused, calling callback (ffffffffc19c9ed0) 00010000:00010000:0.0:1783952154.653081:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952154.653089:0:6505:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.653094:0:68591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.653116:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.653123:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952154.653152:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.653159:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db71600/0x22c73c7857bb5d0f lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5d16 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952154.653177:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952154.653179:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952154.653187:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952154.653194:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783952154.653205:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465567232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952154.653235:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952154.653289:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465567232 00000100:00100000:2.0:1783952154.653294:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465567232 00010000:00010000:2.0:1783952154.653314:0:22092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15a00/0x22c73c7857bb5d16 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22c73c7857bb5d0f expref: 11 pid: 26467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952154.653346:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:2.0:1783952154.653353:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3645:x1870605465567232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952154.653369:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1783952154.655679:0:92492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084296 is committed 00010000:00010000:2.0:1783952154.656402:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15a00/0x22c73c7857bb5d16 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5d0f expref: 9 pid: 26467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.656425:0:22092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff97b16048b600) 00010000:00010000:2.0:1783952154.656431:0:22092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.656441:0:22092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.656449:0:22092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.656538:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952154.656914:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3645:x1870605465567232:12345-0@lo:103:ldlm_bl.0 Request processed in 3559us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952154.656924:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1783952154.657141:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465567232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952154.657278:0:68591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.657287:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952154.657483:0:68591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68591:1870605465567360:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783952154.657530:0:68591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.657667:0:68591:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.657891:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465567360 00000100:00100000:3.0:1783952154.657899:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465567360 00000100:00100000:3.0:1783952154.657978:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:3.0:1783952154.657987:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68591:x1870605465567360:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783952154.658073:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:68591:x1870605465567360:12345-0@lo:1000:mdt00_004.0 Request processed in 86us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.658080:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00000100:00100000:2.0:1783952154.658131:0:68591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:68591:1870605465567360:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1783952154.658188:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14400/0x22c73c7857bb5da2 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658200:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14400/0x22c73c7857bb5da2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658210:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14400/0x22c73c7857bb5da2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952154.658232:0:68591:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14400/0x22c73c7857bb5da2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658264:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658270:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658276:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658282:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658289:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952154.658293:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658300:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658322:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b146f44800) 00010000:00010000:2.0:1783952154.658325:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952154.658329:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658336:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71200/0x22c73c7857bb5d94 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658348:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658353:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658366:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658371:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952154.658374:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658379:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658387:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff97b16048b600) 00010000:00010000:2.0:1783952154.658389:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952154.658392:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658397:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70800/0x22c73c7857bb5d9b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658433:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70200/0x22c73c7857bb5d8d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a481 expref: 10 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658447:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14400/0x22c73c7857bb5da2 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a481 expref: 9 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.658455:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b16048b000) 00010000:00010000:2.0:1783952154.658457:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783952154.658459:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a14400, rc 0) 00000100:00100000:2.0:1783952154.658516:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:71988:x1870605447769216:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6082us (6271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952154.658533:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1373 00000100:00100000:1.0:1783952154.662422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952154.662518:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447769344 00000100:00100000:2.0:1783952154.662528:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447769344 00000100:00100000:2.0:1783952154.662726:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1374 00000100:00100000:2.0:1783952154.662737:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:71988:x1870605447769344:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1783952154.662766:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952154.662789:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15a00/0x22c73c7857bb5da9 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a488 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.662850:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15200/0x22c73c7857bb5db0 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.662865:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15200/0x22c73c7857bb5db0 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.662875:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15200/0x22c73c7857bb5db0 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952154.662923:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1783952154.662927:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1783952154.662962:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15a00/0x22c73c7857bb5da9 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a488 expref: 11 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.662981:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15200/0x22c73c7857bb5db0 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a488 expref: 10 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.662989:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44400) 00010000:00010000:2.0:1783952154.662992:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783952154.663009:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a15200, rc 0) 00000100:00100000:2.0:1783952154.663076:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71988:x1870605447769344:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 341us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952154.663083:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1374 00000100:00100000:0.0:1783952154.670164:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.670296:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447769600 00000100:00100000:3.0:1783952154.670308:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447769600 00000100:00100000:3.0:1783952154.670378:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1375 00000100:00100000:3.0:1783952154.670388:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71988:x1870605447769600:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952154.670409:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952154.670433:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5db7 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a48f expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952154.670536:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1783952154.670867:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5db7 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a48f expref: 12 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.670883:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b155d9d000) 00010000:00010000:3.0:1783952154.670886:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783952154.670891:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5db7 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a48f expref: 12 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.670910:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ac00, rc 0) 00000100:00100000:3.0:1783952154.670975:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:71988:x1870605447769600:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 588us (831us total) trans 77309411460 rc 301/301 00000100:00100000:3.0:1783952154.671000:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1375 00000100:00100000:0.0:1783952154.678489:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.678708:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447769856 00000100:00100000:3.0:1783952154.678728:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447769856 00000100:00100000:3.0:1783952154.678788:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1376 00000100:00100000:3.0:1783952154.678800:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:71988:x1870605447769856:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1783952154.678865:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952154.678891:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15200/0x22c73c7857bb5db0 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a488 expref: 11 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.678910:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44400) 00010000:00010000:3.0:1783952154.678915:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952154.678937:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.678949:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.678958:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952154.679107:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a0dad80 reply state 0000000012c17e96 transno 77309411461 ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.679119:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.679125:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44400) 00010000:00010000:3.0:1783952154.679128:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1783952154.679143:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783952154.679164:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000100:00100000:3.0:1783952154.679247:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:71988:x1870605447769856:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 449us (767us total) trans 77309411461 rc 0/0 00000100:00100000:3.0:1783952154.679255:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1376 00000100:00100000:1.0:1783952154.682165:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952154.682272:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447770112 00000100:00100000:2.0:1783952154.682282:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447770112 00000100:00100000:2.0:1783952154.682352:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 241 00000100:00100000:2.0:1783952154.682363:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:71988:x1870605447770112:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1783952154.682637:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:71988:x1870605447770112:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 275us (490us total) trans 77309411462 rc 0/0 00000100:00100000:2.0:1783952154.682645:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 241 00000100:00100000:0.0:1783952154.702072:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952154.702182:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447770240 00000100:00100000:1.0:1783952154.702192:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447770240 00000100:00100000:1.0:1783952154.702254:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1377 00000100:00100000:1.0:1783952154.702264:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:71989:x1870605447770240:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1783952154.702286:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952154.702308:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70c00/0x22c73c7857bb5dcc lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a496 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.702387:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.702420:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.702432:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.702445:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.702455:0:66237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d400/0x22c73c7857bb5d63 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5d5c expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.702463:0:66237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.702496:0:66237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d400/0x22c73c7857bb5d63 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5d5c expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952154.702512:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66237:1870605465567488:0@lo:104: 00000100:00100000:1.0:1783952154.702564:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.702662:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952154.703035:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783952154.703049:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465567488 00000100:00100000:3.0:1783952154.703054:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465567488 00000100:00100000:3.0:1783952154.703090:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1783952154.703098:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b63e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66237:x1870605465567488:12345-0@lo:104: 00010000:00010000:3.0:1783952154.703112:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.703185:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783952154.703191:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b63e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66237:x1870605465567488:12345-0@lo:104: Request processed in 94us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.703198:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00010000:2.0:1783952154.703277:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952154.703284:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.703293:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70a00 already unused, calling callback (ffffffffc19c9ed0) 00010000:00010000:2.0:1783952154.703298:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952154.703316:0:7459:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.703344:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.703351:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952154.703381:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.703401:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b04db70a00/0x22c73c7857bb5d5c lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5d63 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.703419:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952154.703420:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952154.703422:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952154.703430:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952154.703441:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465567616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783952154.703469:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952154.703496:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465567616 00000100:00100000:2.0:1783952154.703499:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465567616 00010000:00010000:2.0:1783952154.703516:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d400/0x22c73c7857bb5d63 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x22c73c7857bb5d5c expref: 8 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952154.703535:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:2.0:1783952154.703541:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049892d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3644:x1870605465567616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952154.703549:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952154.704185:0:26211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff97b164ef8400) 00010000:00010000:2.0:1783952154.704192:0:26211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.704200:0:26211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.704207:0:26211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952154.704227:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952154.704282:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049892d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3644:x1870605465567616:12345-0@lo:103:ldlm_bl.0 Request processed in 740us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952154.704288:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:0.0:1783952154.704506:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465567616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952154.704816:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d400/0x22c73c7857bb5d63 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5d5c expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952154.704831:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66237:1870605465567488:0@lo:104: 00010000:00010000:1.0:1783952154.704844:0:66237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.704853:0:66237:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952154.704867:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952154.704982:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66237:1870605465567744:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783952154.705024:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952154.705055:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952154.705174:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465567744 00000100:00100000:2.0:1783952154.705181:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465567744 00000100:00100000:2.0:1783952154.705224:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:2.0:1783952154.705231:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66237:x1870605465567744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952154.705321:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66237:x1870605465567744:12345-0@lo:1000:mdt00_001.0 Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952154.705328:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000100:00100000:3.0:1783952154.705394:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66237:1870605465567744:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783952154.705436:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5de1 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705448:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5de1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705457:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5de1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952154.705478:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5de1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705506:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705512:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705519:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705525:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705531:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952154.705536:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705543:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705555:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b146f44800) 00010000:00010000:3.0:1783952154.705558:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952154.705562:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705569:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb5dd3 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705580:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705630:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705644:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705650:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952154.705653:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705660:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705669:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff97b164ef8400) 00010000:00010000:3.0:1783952154.705671:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952154.705675:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705681:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb5dda lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705734:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70c00/0x22c73c7857bb5dcc lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a496 expref: 11 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705751:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5de1 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a496 expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.705759:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b155d9d000) 00010000:00010000:3.0:1783952154.705761:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783952154.705763:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86be00, rc 0) 00000100:00100000:3.0:1783952154.705817:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71989:x1870605447770240:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3554us (3755us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.705833:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1377 00000100:00100000:0.0:1783952154.709521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.709841:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447770368 00000100:00100000:3.0:1783952154.709851:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447770368 00000100:00100000:3.0:1783952154.709911:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1378 00000100:00100000:3.0:1783952154.709922:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:71989:x1870605447770368:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952154.709949:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952154.709971:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a400/0x22c73c7857bb5de8 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a49d expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.710034:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5def lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.710050:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5def lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.710062:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5def lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952154.710109:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783952154.710112:0:67035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783952154.710160:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a400/0x22c73c7857bb5de8 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a49d expref: 15 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.710180:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5def lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a49d expref: 14 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.710188:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b14e2a2300) 00010000:00010000:3.0:1783952154.710191:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783952154.710207:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a000, rc 0) 00000100:00100000:3.0:1783952154.710258:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:71989:x1870605447770368:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 338us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952154.710265:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1378 00000100:00100000:2.0:1783952154.717686:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.717824:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447770624 00000100:00100000:3.0:1783952154.717834:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447770624 00000100:00100000:3.0:1783952154.717897:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1379 00000100:00100000:3.0:1783952154.717907:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:71989:x1870605447770624:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952154.717932:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952154.717955:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a400/0x22c73c7857bb5df6 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4a4 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952154.718051:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783952154.718165:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a400/0x22c73c7857bb5df6 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4a4 expref: 16 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.718181:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b155d9d700) 00010000:00010000:3.0:1783952154.718184:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783952154.718189:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a400/0x22c73c7857bb5df6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4a4 expref: 16 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.718208:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a400, rc 0) 00000100:00100000:3.0:1783952154.718273:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:71989:x1870605447770624:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 368us (596us total) trans 77309411463 rc 301/301 00000100:00100000:3.0:1783952154.718280:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1379 00000100:00100000:0.0:1783952154.721639:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952154.721773:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447770880 00000100:00100000:3.0:1783952154.721784:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447770880 00000100:00100000:3.0:1783952154.721846:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1380 00000100:00100000:3.0:1783952154.721870:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:71989:x1870605447770880:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1783952154.721935:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952154.721962:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86a000/0x22c73c7857bb5def lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a49d expref: 15 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.721982:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b14e2a2300) 00010000:00010000:3.0:1783952154.721988:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952154.722010:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.722024:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.722034:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952154.722204:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b100f904 reply state 00000000140af8e6 transno 77309411464 ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.722217:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952154.722224:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b14e2a2300) 00010000:00010000:3.0:1783952154.722227:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1783952154.722229:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783952154.722237:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1783952154.724715:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:71989:x1870605447770880:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 2835us (3115us total) trans 77309411464 rc 0/0 00000100:00100000:3.0:1783952154.724729:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1380 00000100:00100000:0.0:1783952154.726973:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952154.727418:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447771136 00000100:00100000:2.0:1783952154.727430:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447771136 00000100:00100000:2.0:1783952154.727490:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 242 00000100:00100000:2.0:1783952154.727501:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:71989:x1870605447771136:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1783952154.727902:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:71989:x1870605447771136:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 403us (937us total) trans 77309411465 rc 0/0 00000100:00100000:2.0:1783952154.727910:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 242 00010000:00010000:1.0:1783952155.173487:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783952155.648902:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411465 is committed 00010000:00010000:0.0:1783952155.649008:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649022:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649032:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649039:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ba00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952155.649044:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649054:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649072:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44400) 00010000:00010000:0.0:1783952155.649081:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952155.649087:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649094:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ba00/0x22c73c7857bb5d1d lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649117:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649135:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649142:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649147:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952155.649151:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649157:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649166:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b14e2a2300) 00010000:00010000:0.0:1783952155.649169:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952155.649173:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649179:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db70400/0x22c73c7857bb5d6a lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649190:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649205:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649211:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649216:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ac00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952155.649219:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649224:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649232:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44400) 00010000:00010000:0.0:1783952155.649235:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783952155.649237:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649243:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b14d86ac00/0x22c73c7857bb5dc5 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649261:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649268:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649273:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649278:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952155.649286:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649292:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649311:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b14e2a2300) 00010000:00010000:0.0:1783952155.649313:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783952155.649317:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.649323:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae200/0x22c73c7857bb5e04 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952155.741095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952155.741162:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447771264 00000100:00100000:2.0:1783952155.741171:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447771264 00000100:00100000:2.0:1783952155.741229:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1381 00000100:00100000:2.0:1783952155.741240:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71998:x1870605447771264:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:2.0:1783952155.741282:0:67035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445163008 avail 1298923520 00000100:00100000:2.0:1783952155.741417:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71998:x1870605447771264:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 178us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952155.741425:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1381 00000100:00100000:3.0:1783952155.757073:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952155.757167:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447771392 00000100:00100000:2.0:1783952155.757178:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447771392 00000100:00100000:2.0:1783952155.757244:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1382 00000100:00100000:2.0:1783952155.757255:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:71998:x1870605447771392:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:2.0:1783952155.757318:0:83761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:2.0:1783952155.757390:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:71998:x1870605447771392:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 136us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952155.757411:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1382 00000100:00100000:2.0:1783952155.777219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952155.781264:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447771520 00000100:00100000:3.0:1783952155.781280:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447771520 00000100:00100000:3.0:1783952155.781363:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2213 00000100:00100000:3.0:1783952155.781375:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:71998:x1870605447771520:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783952155.781409:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952155.781486:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:71998:x1870605447771520:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 113us (4275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952155.781493:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2213 00000100:00080000:3.0:1783952155.781530:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952155.792304:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952155.792515:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447771648 00000100:00100000:2.0:1783952155.792524:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447771648 00000100:00100000:2.0:1783952155.792559:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4951 00000100:00100000:2.0:1783952155.792567:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2397:x1870605447771648:12345-192.168.202.48@tcp:8:lfs.0 00010000:00080000:2.0:1783952155.792629:0:26203:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp t0 exp 0000000000000000 cur 3870 last 0 00000020:00000080:2.0:1783952155.792656:0:26203:0:(genops.c:1406:class_connect()) connect: client d33551be-a709-4ba2-a74c-f4d7b53c6817, cookie 0x22c73c7857bb5e0b 00002000:00100000:2.0:1783952155.792669:0:26203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d33551be-a709-4ba2-a74c-f4d7b53c6817/ffff97b1514b8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783952155.792686:0:26203:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783952155.792758:0:26203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783952155.792785:0:26203:0:(import.c:65:import_set_state_nolock()) ffff97b1514bc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783952155.792844:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447771648:12345-192.168.202.48@tcp:8:lfs.0 Request processed in 277us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952155.792852:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4951 00000100:00100000:3.0:1783952155.797126:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952155.797257:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447771776 00000100:00100000:0.0:1783952155.797267:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447771776 00000100:00080000:3.0:1783952155.797368:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952155.797437:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2214 00000100:00100000:0.0:1783952155.797448:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71998:x1870605447771776:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783952155.797475:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952155.797544:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:71998:x1870605447771776:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 98us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952155.797552:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2214 00000100:00100000:2.0:1783952155.888149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952155.900248:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447772032 00000100:00100000:1.0:1783952155.900259:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447772032 00000100:00100000:1.0:1783952155.900332:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1383 00000100:00100000:1.0:1783952155.904499:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:72005:x1870605447772032:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00010000:1.0:1783952155.904566:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952155.904623:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b800/0x22c73c7857bb5d2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a46c expref: 10 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.904645:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:1.0:1783952155.904650:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952155.904714:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.904727:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.904737:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.904752:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.904769:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.904777:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.905163:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.905172:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.905179:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.905186:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.905193:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952155.905197:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.905205:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.905215:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:1.0:1783952155.905218:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952155.905221:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.905228:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71000/0x22c73c7857bb5e12 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952155.905246:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7347416 reply state 0000000026ebcc84 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.905258:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952155.905265:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b1767ed900) 00010000:00010000:1.0:1783952155.905267:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952155.905270:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783952155.907252:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:72005:x1870605447772032:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 6899us (19100us total) trans 120259084297 rc 0/0 00000100:00100000:1.0:1783952155.907265:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1383 00000100:00100000:0.0:1783952155.958822:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952155.958949:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447772160 00000100:00100000:2.0:1783952155.958959:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447772160 00000100:00100000:2.0:1783952155.959058:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1384 00000100:00100000:2.0:1783952155.959082:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:72008:x1870605447772160:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:2.0:1783952155.959106:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952155.959127:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14200/0x22c73c7857bb5e20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4ab expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.959190:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15400/0x22c73c7857bb5e27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.959203:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15400/0x22c73c7857bb5e27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.959213:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15400/0x22c73c7857bb5e27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952155.959260:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783952155.959264:0:67035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783952155.959285:0:67035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15400/0x22c73c7857bb5e27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.959320:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14200/0x22c73c7857bb5e20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ab expref: 13 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.959337:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15400/0x22c73c7857bb5e27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ab expref: 12 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.959352:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:2.0:1783952155.959355:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783952155.959358:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a15400, rc 0) 00000100:00100000:2.0:1783952155.959419:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:72008:x1870605447772160:12345-192.168.202.48@tcp:101:rm.0 Request processed in 339us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952155.959436:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1384 00000100:00100000:1.0:1783952155.963403:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952155.963537:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447772288 00000100:00100000:2.0:1783952155.963547:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447772288 00000100:00100000:2.0:1783952155.963821:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1385 00000100:00100000:2.0:1783952155.963832:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:72008:x1870605447772288:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:2.0:1783952155.963854:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952155.963872:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15e00/0x22c73c7857bb5e2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4b2 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.963944:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.963959:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.963972:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.963981:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15000/0x22c73c7857bb5e3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.963989:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15000/0x22c73c7857bb5e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.963996:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15000/0x22c73c7857bb5e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964068:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14c00/0x22c73c7857bb5e43 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964091:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14c00/0x22c73c7857bb5e43 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964098:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14c00/0x22c73c7857bb5e43 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952155.964139:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x3:0x0]: returning size 0 00000004:00200000:2.0:1783952155.964143:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783952155.964159:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14c00/0x22c73c7857bb5e43 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964170:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14c00/0x22c73c7857bb5e43 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964179:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964185:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964192:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964199:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964205:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952155.964210:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964217:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964238:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:2.0:1783952155.964241:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952155.964245:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964252:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15800/0x22c73c7857bb5e35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964264:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15000/0x22c73c7857bb5e3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964270:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15000/0x22c73c7857bb5e3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964275:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15000/0x22c73c7857bb5e3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964280:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952155.964283:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15000/0x22c73c7857bb5e3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964289:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15000/0x22c73c7857bb5e3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964295:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b1767ed900) 00010000:00010000:2.0:1783952155.964297:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952155.964300:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15000/0x22c73c7857bb5e3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964305:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15000/0x22c73c7857bb5e3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964334:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15e00/0x22c73c7857bb5e2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4b2 expref: 14 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964357:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14c00/0x22c73c7857bb5e43 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4b2 expref: 13 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952155.964364:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff97b174267b00) 00010000:00010000:2.0:1783952155.964366:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952155.964368:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a14c00, rc 0) 00000100:00100000:2.0:1783952155.964435:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:72008:x1870605447772288:12345-192.168.202.48@tcp:101:rm.0 Request processed in 605us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952155.964443:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1385 00000100:00100000:0.0:1783952155.968825:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952155.968912:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447772544 00000100:00100000:3.0:1783952155.968922:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447772544 00000100:00100000:3.0:1783952155.969000:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1386 00000100:00100000:3.0:1783952155.969010:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:72008:x1870605447772544:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:3.0:1783952155.969061:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783952155.969087:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14c00/0x22c73c7857bb5e43 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4b2 expref: 13 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969106:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff97b174267b00) 00010000:00010000:3.0:1783952155.969120:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a15400/0x22c73c7857bb5e27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ab expref: 12 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969129:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952155.969132:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952155.969163:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969186:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969196:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969207:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969215:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969221:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969295:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e58 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969311:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e58 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969318:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e58 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969523:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969533:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969540:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969557:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969563:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969568:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969626:0:66238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783952155.969647:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e58 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969654:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e58 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969660:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e58 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969665:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952155.969669:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e58 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969676:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e58 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.969684:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff97b146f44700) 00010000:00010000:3.0:1783952155.969687:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783952155.969690:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e58 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.969954:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952155.969960:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.969967:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952155.969970:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.969982:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.969991:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff97b146f44700) 00010000:00010000:0.0:1783952155.969994:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783952155.969997:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.970002:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afc00/0x22c73c7857bb5e5f lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952155.970013:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952155.970014:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952155.970016:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952155.970045:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e58 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.970063:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.970069:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.970075:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.970080:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.970085:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762aea00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952155.970088:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.970093:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.970101:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952155.970103:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952155.970105:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.970111:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952155.970119:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fe21e84 reply state 00000000827467dd transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.970137:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952155.970143:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b1767ed900) 00010000:00010000:3.0:1783952155.970146:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952155.970148:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952155.970248:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:72008:x1870605447772544:12345-192.168.202.48@tcp:36:rm.0 Request processed in 1237us (1428us total) trans 120259084298 rc 0/0 00000100:00100000:3.0:1783952155.970256:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1386 00010000:00010000:0.0:1783952156.192965:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952156.256949:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465567872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952156.257025:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952156.257133:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465567872 00000100:00100000:1.0:1783952156.257140:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465567872 00000100:00100000:1.0:1783952156.257185:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:1.0:1783952156.257191:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465567872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783952156.257229:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:1.0:1783952156.257267:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465567872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952156.257272:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:3.0:1783952156.257377:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465567872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783952156.258785:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465568000:0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.258841:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952156.258873:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465568512:0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.258900:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952156.258916:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465569024:0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.258936:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952156.258957:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783952156.258961:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465568384:0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.258977:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952156.258986:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465568896:0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.259000:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952156.259007:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465569408:0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.259033:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952156.259054:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465568512 00000100:00100000:2.0:1783952156.259058:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465568512 00000100:00100000:2.0:1783952156.259108:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465569024 00000100:00100000:2.0:1783952156.259111:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465569024 00000100:00100000:2.0:1783952156.259124:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465568384 00000100:00100000:2.0:1783952156.259126:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465568384 00000100:00100000:2.0:1783952156.259137:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465569408 00000100:00100000:2.0:1783952156.259139:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465569408 00000100:00100000:2.0:1783952156.259150:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:2.0:1783952156.259156:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465568512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.259208:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465568512:12345-0@lo:400:kworker.0 Request processed in 51us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952156.259214:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:2.0:1783952156.259354:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1783952156.259359:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465569024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.259381:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465569024:12345-0@lo:400:kworker.0 Request processed in 23us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952156.259385:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1783952156.259392:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1783952156.259405:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465568384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.259421:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465568384:12345-0@lo:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952156.259425:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1783952156.259431:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1783952156.259434:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465569408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.259447:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465569408:12345-0@lo:400:kworker.0 Request processed in 13us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952156.259456:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1783952156.259483:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465568384:0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.259493:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465569408:0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.259502:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465568512:0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.259509:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465569024:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.259678:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465568128:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.259709:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952156.259731:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465568640:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.259755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952156.259772:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465569152:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.259793:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952156.259810:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783952156.259815:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465568256:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.259836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952156.259852:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465568768:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.259872:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952156.259887:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b05095b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465569280:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.259909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952156.259930:0:92497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465568000 00000100:00100000:0.0:1783952156.259933:0:92497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465568000 00000100:00100000:0.0:1783952156.259954:0:92497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783952156.259959:0:92497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b160515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465568000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.259978:0:92497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b160515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465568000:12345-0@lo:400:kworker.0 Request processed in 19us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952156.259982:0:92497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783952156.260000:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465568128 00000100:00100000:0.0:1783952156.260002:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465568128 00000100:00100000:0.0:1783952156.260016:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465568256 00000100:00100000:0.0:1783952156.260018:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465568256 00000100:00100000:0.0:1783952156.260026:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1783952156.260029:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465568128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260048:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465568128:12345-0@lo:400:kworker.0 Request processed in 18us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952156.260051:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1783952156.260058:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1783952156.260062:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465568256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260075:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465568256:12345-0@lo:400:kworker.0 Request processed in 13us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952156.260078:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1783952156.260088:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465568640 00000100:00100000:0.0:1783952156.260090:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465568640 00000100:00100000:0.0:1783952156.260104:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:0.0:1783952156.260107:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465568640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260128:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465568640:12345-0@lo:400:kworker.0 Request processed in 21us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952156.260137:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:0.0:1783952156.260149:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465568896 00000100:00100000:0.0:1783952156.260152:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465568896 00000100:00100000:0.0:1783952156.260167:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465569152 00000100:00100000:0.0:1783952156.260169:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465569152 00000100:00100000:0.0:1783952156.260178:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465568768 00000100:00100000:0.0:1783952156.260179:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465568768 00000100:00100000:0.0:1783952156.260188:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465569280 00000100:00100000:0.0:1783952156.260189:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465569280 00000100:00100000:0.0:1783952156.260199:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:0.0:1783952156.260202:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465568896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260222:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465568896:12345-0@lo:400:kworker.0 Request processed in 20us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952156.260226:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00100000:0.0:1783952156.260232:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00000100:00100000:0.0:1783952156.260235:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465569152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260247:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465569152:12345-0@lo:400:kworker.0 Request processed in 12us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952156.260251:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00000100:00100000:0.0:1783952156.260257:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:0.0:1783952156.260260:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465568768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260273:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465568768:12345-0@lo:400:kworker.0 Request processed in 13us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952156.260276:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000100:00100000:0.0:1783952156.260281:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835 00000100:00100000:0.0:1783952156.260284:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465569280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260308:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465569280:12345-0@lo:400:kworker.0 Request processed in 24us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952156.260312:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835 00000100:00100000:0.0:1783952156.260335:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465568256:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260341:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465568768:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260345:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465569280:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260350:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465568128:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260355:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000004:00080000:0.0:1783952156.260359:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084295 committed transno 120259084296 00000020:00080000:0.0:1783952156.260364:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff97b176e3b9c0 refcount 2 committed 0 result 0 batchid 73014444093 00000020:00080000:0.0:1783952156.260366:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97b150f0ef00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff97b176e3b300 00000020:00080000:0.0:1783952156.260369:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x6:0x0].4 00000020:00080000:0.0:1783952156.260370:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97b150f0e800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97b174221200 00000020:00080000:0.0:1783952156.260372:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].5 00000004:00080000:0.0:1783952156.260388:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084296 committed transno 120259084296 00000020:00080000:0.0:1783952156.260390:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff97b1742c70c0 refcount 2 committed 0 result 0 batchid 73014444094 00000020:00080000:0.0:1783952156.260392:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97b0467fd300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff97b1742c7780 00000020:00080000:0.0:1783952156.260394:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2000090a1:0x6:0x0].5 00000020:00080000:0.0:1783952156.260395:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97b048b1f000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97b047963200 00000020:00080000:0.0:1783952156.260397:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].6 00000100:00100000:0.0:1783952156.260410:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b05095a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465568640:0@lo:400:kworker.0 00000100:00100000:0.0:1783952156.260416:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465569152:0@lo:400:kworker.0 00000020:00080000:2.0:1783952156.261232:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444094 committed batchid 73014444092 00000020:00080000:2.0:1783952156.261292:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444092 00000100:00100000:2.0:1783952156.261307:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465569536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952156.261339:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952156.261372:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465568896:0@lo:400:kworker.0 00000100:00100000:2.0:1783952156.261379:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465568000:0@lo:400:kworker.0 00000100:00080000:3.0:1783952156.261479:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952156.261483:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952156.261485:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783952156.261488:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952156.261795:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465569536 00000100:00100000:1.0:1783952156.261801:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465569536 00000100:00100000:1.0:1783952156.261845:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:1.0:1783952156.261852:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465569536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783952156.261883:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445163008 avail 1298923520 00000100:00100000:1.0:1783952156.261937:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465569536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952156.261953:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00100000:2.0:1783952156.262080:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465569536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952156.769788:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952156.769811:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465569664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952156.769880:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952156.769885:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952156.769895:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465569792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952156.769923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952156.769951:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465569664 00000100:00100000:2.0:1783952156.769959:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465569664 00000100:00100000:2.0:1783952156.770044:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465569792 00000100:00100000:2.0:1783952156.770049:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465569792 00000100:00100000:3.0:1783952156.772916:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00100000:3.0:1783952156.772938:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465569664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952156.772968:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952156.773063:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465569664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (3182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952156.773071:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00100000:3.0:1783952156.773096:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00100000:3.0:1783952156.773111:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465569792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783952156.773124:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952156.773162:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465569792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (3238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952156.773168:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00100000:3.0:1783952156.773240:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465569792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952156.773285:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465569664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952157.169472:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952157.169517:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952157.169548:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447772800 00000100:00100000:1.0:1783952157.169558:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447772800 00000100:00100000:1.0:1783952157.169649:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1368 00000100:00100000:1.0:1783952157.169660:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:2401:x1870605447772800:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000080:1.0:1783952157.169692:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147743480 x1870605447772800/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:418/0 lens 224/224 e 0 to 0 dl 1783952168 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952157.169747:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:2401:x1870605447772800:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952157.169755:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1368 00000100:00080000:1.0:1783952157.169858:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783952157.171436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952157.171466:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952157.171485:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952157.171509:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447772928 00000100:00100000:1.0:1783952157.171516:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447772928 00000100:00100000:1.0:1783952157.171561:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1369 00000100:00100000:1.0:1783952157.171569:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447772928:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952157.171650:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447772928:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952157.171657:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1369 00000100:00100000:1.0:1783952157.171678:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447773056 00000100:00100000:1.0:1783952157.171681:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447773056 00000100:00100000:1.0:1783952157.171713:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447773184 00000100:00100000:1.0:1783952157.171715:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447773184 00000100:00100000:1.0:1783952157.171734:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2836 00000100:00100000:1.0:1783952157.171739:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447773056:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952157.171854:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447773056:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952157.171862:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2836 00000100:00100000:1.0:1783952157.171875:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2837 00000100:00100000:1.0:1783952157.171881:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2398:x1870605447773184:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952157.171902:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2398:x1870605447773184:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 23us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952157.171908:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2837 00000100:00080000:1.0:1783952157.171933:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952157.171936:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952157.171939:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952157.172651:0:92499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447772672 00000100:00100000:1.0:1783952157.172659:0:92499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447772672 00000100:00100000:1.0:1783952157.172697:0:92499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 172 00000100:00100000:1.0:1783952157.172704:0:92499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447772672:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952157.172746:0:92499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447772672:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 41us (3282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952157.172752:0:92499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 172 00010000:00010000:2.0:1783952157.221112:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952158.240878:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952158.304889:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465569920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952158.304976:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952158.305088:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465569920 00000100:00100000:1.0:1783952158.305105:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465569920 00000100:00100000:1.0:1783952158.305165:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00100000:1.0:1783952158.305175:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465569920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952158.305219:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952158.305266:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465569920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952158.305274:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000100:00100000:1.0:1783952158.305347:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465569920:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783952158.305647:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952158.305881:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783952158.305893:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465570048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952158.305928:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952158.306327:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465570048 00000100:00100000:0.0:1783952158.306343:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465570048 00000100:00100000:0.0:1783952158.306522:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00100000:0.0:1783952158.306533:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465570048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952158.306558:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952158.306650:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465570048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952158.306657:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00080000:3.0:1783952158.306781:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952158.307332:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465570048:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783952159.264849:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952160.289616:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952161.312969:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952161.376838:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783952161.376864:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465570176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952161.376943:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952161.377140:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952161.377149:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465570304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952161.377176:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952161.377208:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465570176 00000100:00100000:0.0:1783952161.377214:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465570176 00000100:00100000:0.0:1783952161.377268:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465570304 00000100:00100000:0.0:1783952161.377271:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465570304 00000100:00100000:0.0:1783952161.377294:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:0.0:1783952161.377302:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465570176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783952161.377339:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:0.0:1783952161.377379:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465570176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952161.377387:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00100000:0.0:1783952161.377403:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:0.0:1783952161.377408:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465570304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783952161.377442:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445163008 avail 1298923520 00010000:00000080:0.0:1783952161.377454:0:23862:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04aa49180 x1870605465570304/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:422/0 lens 224/368 e 0 to 0 dl 1783952172 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952161.377486:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465570304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952161.377493:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00100000:0.0:1783952161.377537:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ab00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465570304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952161.377749:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465570176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952161.379764:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465570816:0@lo:400:kworker.0 00000100:00100000:3.0:1783952161.379821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952161.379849:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465571328:0@lo:400:kworker.0 00000100:00100000:3.0:1783952161.379870:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952161.379892:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783952161.379898:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465570688:0@lo:400:kworker.0 00000100:00100000:3.0:1783952161.379920:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952161.379937:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465571200:0@lo:400:kworker.0 00000100:00100000:3.0:1783952161.379959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952161.379973:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465571712:0@lo:400:kworker.0 00000100:00100000:3.0:1783952161.379992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952161.380266:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465570560:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.380307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952161.380326:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465571072:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.380344:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952161.380361:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465571584:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.380380:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952161.380399:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783952161.380405:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465570432:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.380430:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952161.380583:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465570816 00000100:00100000:3.0:1783952161.380622:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465570816 00000100:00080000:0.0:1783952161.380692:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783952161.382389:0:92498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465570432 00000100:00100000:1.0:1783952161.382400:0:92498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465570432 00000100:00100000:1.0:1783952161.382458:0:92498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783952161.382468:0:92498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465570432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952161.382539:0:92498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465570432:12345-0@lo:400:kworker.0 Request processed in 72us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952161.382547:0:92498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783952161.384837:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465571200 00000100:00100000:0.0:1783952161.384851:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465571200 00000100:00100000:0.0:1783952161.384929:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465571072 00000100:00100000:0.0:1783952161.384933:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465571072 00000100:00100000:0.0:1783952161.384955:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465571584 00000100:00100000:0.0:1783952161.384959:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465571584 00000100:00100000:0.0:1783952161.384983:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:0.0:1783952161.384992:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465571200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952161.385097:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465571200:12345-0@lo:400:kworker.0 Request processed in 106us (5136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952161.385104:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:0.0:1783952161.385121:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839 00000100:00100000:0.0:1783952161.385127:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465571072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952161.385157:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465571072:12345-0@lo:400:kworker.0 Request processed in 30us (4811us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952161.385162:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839 00000100:00100000:0.0:1783952161.385173:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:0.0:1783952161.385179:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465571584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952161.385224:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465571584:12345-0@lo:400:kworker.0 Request processed in 45us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952161.385230:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:0.0:1783952161.385367:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465571328 00000100:00100000:0.0:1783952161.385372:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465571328 00000100:00080000:1.0:1783952161.385422:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952161.385427:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952161.386374:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465570432:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.386388:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465570944:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.386431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952161.386466:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465571456:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.386489:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952161.386520:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465571072:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.386532:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465571584:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.386585:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465571456 00000100:00100000:2.0:1783952161.386604:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465571456 00000100:00100000:2.0:1783952161.386761:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:2.0:1783952161.386769:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465571456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.386817:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465571456:12345-0@lo:400:kworker.0 Request processed in 49us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952161.386824:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:3.0:1783952161.388797:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465570688 00000100:00100000:3.0:1783952161.388808:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465570688 00000100:00100000:0.0:1783952161.389230:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465571712 00000100:00100000:0.0:1783952161.389235:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465571712 00000100:00100000:0.0:1783952161.389450:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465570560 00000100:00100000:0.0:1783952161.389453:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465570560 00000100:00100000:0.0:1783952161.389468:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465570944 00000100:00100000:0.0:1783952161.389471:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465570944 00000100:00100000:0.0:1783952161.389489:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:0.0:1783952161.389498:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465570816:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952161.389525:0:67035:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b174af7800 x1870605465570816/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:422/0 lens 224/224 e 0 to 0 dl 1783952172 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952161.389619:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465570816:12345-0@lo:400:kworker.0 Request processed in 123us (9798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952161.389627:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:0.0:1783952161.389645:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:0.0:1783952161.389662:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465571328:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952161.389674:0:67035:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b174af7480 x1870605465571328/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:422/0 lens 224/224 e 0 to 0 dl 1783952172 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952161.389704:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465571328:12345-0@lo:400:kworker.0 Request processed in 53us (9832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952161.389710:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:0.0:1783952161.389722:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1783952161.389728:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465571712:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952161.389754:0:67035:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049ded500 x1870605465571712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:422/0 lens 224/224 e 0 to 0 dl 1783952172 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952161.389783:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465571712:12345-0@lo:400:kworker.0 Request processed in 55us (9790us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952161.389790:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1783952161.389803:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:0.0:1783952161.389809:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465570560:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952161.389820:0:67035:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b050958380 x1870605465570560/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:422/0 lens 224/224 e 0 to 0 dl 1783952172 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952161.389845:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465570560:12345-0@lo:400:kworker.0 Request processed in 37us (9538us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952161.389851:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:0.0:1783952161.389862:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:0.0:1783952161.389868:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465570944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952161.389897:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465570944:12345-0@lo:400:kworker.0 Request processed in 29us (3465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952161.389902:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:0.0:1783952161.389974:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465571200:0@lo:400:kworker.0 00000100:00100000:0.0:1783952161.389986:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465571712:0@lo:400:kworker.0 00000100:00100000:0.0:1783952161.389997:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465570816:0@lo:400:kworker.0 00000100:00100000:0.0:1783952161.390007:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465571328:0@lo:400:kworker.0 00000100:00080000:2.0:1783952161.393764:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783952161.393774:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952161.393787:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952161.393838:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465570944:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.393854:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465571456:0@lo:400:kworker.0 00000100:00100000:2.0:1783952161.393867:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465570560:0@lo:400:kworker.0 00000100:00100000:3.0:1783952161.394008:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:3.0:1783952161.394022:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465570688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952161.394111:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465570688:12345-0@lo:400:kworker.0 Request processed in 95us (14191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952161.394118:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:3.0:1783952161.394163:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465570688:0@lo:400:kworker.0 00000100:00100000:3.0:1783952161.889092:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465571840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952161.889158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952161.889221:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465571840 00000100:00100000:3.0:1783952161.889229:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465571840 00000100:00100000:3.0:1783952161.889284:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219 00000100:00100000:3.0:1783952161.889294:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465571840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783952161.889324:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952161.889384:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465571840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952161.889392:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219 00000100:00100000:3.0:1783952161.889437:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465571840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952161.890678:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952161.890696:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465571968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952161.890776:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952161.890832:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465571968 00000100:00100000:3.0:1783952161.890837:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465571968 00000100:00100000:3.0:1783952161.890873:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:3.0:1783952161.890882:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465571968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952161.890915:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952161.891106:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465571968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 223us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952161.891112:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:3.0:1783952161.891236:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465571968:0@lo:13:osp-pre-1-0.0 00000020:00080000:3.0:1783952161.893638:0:75694:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444094 batchid updated 00000020:00080000:2.0:1783952161.893964:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444094 00000001:00100000:3.0:1783952161.894122:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000004:00080000:2.0:1783952161.895210:0:75714:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97b174b5e780 with version 18 00000020:00080000:2.0:1783952161.895230:0:75714:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444093 cancel update log [0x2000090a1:0x6:0x0].4: rc = 0 00000004:00080000:3.0:1783952161.895321:0:75700:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97b1748af6c0 version 18 rpc_version 18 00000020:00100000:3.0:1783952161.895417:0:75700:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783952161.895429:0:75700:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97b049ded880 x1870605465572224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952161.895455:0:75700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ded880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465572224:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783952161.895527:0:75700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952161.895575:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952161.895614:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465572224 00000100:00100000:3.0:1783952161.895622:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465572224 00000020:00080000:2.0:1783952161.895937:0:75714:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444093 cancel update log [0x2400088d0:0x2:0x0].5: rc = 0 00000004:00080000:2.0:1783952161.895975:0:75714:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff97b174b5e840 with version 19 00000020:00080000:2.0:1783952161.895979:0:75714:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444094 cancel update log [0x2000090a1:0x6:0x0].5: rc = 0 00000020:00080000:2.0:1783952161.896001:0:75714:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444094 cancel update log [0x2400088d0:0x2:0x0].6: rc = 0 00000020:00080000:2.0:1783952161.896011:0:75714:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444094 00000100:00100000:3.0:1783952161.896254:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:3.0:1783952161.896265:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75700:x1870605465572224:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:3.0:1783952161.896378:0:23862:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049def100 x1870605465572224/t120259084299(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:422/0 lens 488/4320 e 0 to 0 dl 1783952172 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952161.896430:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75700:x1870605465572224:12345-0@lo:1000:osp_up0-1.0 Request processed in 167us (902us total) trans 120259084299 rc 0/0 00000100:00100000:3.0:1783952161.896438:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:3.0:1783952161.896672:0:75700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ded880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465572224:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1783952161.896683:0:75700:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff97b1748af6c0 version 19 rpc_version 19 00000020:00100000:3.0:1783952161.896705:0:75700:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783952161.896711:0:75700:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff97b049deea00 x1870605465572480/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952161.896726:0:75700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049deea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465572480:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783952161.896759:0:75700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952161.896778:0:75700:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147dee480 going to sleep for 11 seconds 00000100:00100000:3.0:1783952161.896807:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465572480 00000100:00100000:3.0:1783952161.896812:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465572480 00000100:00100000:3.0:1783952161.896841:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:3.0:1783952161.896847:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75700:x1870605465572480:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1783952161.929315:0:92492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084299 is committed 00000001:00080000:1.0:1783952161.929349:0:92492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00010000:00010000:0.0:1783952161.929492:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929516:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929524:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929530:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952161.929535:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929543:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929569:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b1767ed900) 00010000:00010000:0.0:1783952161.929572:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952161.929578:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929585:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70e00/0x22c73c7857bb5e19 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929635:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929642:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929658:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929663:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952161.929672:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929679:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929687:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b1767ed900) 00010000:00010000:0.0:1783952161.929690:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952161.929692:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952161.929697:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5e51 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1783952161.931969:0:26467:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dee300 x1870605465572480/t120259084300(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:422/0 lens 488/4320 e 0 to 0 dl 1783952172 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952161.932954:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75700:x1870605465572480:12345-0@lo:1000:osp_up0-1.0 Request processed in 36103us (36190us total) trans 120259084300 rc 0/0 00000100:00100000:3.0:1783952161.932966:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00100000:0.0:1783952161.938831:0:75700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049deea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75700:1870605465572480:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783952162.291016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952162.291067:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952162.291103:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952162.291132:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952162.291154:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952162.291185:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447773696 00000100:00100000:0.0:1783952162.291195:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447773696 00000100:00100000:0.0:1783952162.291248:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447773824 00000100:00100000:0.0:1783952162.291252:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447773824 00000100:00100000:0.0:1783952162.291275:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2842 00000100:00100000:0.0:1783952162.291285:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447773696:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952162.291353:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447773696:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 70us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952162.291361:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2842 00000100:00100000:0.0:1783952162.291385:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2843 00000100:00100000:0.0:1783952162.291391:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447773824:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952162.291417:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447773824:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952162.291423:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2843 00000100:00100000:0.0:1783952162.291441:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447773440 00000100:00100000:0.0:1783952162.291444:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447773440 00000100:00100000:0.0:1783952162.291472:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447773568 00000100:00100000:0.0:1783952162.291475:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447773568 00000100:00100000:0.0:1783952162.291495:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1376 00000100:00100000:0.0:1783952162.291501:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447773440:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000080:0.0:1783952162.291518:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b174af6680 x1870605447773440/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:423/0 lens 224/224 e 0 to 0 dl 1783952173 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952162.291555:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447773440:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 54us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952162.291563:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1376 00000100:00100000:0.0:1783952162.291576:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1377 00000100:00100000:0.0:1783952162.291583:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447773568:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952162.291633:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447773568:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 50us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952162.291639:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1377 00000100:00080000:0.0:1783952162.291659:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952162.291663:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952162.291665:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952162.291667:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952162.291877:0:92502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447773312 00000100:00100000:2.0:1783952162.291882:0:92502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447773312 00000100:00100000:2.0:1783952162.291919:0:92502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 174 00000100:00100000:2.0:1783952162.291924:0:92502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dcdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447773312:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952162.291958:0:92502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dcdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447773312:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 34us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952162.291965:0:92502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 174 00010000:00010000:1.0:1783952162.340214:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783952162.868067:0:93687:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1783952162.989529:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952162.990351:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447773952 00000100:00100000:3.0:1783952162.990364:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447773952 00000100:00100000:3.0:1783952162.990432:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1387 00000100:00100000:3.0:1783952162.990443:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:72075:x1870605447773952:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952162.990466:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952162.990488:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4b9 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952162.990563:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952162.990608:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952162.990622:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952162.990787:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783952162.990792:0:66237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952162.990827:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952162.990853:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4b9 expref: 11 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952162.990869:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4b9 expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952162.990878:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176ee0500) 00010000:00010000:3.0:1783952162.990881:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783952162.990884:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762aea00, rc 0) 00010000:00000080:3.0:1783952162.990892:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14474ea00 x1870605447773952/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:423/0 lens 576/688 e 0 to 0 dl 1783952173 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952162.990963:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:72075:x1870605447773952:12345-192.168.202.48@tcp:101:touch.0 Request processed in 522us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952162.990971:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1387 00000100:00100000:2.0:1783952163.009424:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952163.009508:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447774080 00000100:00100000:0.0:1783952163.009520:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447774080 00000100:00100000:0.0:1783952163.009620:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1388 00000100:00100000:0.0:1783952163.009631:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:72075:x1870605447774080:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952163.009661:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952163.009683:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5e74 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4c0 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009753:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009769:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009782:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009796:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5e82 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009803:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5e82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009808:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5e82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009877:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb5e89 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009885:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb5e89 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009909:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb5e89 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952163.009930:0:66238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb5e89 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009943:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009949:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009955:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009962:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009968:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2da00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952163.009972:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009980:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.009992:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b146f44800) 00010000:00010000:0.0:1783952163.009995:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952163.010000:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010005:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb5e7b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010023:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5e82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010029:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5e82 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010034:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5e82 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010038:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2cc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952163.010040:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5e82 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010046:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5e82 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010053:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff97b164ef8900) 00010000:00010000:0.0:1783952163.010055:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952163.010057:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5e82 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010062:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5e82 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010091:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb5e74 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4c0 expref: 12 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010103:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb5e89 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4c0 expref: 11 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.010120:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b16048b000) 00010000:00010000:0.0:1783952163.010122:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783952163.010125:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d600, rc 0) 00010000:00000080:0.0:1783952163.010132:0:66238:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b05095ad80 x1870605447774080/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:424/0 lens 576/584 e 0 to 0 dl 1783952174 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952163.010197:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:72075:x1870605447774080:12345-192.168.202.48@tcp:101:touch.0 Request processed in 568us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952163.010204:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1388 00000100:00100000:0.0:1783952163.013070:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952163.013147:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447774208 00000100:00100000:3.0:1783952163.013157:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447774208 00000100:00100000:3.0:1783952163.013218:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1389 00000100:00100000:3.0:1783952163.013254:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:72075:x1870605447774208:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952163.013275:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952163.013300:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e90 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4c7 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.013360:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aec00/0x22c73c7857bb5e97 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.013373:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aec00/0x22c73c7857bb5e97 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.013385:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aec00/0x22c73c7857bb5e97 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952163.013433:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1783952163.013437:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783952163.013488:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae400/0x22c73c7857bb5e90 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4c7 expref: 7 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.013505:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762aec00/0x22c73c7857bb5e97 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4c7 expref: 6 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.013513:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44700) 00010000:00010000:3.0:1783952163.013515:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1783952163.013519:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762aec00, rc 0) 00000100:00100000:3.0:1783952163.013615:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:72075:x1870605447774208:12345-192.168.202.48@tcp:101:touch.0 Request processed in 373us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952163.013622:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1389 00000100:00100000:2.0:1783952163.017032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952163.017097:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447774336 00000100:00100000:3.0:1783952163.017123:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447774336 00000100:00100000:3.0:1783952163.017190:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 727 00000100:00100000:3.0:1783952163.017201:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2400:x1870605447774336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783952163.017220:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952163.017808:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb5e89 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4c0 expref: 11 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.017829:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b16048b000) 00010000:00010000:3.0:1783952163.017836:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952163.017971:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2400:x1870605447774336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 770us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952163.017980:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 727 00000100:00100000:2.0:1783952163.028765:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952163.028846:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447774592 00000100:00100000:0.0:1783952163.028857:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447774592 00000100:00100000:0.0:1783952163.028921:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1390 00000100:00100000:0.0:1783952163.028930:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:72075:x1870605447774592:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952163.028952:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952163.028972:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c800/0x22c73c7857bb5e9e lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4ce expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.029081:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.029095:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.029107:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.029120:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.029141:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.029148:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952163.029321:0:67035:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67035:1870605465572608:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783952163.029372:0:67035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952163.029411:0:67035:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048af1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783952163.029726:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465572608 00000100:00100000:2.0:1783952163.029732:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465572608 00000100:00100000:2.0:1783952163.029775:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:2.0:1783952163.029784:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67035:x1870605465572608:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1783952163.029829:0:23862:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1762f2680 x1870605465572608/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:424/0 lens 328/4320 e 0 to 0 dl 1783952174 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952163.029881:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:67035:x1870605465572608:12345-0@lo:1000:mdt00_003.0 Request processed in 99us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952163.029889:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:2.0:1783952163.029933:0:67035:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67035:1870605465572608:0@lo:1000:mdt00_003.0 00000004:00080000:2.0:1783952163.030213:0:67035:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0xb1:0x0], count =369 00000004:00080000:2.0:1783952163.030220:0:67035:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0xb1:0x0]+369 in llog 00000004:00080000:2.0:1783952163.030363:0:67035:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x222:0x0], index 1: 0 00010000:00010000:2.0:1783952163.030533:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a14c00/0x22c73c7857bb5eb3 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030579:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a14c00/0x22c73c7857bb5eb3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030609:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a14c00/0x22c73c7857bb5eb3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030642:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030648:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030655:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030673:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030679:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2cc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952163.030683:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030691:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030706:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44700) 00010000:00010000:2.0:1783952163.030709:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952163.030713:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030721:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2cc00/0x22c73c7857bb5ea5 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952163.030735:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075b9f71d reply state 00000000c07c05fa transno 77309411466 ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030745:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030751:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff97b164ef8900) 00010000:00010000:2.0:1783952163.030753:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952163.030756:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783952163.030793:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c800/0x22c73c7857bb5e9e lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ce expref: 9 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030807:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a14c00/0x22c73c7857bb5eb3 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ce expref: 8 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.030821:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff97b16048b500) 00010000:00010000:2.0:1783952163.030824:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952163.030826:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a14c00, rc 0) 00000100:00100000:2.0:1783952163.031008:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:72075:x1870605447774592:12345-192.168.202.48@tcp:101:touch.0 Request processed in 2078us (2252us total) trans 77309411466 rc 0/0 00000100:00100000:2.0:1783952163.031016:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1390 00000100:00100000:3.0:1783952163.039192:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952163.039332:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447774848 00000100:00100000:0.0:1783952163.039343:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447774848 00000100:00100000:0.0:1783952163.039406:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1391 00000100:00100000:0.0:1783952163.039416:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:72075:x1870605447774848:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:0.0:1783952163.039473:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952163.039499:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a14c00/0x22c73c7857bb5eb3 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ce expref: 9 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.039518:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff97b16048b500) 00010000:00010000:0.0:1783952163.039527:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952163.039612:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.039626:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.039645:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952163.039754:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034187f2a reply state 00000000e5f71bc2 transno 77309411467 ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.039778:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.039784:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff97b164ef8800) 00010000:00010000:0.0:1783952163.039787:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952163.039789:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952163.039876:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:72075:x1870605447774848:12345-192.168.202.48@tcp:36:touch.0 Request processed in 462us (696us total) trans 77309411467 rc 0/0 00000100:00100000:0.0:1783952163.039884:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1391 00000100:00100000:3.0:1783952163.043831:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952163.043988:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447774976 00000100:00100000:0.0:1783952163.043998:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447774976 00000100:00100000:0.0:1783952163.044048:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1392 00000100:00100000:0.0:1783952163.044058:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:72075:x1870605447774976:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952163.044085:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952163.044106:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d400/0x22c73c7857bb5ec8 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4d5 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.044165:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d400/0x22c73c7857bb5ec8 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4d5 expref: 11 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.044180:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d400/0x22c73c7857bb5ec8 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4d5 expref: 11 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.044199:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff97b164ef8800) 00010000:00010000:0.0:1783952163.044203:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783952163.044207:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d400, rc 0) 00000100:00100000:0.0:1783952163.044271:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:72075:x1870605447774976:12345-192.168.202.48@tcp:101:touch.0 Request processed in 214us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952163.044286:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1392 00000100:00100000:0.0:1783952163.050300:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952163.050428:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447775104 00000100:00100000:3.0:1783952163.050438:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447775104 00000100:00100000:3.0:1783952163.050504:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4952 00000100:00100000:3.0:1783952163.050514:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447775104:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:3.0:1783952163.050819:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2399:x1870605447775104:12345-192.168.202.48@tcp:2:touch.0 Request processed in 306us (530us total) trans 4294968957 rc 0/0 00000100:00100000:3.0:1783952163.050826:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4952 00000100:00100000:3.0:1783952163.063444:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952163.066355:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447775360 00000100:00100000:2.0:1783952163.066372:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447775360 00000100:00100000:2.0:1783952163.066510:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 243 00000100:00100000:2.0:1783952163.066522:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:72075:x1870605447775360:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:2.0:1783952163.066862:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:72075:x1870605447775360:12345-192.168.202.48@tcp:35:touch.0 Request processed in 341us (3423us total) trans 77309411468 rc 0/0 00000100:00100000:2.0:1783952163.066871:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 243 00000100:00100000:1.0:1783952163.091557:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952163.091947:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447775488 00000100:00100000:3.0:1783952163.091958:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447775488 00000100:00100000:3.0:1783952163.092020:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1393 00000100:00100000:3.0:1783952163.092031:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:72076:x1870605447775488:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952163.092052:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952163.092073:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5ecf lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4dc expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092383:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092399:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092413:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092428:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb5edd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092435:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb5edd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092442:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb5edd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092501:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5ee4 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092511:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5ee4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092518:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5ee4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952163.092550:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5ee4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092564:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092578:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092727:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092736:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092742:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952163.092747:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092754:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092767:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b146f44800) 00010000:00010000:3.0:1783952163.092770:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952163.092775:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092782:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb5ed6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092795:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb5edd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092801:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb5edd lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092807:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb5edd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092820:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952163.092823:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb5edd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092830:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb5edd lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092840:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff97b146f44600) 00010000:00010000:3.0:1783952163.092843:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952163.092846:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb5edd lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092851:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae600/0x22c73c7857bb5edd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092885:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae400/0x22c73c7857bb5ecf lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4dc expref: 12 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092899:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5ee4 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4dc expref: 11 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.092906:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b155d9d000) 00010000:00010000:3.0:1783952163.092909:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783952163.092911:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af200, rc 0) 00010000:00000080:3.0:1783952163.092921:0:66237:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147741500 x1870605447775488/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:424/0 lens 576/584 e 0 to 0 dl 1783952174 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952163.092992:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:72076:x1870605447775488:12345-192.168.202.48@tcp:101:touch.0 Request processed in 963us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952163.093010:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1393 00000100:00100000:1.0:1783952163.103798:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952163.103897:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952163.103931:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447775744 00000100:00100000:1.0:1783952163.103949:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447775744 00000100:00100000:1.0:1783952163.104012:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 728 00000100:00100000:1.0:1783952163.104023:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ef40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2400:x1870605447775744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783952163.104039:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952163.104066:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb5ee4 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4dc expref: 11 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952163.104083:0:22092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b155d9d000) 00010000:00010000:1.0:1783952163.104088:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952163.104136:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ef40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2400:x1870605447775744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 115us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952163.104144:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 728 00000100:00100000:2.0:1783952163.109480:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447775616 00000100:00100000:2.0:1783952163.109496:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447775616 00000100:00100000:2.0:1783952163.109576:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1394 00000100:00100000:2.0:1783952163.109604:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:72076:x1870605447775616:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952163.109632:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952163.110336:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15e00/0x22c73c7857bb5eeb lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4e3 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.110398:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15000/0x22c73c7857bb5ef2 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.110413:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15000/0x22c73c7857bb5ef2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.110435:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15000/0x22c73c7857bb5ef2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952163.110482:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783952163.110486:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1783952163.110522:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15e00/0x22c73c7857bb5eeb lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4e3 expref: 14 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.110550:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b175a15000/0x22c73c7857bb5ef2 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4e3 expref: 13 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952163.110560:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b16048b700) 00010000:00010000:2.0:1783952163.110563:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1783952163.110566:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a15000, rc 0) 00000100:00100000:2.0:1783952163.110892:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:72076:x1870605447775616:12345-192.168.202.48@tcp:101:touch.0 Request processed in 1306us (7102us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952163.110901:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1394 00000100:00100000:2.0:1783952163.121381:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952163.121553:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447776000 00000100:00100000:0.0:1783952163.121564:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447776000 00000100:00100000:0.0:1783952163.122192:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1395 00000100:00100000:0.0:1783952163.122204:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:72076:x1870605447776000:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952163.122227:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952163.122261:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c400/0x22c73c7857bb5ef9 lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4ea expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.122367:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.122382:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.122392:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.122408:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.122415:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.122421:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783952163.122908:0:66236:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x223:0x0], index 1: 0 00010000:00010000:0.0:1783952163.123061:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d000/0x22c73c7857bb5f0e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123084:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d000/0x22c73c7857bb5f0e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123093:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d000/0x22c73c7857bb5f0e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123128:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123137:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123143:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123149:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123155:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2dc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952163.123160:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123168:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123180:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b16048b700) 00010000:00010000:0.0:1783952163.123183:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952163.123188:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123194:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2dc00/0x22c73c7857bb5f00 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952163.123215:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000decf38d9 reply state 00000000d4f48580 transno 77309411469 ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123227:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123308:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff97b164ef8f00) 00010000:00010000:0.0:1783952163.123311:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952163.123314:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783952163.123348:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c400/0x22c73c7857bb5ef9 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ea expref: 16 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123364:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d000/0x22c73c7857bb5f0e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ea expref: 15 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952163.123372:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff97b164ef8b00) 00010000:00010000:0.0:1783952163.123374:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952163.123377:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d000, rc 0) 00000100:00100000:0.0:1783952163.123456:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:72076:x1870605447776000:12345-192.168.202.48@tcp:101:touch.0 Request processed in 1253us (2083us total) trans 77309411469 rc 0/0 00000100:00100000:0.0:1783952163.123465:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1395 00000100:00100000:1.0:1783952163.139804:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952163.139845:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447776256 00000100:00100000:1.0:1783952163.139854:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447776256 00000100:00100000:1.0:1783952163.139915:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1396 00000100:00100000:1.0:1783952163.139926:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:72076:x1870605447776256:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:1.0:1783952163.139982:0:67035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952163.140010:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d000/0x22c73c7857bb5f0e lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ea expref: 16 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952163.140027:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff97b164ef8b00) 00010000:00010000:1.0:1783952163.140039:0:67035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952163.140096:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952163.140110:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952163.140130:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952163.140822:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e3895bf reply state 0000000055fc35bc transno 77309411470 ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952163.140837:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952163.140843:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff97b1767edb00) 00010000:00010000:1.0:1783952163.140846:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952163.140848:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783952163.140950:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:72076:x1870605447776256:12345-192.168.202.48@tcp:36:touch.0 Request processed in 1024us (1153us total) trans 77309411470 rc 0/0 00000100:00100000:1.0:1783952163.140958:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1396 00000100:00100000:1.0:1783952163.147667:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952163.148466:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447776384 00000100:00100000:3.0:1783952163.148477:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447776384 00000100:00100000:3.0:1783952163.148579:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1397 00000100:00100000:3.0:1783952163.148608:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:72076:x1870605447776384:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952163.148642:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952163.148663:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae400/0x22c73c7857bb5f23 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4f1 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.148720:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae400/0x22c73c7857bb5f23 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f1 expref: 18 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.148737:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b1762ae400/0x22c73c7857bb5f23 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f1 expref: 18 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952163.148755:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff97b1767edb00) 00010000:00010000:3.0:1783952163.148759:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783952163.148762:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762ae400, rc 0) 00000100:00100000:3.0:1783952163.148822:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+18:72076:x1870605447776384:12345-192.168.202.48@tcp:101:touch.0 Request processed in 235us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952163.148829:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1397 00000100:00100000:2.0:1783952163.154955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952163.155027:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447776512 00000100:00100000:3.0:1783952163.155037:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447776512 00000100:00100000:3.0:1783952163.155096:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4953 00000100:00100000:3.0:1783952163.155108:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2401:x1870605447776512:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:3.0:1783952163.155455:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2401:x1870605447776512:12345-192.168.202.48@tcp:2:touch.0 Request processed in 349us (507us total) trans 4294968958 rc 0/0 00000100:00100000:3.0:1783952163.155477:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4953 00000100:00100000:1.0:1783952163.159149:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952163.159305:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447776768 00000100:00100000:0.0:1783952163.159316:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447776768 00000100:00100000:0.0:1783952163.159408:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 244 00000100:00100000:0.0:1783952163.159420:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+18:72076:x1870605447776768:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:0.0:1783952163.159918:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:72076:x1870605447776768:12345-192.168.202.48@tcp:35:touch.0 Request processed in 500us (776us total) trans 77309411471 rc 0/0 00000100:00100000:0.0:1783952163.159944:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 244 00010000:00010000:0.0:1783952163.362083:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952163.425627:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465572736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952163.425707:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952163.425755:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465572736 00000100:00100000:1.0:1783952163.425761:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465572736 00000100:00100000:1.0:1783952163.425800:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:1.0:1783952163.425807:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465572736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952163.425831:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952163.425862:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465572736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952163.425866:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00080000:1.0:1783952163.425894:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952163.425954:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465572736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952163.426294:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952163.426304:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465572864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952163.426328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952163.426349:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465572864 00000100:00100000:3.0:1783952163.426352:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465572864 00000100:00100000:3.0:1783952163.426379:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222 00000100:00100000:3.0:1783952163.426386:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465572864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783952163.426416:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952163.426442:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465572864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952163.426447:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222 00000100:00100000:3.0:1783952163.426468:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465572864:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783952163.427563:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783952164.392324:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783952165.019318:0:93784:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783952165.019363:0:93784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.019374:0:93784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.019379:0:93784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.019383:0:93784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.019399:0:93784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783952165.019403:0:93784:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1783952165.019423:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1783952165.019428:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1783952165.019430:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952165.019432:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783952165.019437:0:93784:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1783952165.019438:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2de00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952165.019441:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.019448:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783952165.019461:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b046483000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:2.0:1783952165.019477:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952165.019483:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783952165.019485:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783952165.019488:0:7459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1783952165.019498:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465572992:0@lo:39:umount.0 00010000:00010000:2.0:1783952165.019512:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.019530:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952165.019551:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.019557:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b047b2de00/0x22c73c7857bb5c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5c3d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.019567:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952165.019569:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952165.019571:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952165.019581:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465573120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952165.019582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952165.019645:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952165.019664:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465572992 00000100:00100000:0.0:1783952165.019671:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465572992 00000100:00100000:2.0:1783952165.019685:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465573120 00000100:00100000:2.0:1783952165.019688:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465573120 00000100:00100000:0.0:1783952165.019709:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1783952165.019715:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:0.0:1783952165.019717:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465572992:12345-0@lo:39:umount.0 00000100:00100000:2.0:1783952165.019720:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465573120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952165.019731:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1783952165.019740:0:66236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5893 00010000:00010000:2.0:1783952165.019746:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216a600/0x22c73c7857bb5c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5c36 expref: 24 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783952165.019759:0:66236:0:(import.c:65:import_set_state_nolock()) ffff97b144576800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783952165.019770:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00000080:0.0:1783952165.019784:0:66236:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1762f2d80 x1870605465572992/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:426/0 lens 224/224 e 0 to 0 dl 1783952176 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952165.019810:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3645:x1870605465573120:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952165.019816:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1870605465572992:12345-0@lo:39:umount.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952165.019818:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:0.0:1783952165.019824:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000020:00000080:0.0:1783952165.019832:0:66236:0:(genops.c:906:class_export_put()) final put ffff97b144576000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1783952165.019881:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465573120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952165.019901:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783952165.020051:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046483000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783952165.020058:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465572992:0@lo:39:umount.0 00000100:00080000:0.0:1783952165.020089:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783952165.020091:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783952165.020094:0:93784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783952165.020121:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144576000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783952165.020314:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144576800 for lustre-MDT0000 00010000:00010000:0.0:1783952165.021151:0:93784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021164:0:93784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021171:0:93784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021176:0:93784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021245:0:93784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952165.021253:0:93784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021259:0:93784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021272:0:93784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021276:0:93784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021286:0:93784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783952165.021292:0:93784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021298:0:93784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021304:0:93784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021309:0:93784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021325:0:93784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783952165.021330:0:93784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021336:0:93784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952165.021343:0:93784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021359:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783952165.021359:0:93784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021367:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021374:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ba00 already unused, calling callback (ffffffffc13acc20) 00010000:00010000:0.0:1783952165.021375:0:93784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:00010000:1.0:1783952165.021378:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952165.021378:0:93784:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1783952165.021386:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783952165.021392:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952165.021397:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783952165.021399:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1783952165.021401:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000004:0.0:1783952165.021406:0:93784:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783952165.021409:0:93784:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1783952165.021413:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1783952165.021418:0:93784:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1783952165.021425:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021431:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952165.021453:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021460:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216ba00/0x22c73c7857bb5c44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5c4b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021485:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783952165.021489:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021496:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd800 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783952165.021499:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021505:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783952165.021512:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.021513:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:1.0:1783952165.021532:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783952165.021534:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783952165.021543:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783952165.021549:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021559:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.021582:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afa00 already unused, calling callback (ffffffffc13acc20) 00010000:00010000:1.0:1783952165.021584:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952165.021630:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021637:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb5797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb579e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021647:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952165.021651:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021663:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216bc00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783952165.021666:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021673:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783952165.021679:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952165.021684:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783952165.021686:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783952165.021688:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783952165.021703:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021709:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952165.021727:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021734:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216bc00/0x22c73c7857bb567f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb5686 expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.021743:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952165.021745:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952165.021747:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952165.021765:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465573248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952165.021817:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952165.021856:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783952165.021868:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465573376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952165.021891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952165.021917:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952165.021922:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952165.021930:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465573504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952165.021960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952165.021997:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465573248 00000100:00100000:1.0:1783952165.022004:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465573248 10000000:00010000:3.0:1783952165.022009:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.022026:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952165.022034:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952165.022049:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465573376 00000100:00100000:1.0:1783952165.022056:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465573376 10000000:01000000:3.0:1783952165.022061:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783952165.022066:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783952165.022070:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:1.0:1783952165.022087:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465573504 00000100:00100000:1.0:1783952165.022093:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465573504 00010000:00010000:3.0:1783952165.022112:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.022121:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783952165.022136:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00010000:00010000:3.0:1783952165.022153:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952165.022153:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3642:x1870605465573248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952165.022176:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb5766 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb576d expref: -99 pid: 92491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.022182:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952165.022190:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952165.022194:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952165.022198:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952165.022211:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db70000/0x22c73c7857bb5c4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5c44 expref: 25 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.022227:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952165.022273:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465573248:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952165.022280:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1783952165.022298:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1783952165.022304:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3642:x1870605465573376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952165.022313:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952165.022321:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86bc00/0x22c73c7857bb579e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5797 expref: 23 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.022331:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952165.022367:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3642:x1870605465573376:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952165.022375:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1783952165.022397:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:3.0:1783952165.022411:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465573376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952165.022412:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3645:x1870605465573504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952165.022433:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783952165.022440:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465573248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952165.022446:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb5686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb567f expref: 21 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.022459:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952165.022489:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3645:x1870605465573504:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952165.022495:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1783952165.022536:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465573632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952165.022560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952165.022623:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465573504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952165.022701:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952165.022713:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465573632 00000100:00100000:2.0:1783952165.022717:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465573632 00000100:00100000:2.0:1783952165.022747:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1783952165.022754:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3645:x1870605465573632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952165.022762:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952165.022771:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762af400/0x22c73c7857bb576d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5766 expref: 20 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.022781:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952165.022812:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3645:x1870605465573632:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952165.022818:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1783952165.022863:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465573632:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1783952165.023821:0:93784:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1783952165.024775:0:92492:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00000020:00000080:1.0:1783952165.025057:0:93784:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1783952165.025066:0:93784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b144575800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783952165.025071:0:93784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b17704d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783952165.025075:0:93784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b144573800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783952165.025081:0:93784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b17407c800 d33551be-a709-4ba2-a74c-f4d7b53c6817 192.168.202.48@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 120259084298 stale:0 00000020:00080000:1.0:1783952165.025085:0:93784:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97b17407e800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 120259084300 stale:0 00000020:00080000:1.0:1783952165.025089:0:93784:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff97b1454599c0) has exports, disconnecting them 00000020:00080000:1.0:1783952165.025093:0:93784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b144575800), last request at 1783952135 00000020:00000080:1.0:1783952165.025098:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb588c 00000100:00080000:1.0:1783952165.025113:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b144570000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783952165.025149:0:93784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b144575800): rc 0 00000020:00000080:1.0:1783952165.025152:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b144575800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1783952165.025168:0:93784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b17704d000), last request at 1783952161 00000020:00000080:1.0:1783952165.025171:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5885 00000100:00080000:1.0:1783952165.025176:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b143cdf800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783952165.025191:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783952165.025199:0:93784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b17704d000): rc 0 00000020:00000080:1.0:1783952165.025209:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b17704d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1783952165.025214:0:93784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b144573800), last request at 1783952161 00000020:00000080:1.0:1783952165.025217:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb587e 00000100:00080000:1.0:1783952165.025222:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b144577000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783952165.025237:0:93784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b144573800): rc 0 00000020:00000080:1.0:1783952165.025239:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b144573800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1783952165.025244:0:93784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.48@tcp (ffff97b17407c800), last request at 1783952163 00000020:00000080:1.0:1783952165.025252:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb56e8 00000020:00010000:1.0:1783952165.025261:0:93784:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b17407c800: total 3 00000100:00080000:1.0:1783952165.025265:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b1447cf800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1783952165.025298:0:6506:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b17407c800: total 3 00000020:00080000:1.0:1783952165.025303:0:93784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b17407c800): rc 0 00000020:00080000:1.0:1783952165.025307:0:93784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97b17407e800), last request at 1783952130 00000020:00000080:1.0:1783952165.025310:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb56e1 00000020:00010000:1.0:1783952165.025314:0:93784:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b17407e800: total 3 00000100:00080000:1.0:1783952165.025317:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b17704c800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1783952165.025326:0:15262:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b17407e800: total 3 00010000:00010000:1.0:1783952165.025328:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952165.025347:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b17407c800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1783952165.025358:0:15262:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b17407e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783952165.025380:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ae00/0x22c73c7857bb5d86 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a47a expref: 5 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.025380:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b400/0x22c73c7857bb58af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb58a8 expref: 5 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.025403:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aea00/0x22c73c7857bb5e6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4b9 expref: 4 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952165.025405:0:15262:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b17407e800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783952165.025419:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb5de1 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a496 expref: 3 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.025442:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b175a14400/0x22c73c7857bb5da2 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a481 expref: 2 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.025457:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b17407c800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1783952165.025514:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144575800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783952165.025571:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17704d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783952165.025604:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144573800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783952165.025623:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144570000 for lustre-MDT0000 00000020:00000080:2.0:1783952165.025626:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b143cdf800 for lustre-MDT0000 00000020:00000080:2.0:1783952165.025629:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144577000 for lustre-MDT0000 00010000:00010000:2.0:1783952165.025646:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952165.028864:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783952165.030239:0:93784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b17407e800): rc 0 00000004:00000080:0.0:1783952165.030252:0:93784:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa80a41d87ae0 00000100:00080000:0.0:1783952165.030280:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783952165.030285:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783952165.031127:0:93784:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783952165.031152:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b164cea000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783952165.031302:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783952165.031306:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968955 gen 3 00000004:00080000:0.0:1783952165.031319:0:93784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783952165.031331:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465573760:0@lo:39:umount.0 00000100:00080000:0.0:1783952165.031373:0:93784:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783952165.031382:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b1476fe800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783952165.031388:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783952165.031390:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968956 gen 3 00000100:00100000:2.0:1783952165.031394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783952165.031397:0:93784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783952165.031430:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465573888:0@lo:9:umount.0 00000100:00100000:2.0:1783952165.031452:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783952165.031453:0:93784:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783952165.031460:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b144763000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783952165.031472:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465574016:0@lo:9:umount.0 00000100:00100000:2.0:1783952165.031490:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783952165.031503:0:93784:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b1454599c0) has no exports 00000100:00100000:2.0:1783952165.031682:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465573760 00000100:00100000:2.0:1783952165.031689:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465573760 00000100:00100000:2.0:1783952165.031736:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:2.0:1783952165.031745:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465573760:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783952165.031771:0:8445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5727 00000100:00080000:2.0:1783952165.031778:0:8445:0:(import.c:65:import_set_state_nolock()) ffff97b046a94000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783952165.031803:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411471 00010000:00010000:0.0:1783952165.031937:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952165.031938:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3641:x1870605465573760:12345-0@lo:39:umount.0 Request processed in 194us (542us total) trans 77309411472 rc 0/0 00000100:00100000:2.0:1783952165.031945:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:2.0:1783952165.031969:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465573888 00000100:00100000:2.0:1783952165.031972:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465573888 00000100:00100000:2.0:1783952165.032016:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465574016 00000100:00100000:2.0:1783952165.032019:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465574016 00000100:00100000:2.0:1783952165.032041:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4954 00000100:00100000:2.0:1783952165.032047:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465573888:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783952165.032060:0:26204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5743 00000100:00080000:2.0:1783952165.032065:0:26204:0:(import.c:65:import_set_state_nolock()) ffff97b144767000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783952165.032105:0:26204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968956 00000100:00100000:2.0:1783952165.032200:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465573888:12345-0@lo:9:umount.0 Request processed in 141us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952165.032223:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4954 00000100:00100000:2.0:1783952165.032236:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4955 00000100:00100000:2.0:1783952165.032243:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465574016:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783952165.032254:0:26204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5751 00000100:00080000:2.0:1783952165.032260:0:26204:0:(import.c:65:import_set_state_nolock()) ffff97b14de80800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783952165.032282:0:26204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968958 00000100:00100000:2.0:1783952165.032356:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3641:x1870605465574016:12345-0@lo:9:umount.0 Request processed in 113us (864us total) trans 0 rc 0/0 00000100:00080000:0.0:1783952165.032360:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952165.032363:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4955 00000100:00080000:0.0:1783952165.032364:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783952165.032384:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783952165.032413:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b144763000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783952165.032432:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783952165.032434:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783952165.032438:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465574016:0@lo:9:umount.0 00000100:00080000:2.0:1783952165.032450:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fe800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783952165.032453:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783952165.032454:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783952165.032456:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465573888:0@lo:9:umount.0 00000100:00080000:2.0:1783952165.032468:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b164cea000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783952165.032473:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465573760:0@lo:39:umount.0 00010000:00010000:2.0:1783952165.032493:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783952165.035050:0:93784:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97b1454599c0) has no exports 00000020:00000080:3.0:1783952165.078035:0:6506:0:(genops.c:906:class_export_put()) final put ffff97b17407c800/d33551be-a709-4ba2-a74c-f4d7b53c6817 00000020:00000080:0.0:1783952165.078223:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407c800/d33551be-a709-4ba2-a74c-f4d7b53c6817 for lustre-MDT0000 00000020:00000080:0.0:1783952165.078284:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1447cf800 for lustre-MDT0000 00010000:00010000:3.0:1783952165.081327:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952165.081335:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952165.081337:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783952165.085032:0:15262:0:(genops.c:906:class_export_put()) final put ffff97b17407e800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1783952165.085120:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952165.085131:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952165.085134:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783952165.086336:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17407e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783952165.086401:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b17704c800 for lustre-MDT0000 00000020:00000080:2.0:1783952165.147824:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb56fd 00000020:00000080:2.0:1783952165.147843:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b176bce000/lustre-QMT0000_UUID 00000020:01000000:2.0:1783952165.147906:0:93784:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783952165.148480:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176bce000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783952165.148855:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783952165.148869:0:93784:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783952165.148875:0:93784:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff97b048b599c0) has no exports 00000020:00000080:3.0:1783952165.149158:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb56f6 00000020:00000080:3.0:1783952165.149165:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b176bcd000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783952165.149277:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176bcd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783952165.149402:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783952165.149410:0:93784:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783952165.149413:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b176bc8800/lustre-QMT0000_UUID 00000020:00000080:3.0:1783952165.149416:0:93784:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176bc8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783952165.149424:0:93784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1783952165.149753:0:93784:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b17639b840 - data ffff97b1655b7870/ffff97b14edc4800 00000020:01000000:3.0:1783952165.149900:0:93784:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b17639b180 - data ffff97b181c47948/ffff97b167c23400 00000100:00080000:3.0:1783952165.221296:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783952165.221304:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783952165.221316:0:93784:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff97b1762f1c00 x1870605465573760/t77309411472(77309411472) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952175 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952165.221340:0:93784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783952165.225011:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783952165.225019:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968955 gen 4 00000004:00080000:3.0:1783952165.225077:0:93784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783952165.225080:0:93784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783952165.229149:0:92510:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783952165.229158:0:92510:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x70:0x0] index 1 count 1 00000040:00080000:1.0:1783952165.229172:0:92510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 28 count 2 00000100:00080000:3.0:1783952165.230063:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783952165.230070:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968956 gen 4 00000004:00080000:3.0:1783952165.230089:0:93784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783952165.230092:0:93784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783952165.232340:0:92512:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783952165.232348:0:92512:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x72:0x0] index 1 count 1 00000040:00080000:0.0:1783952165.232358:0:92512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 28 count 2 00000020:00000080:3.0:1783952165.233778:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb56a9 00000020:00000080:3.0:1783952165.233789:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b164ce8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783952165.234906:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb56be 00000020:00000080:3.0:1783952165.234916:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b0497f5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783952165.234922:0:93784:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783952165.234928:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783952165.234940:0:93784:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783952165.234944:0:93784:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff97b14545b380) has no exports 00000004:01000000:3.0:1783952165.235147:0:93784:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783952165.235156:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb574a 00000020:00000080:3.0:1783952165.235159:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b0497f2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783952165.235163:0:93784:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783952165.235166:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783952165.235174:0:93784:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783952165.235176:0:93784:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff97b0468a0000) has no exports 00000020:00000080:3.0:1783952165.235182:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb573c 00000020:00000080:3.0:1783952165.235185:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b15036a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783952165.235927:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b164ce8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783952165.235942:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0497f5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783952165.235947:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0497f2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783952165.235952:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b15036a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783952165.240053:0:93784:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783952165.240062:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783952165.240066:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968956 gen 5 00000004:00080000:0.0:1783952165.240073:0:93784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783952165.240076:0:93784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783952165.240158:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952165.240172:0:93784:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783952165.240180:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb572e 00000020:00000080:0.0:1783952165.240189:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b04965a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783952165.240868:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144763000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783952165.240876:0:86521:0:(genops.c:906:class_export_put()) final put ffff97b04965e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783952165.240880:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783952165.240887:0:86521:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952165.244286:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783952165.245155:0:93784:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783952165.245166:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952165.245181:0:93784:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783952165.245186:0:93784:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff97b1447bcd40) has no exports 00000020:00000080:0.0:1783952165.245195:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5720 00000020:00000080:0.0:1783952165.245218:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b04d9f6800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783952165.245675:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04d9f6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783952165.245918:0:93784:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783952165.245923:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783952165.245927:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968955 gen 5 00000004:00080000:0.0:1783952165.245934:0:93784:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783952165.245950:0:93784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783952165.245993:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952165.246001:0:93784:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783952165.246015:0:93784:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783952165.246021:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5712 00000020:00000080:0.0:1783952165.246025:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b04965f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783952165.246029:0:93784:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783952165.246032:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952165.246037:0:93784:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783952165.246039:0:93784:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff97b1447b8000) has no exports 00000020:00000080:0.0:1783952165.246044:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb570b 00000020:00000080:0.0:1783952165.246046:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b048caf000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783952165.246320:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1476fe800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783952165.246327:0:86521:0:(genops.c:906:class_export_put()) final put ffff97b04965b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783952165.246329:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783952165.246427:0:86521:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783952165.246507:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783952165.246512:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b048caf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783952165.313746:0:93784:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783952165.313756:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783952165.313760:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783952165.313767:0:93784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783952165.313856:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952165.313872:0:93784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783952165.313904:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952165.313908:0:93784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783952165.313914:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b048caa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783952165.313919:0:93784:0:(genops.c:865:class_export_destroy()) destroying export ffff97b048caa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783952165.313927:0:93784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783952165.314034:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb56c5 00000020:00000080:0.0:1783952165.314042:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b0497f3800/lustre-MDD0000_UUID 00000020:00000080:1.0:1783952165.314428:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b164cea000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783952165.314436:0:86521:0:(genops.c:906:class_export_put()) final put ffff97b04965a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783952165.314438:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783952165.314447:0:86521:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783952165.314558:0:93784:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783952165.314563:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952165.314570:0:93784:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783952165.314574:0:93784:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff97b14545cd40) has no exports 00000020:00000080:1.0:1783952165.314718:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0497f3800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783952165.314782:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952165.314788:0:93784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783952165.314792:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b1469d0000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783952165.314800:0:93784:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1469d0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783952165.314804:0:93784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783952165.314838:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb56cc 00000020:00000080:0.0:1783952165.314844:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b0497f7000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783952165.314893:0:93784:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b174b36000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783952165.314897:0:93784:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174b36000 3 00000020:01000004:0.0:1783952165.314900:0:93784:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b174b36000 from lustre-MDT0000 00000020:00000080:0.0:1783952165.314917:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952165.314922:0:93784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783952165.314925:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b164ceb800/lustre-MDT0000_UUID 00000020:00000080:0.0:1783952165.314927:0:93784:0:(genops.c:865:class_export_destroy()) destroying export ffff97b164ceb800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783952165.314933:0:93784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783952165.314960:0:93784:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783952165.314964:0:93784:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783952165.314967:0:93784:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783952165.314969:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952165.314972:0:93784:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783952165.314981:0:93784:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b1447cc800 e617e28a-7c0f-459e-8765-f628898cec50 192.168.202.48@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783952165.314987:0:93784:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97b176d52800 75da5dc4-aa7e-42cf-a965-1b5f01232c6f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783952165.314992:0:93784:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff97b1447b99c0) has exports, disconnecting them 00000020:00080000:0.0:1783952165.314995:0:93784:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.48@tcp (ffff97b1447cc800), last request at 1783952131 00000020:00000080:0.0:1783952165.315014:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb585b 00000020:00010000:0.0:1783952165.315019:0:93784:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b1447cc800: total 1 00000100:00080000:0.0:1783952165.315022:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b1447ca000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783952165.315048:0:93784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b1447cc800): rc 0 00000020:00080000:0.0:1783952165.315051:0:93784:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97b176d52800), last request at 1783952130 00000020:00000080:0.0:1783952165.315092:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5678 00000020:00010000:0.0:1783952165.315096:0:93784:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b176d52800: total 1 00000100:00080000:0.0:1783952165.315098:0:93784:0:(import.c:65:import_set_state_nolock()) ffff97b176d53800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783952165.315113:0:93784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b176d52800): rc 0 00000020:00080000:0.0:1783952165.315122:0:93784:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff97b1447b99c0) has no exports 00000100:00100000:0.0:1783952165.315180:0:92497:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97b1438a2600:92497] 0 exiting: rc = 1 00000020:00010000:3.0:1783952165.315293:0:6505:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b1447cc800: total 1 00010000:00010000:3.0:1783952165.315329:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b1447cc800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1783952165.315356:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db70600/0x22c73c7857bb5c28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a449 expref: 5 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.315369:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216aa00/0x22c73c7857bb5862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3d9 expref: 4 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.315390:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86a800/0x22c73c7857bb5870 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a3e7 expref: 3 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.315400:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71c00/0x22c73c7857bb5c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a450 expref: 2 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952165.315407:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b1447cc800, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1783952165.315425:0:6505:0:(genops.c:906:class_export_put()) final put ffff97b1447cc800/e617e28a-7c0f-459e-8765-f628898cec50 00000020:00010000:2.0:1783952165.315534:0:7459:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b176d52800: total 2 00010000:00010000:2.0:1783952165.315573:0:7459:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b176d52800, canceled 0 locks, left on hash table 13. 00000100:00100000:0.0:1783952165.315804:0:92499:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97b047828800:92499] 2 exiting: rc = 0 00000100:00100000:0.0:1783952165.315878:0:92498:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97b0489b2e00:92498] 1 exiting: rc = 0 00010000:00010000:2.0:1783952165.316006:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216ac00/0x22c73c7857bb57ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb57b3 expref: 14 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316021:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216be00/0x22c73c7857bb5c67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5c60 expref: 13 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316031:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216ae00/0x22c73c7857bb5c75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5c6e expref: 12 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316040:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b800/0x22c73c7857bb5c83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5c7c expref: 11 pid: 92499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316049:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86a200/0x22c73c7857bb5838 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5831 expref: 10 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316058:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b200/0x22c73c7857bb5c91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5c8a expref: 9 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316069:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbd200/0x22c73c7857bb5846 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb583f expref: 8 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316079:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86a600/0x22c73c7857bb57d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb57cf expref: 7 pid: 92497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316089:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71800/0x22c73c7857bb5cad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5ca6 expref: 6 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316098:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb57e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb57dd expref: 5 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316107:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b047b2c600/0x22c73c7857bb5c9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5c98 expref: 4 pid: 92503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316123:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b18216b000/0x22c73c7857bb5c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5c52 expref: 3 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316133:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86aa00/0x22c73c7857bb580e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb5807 expref: 2 pid: 92498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952165.316142:0:7459:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b176d52800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1783952165.316155:0:7459:0:(genops.c:906:class_export_put()) final put ffff97b176d52800/75da5dc4-aa7e-42cf-a965-1b5f01232c6f 00000020:00000080:1.0:1783952165.316216:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0497f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1783952165.316437:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952165.316441:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952165.316443:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952165.316475:0:92503:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff97b147788600:92503] 4 exiting: rc = 0 00000100:00100000:3.0:1783952165.316566:0:92502:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff97b0496c0400:92502] 3 exiting: rc = 0 00010000:00010000:2.0:1783952165.316744:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952165.316747:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952165.316748:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783952165.317087:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1447cc800/e617e28a-7c0f-459e-8765-f628898cec50 for MGS 00000020:00000080:1.0:1783952165.317122:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176d52800/75da5dc4-aa7e-42cf-a965-1b5f01232c6f for MGS 00000020:00000080:1.0:1783952165.317135:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1447ca000 for MGS 00000020:00000080:1.0:1783952165.317140:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b176d53800 for MGS 00000100:00100000:0.0:1783952165.317836:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317845:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317851:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317857:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317864:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317870:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317876:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317882:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317888:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317893:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317899:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317905:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317911:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317916:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317921:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317925:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317931:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317936:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317942:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317948:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317954:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317959:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317964:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317968:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317974:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317980:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317986:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317991:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.317999:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318006:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318022:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318027:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318032:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318037:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318042:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318047:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318052:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318057:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318062:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318068:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318074:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318081:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318087:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318093:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318098:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318104:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318110:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318115:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318121:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318126:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318131:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318137:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318142:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318147:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318152:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318157:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318162:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318167:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318172:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318178:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318183:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318189:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318194:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783952165.318277:0:93784:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1783952165.319358:0:93784:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b17639b1e0 - data ffff97b1657eb5e8/ffff97b167c20400 00000020:01000000:3.0:1783952165.319476:0:93784:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b174388de0 - data ffff97b1657e4438/ffff97b175079400 00000020:00000080:3.0:1783952165.320050:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5671 00000020:00000080:3.0:1783952165.320059:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b1746c9800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783952165.320083:0:93784:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b174b36000 from MGS, refs=2 00000020:01000004:3.0:1783952165.320086:0:93784:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174b36000 2 00000020:01000004:3.0:1783952165.320090:0:93784:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b174b36000 from MGS 00000020:00000080:3.0:1783952165.320109:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783952165.320117:0:93784:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783952165.320119:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b176be7000/MGS 00000020:00000080:3.0:1783952165.320122:0:93784:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176be7000/MGS for MGS 00000020:01000000:3.0:1783952165.320130:0:93784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1783952165.320206:0:93784:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1783952165.320315:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1746c9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783952165.320362:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783952165.320374:0:93784:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783952165.320384:0:93784:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97b16e9ff800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783952165.320397:0:93784:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff97b0489bcd40) has exports, disconnecting them 00000020:00080000:3.0:1783952165.320402:0:93784:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97b16e9ff800), last request at 1783952130 00000020:00000080:3.0:1783952165.320406:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5789 00000020:00080000:3.0:1783952165.320419:0:93784:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b16e9ff800): rc 0 00000020:00000080:3.0:1783952165.320425:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b16e9ff800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783952165.322384:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b16e9ff800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783952165.327714:0:93784:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783952165.327723:0:93784:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783952165.327727:0:93784:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783952165.327733:0:93784:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783952165.327875:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952165.327889:0:93784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783952165.327896:0:93784:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174b36000 1 00000020:00000080:0.0:1783952165.327904:0:93784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5663 00000020:00000080:0.0:1783952165.327913:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b176be1000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783952165.327919:0:93784:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783952165.327924:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952165.327929:0:93784:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783952165.327932:0:93784:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff97b048b5b380) has no exports 00000020:00000080:1.0:1783952165.330348:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b046483000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783952165.330364:0:40998:0:(genops.c:906:class_export_put()) final put ffff97b0410d9000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783952165.330368:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0410d9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783952165.330375:0:40998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1783952165.330464:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176be1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1783952165.408770:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783952165.419222:0:93784:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952165.419238:0:93784:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783952165.419244:0:93784:0:(genops.c:906:class_export_put()) final put ffff97b174b37800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783952165.419249:0:93784:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b37800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783952165.419261:0:93784:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783952165.419393:0:93784:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97b174b31000 00000020:02000400:0.0:1783952165.419458:0:93784:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1783952166.443848:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952166.507747:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465574400:0@lo:400:kworker.0 00000100:00100000:2.0:1783952166.507855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952166.507917:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952166.507926:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465574528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952166.507959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952166.508041:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465574528 00000100:00100000:2.0:1783952166.508051:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465574528 00000100:00100000:2.0:1783952166.508108:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:2.0:1783952166.508117:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870605465574528:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1783952166.508127:0:23862:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783952166.508175:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1870605465574528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (213us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783952166.508182:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:02020000:2.0:1783952166.508232:0:3644:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1783952166.511826:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465574272:0@lo:400:kworker.0 00000100:00100000:1.0:1783952166.511935:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952166.511992:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952166.511999:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465574144:0@lo:400:kworker.0 00000400:00000100:1.0:1783952166.512020:0:3643:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465574144 offset 0 length 224: 4 00000100:00100000:1.0:1783952166.512068:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465574400 00000100:00100000:1.0:1783952166.512077:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465574400 00000100:00100000:1.0:1783952166.512142:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465574272 00000100:00100000:1.0:1783952166.512144:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465574272 00000100:00100000:1.0:1783952166.512168:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1783952166.512179:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465574400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952166.512259:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465574400:12345-0@lo:400:kworker.0 Request processed in 81us (4403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952166.512266:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1783952166.512285:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1783952166.512289:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1870605465574272:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783952166.512314:0:67035:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783952166.512345:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1870605465574272:12345-0@lo:400:kworker.0 Request processed in 55us (412us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783952166.512352:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00080000:1.0:1783952166.512369:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952166.512404:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783952166.512410:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783952166.512414:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783952166.512421:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952166.512425:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3850 00000100:00080000:1.0:1783952166.512431:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952166.512463:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b147742a00 x1870605465574656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952166.512492:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465574272:0@lo:400:kworker.0 00000100:00100000:1.0:1783952166.514062:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465574784:0@lo:400:kworker.0 00000100:00100000:1.0:1783952166.514141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952166.514186:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465575296:0@lo:400:kworker.0 00000100:00100000:1.0:1783952166.514249:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952166.514269:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783952166.514274:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465574912:0@lo:400:kworker.0 00000100:00100000:1.0:1783952166.514295:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952166.514327:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465574784 00000100:00100000:1.0:1783952166.514335:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465574784 00000100:00100000:1.0:1783952166.514373:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465575296 00000100:00100000:1.0:1783952166.514375:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465575296 00000100:00100000:1.0:1783952166.514397:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465574912 00000100:00100000:1.0:1783952166.514400:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465574912 00000100:00100000:1.0:1783952166.514436:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1783952166.514444:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465574912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952166.514530:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465574912:12345-0@lo:400:kworker.0 Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952166.514538:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1783952166.514554:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1783952166.514559:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1870605465574784:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783952166.514566:0:83761:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783952166.514610:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1870605465574784:12345-0@lo:400:kworker.0 Request processed in 50us (470us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783952166.514699:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1783952166.514713:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:1.0:1783952166.514717:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1870605465575296:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783952166.514721:0:83761:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783952166.514745:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1870605465575296:12345-0@lo:400:kworker.0 Request processed in 27us (497us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783952166.514751:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00080000:1.0:1783952166.514781:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952166.514817:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465574912:0@lo:400:kworker.0 00000100:00080000:1.0:1783952166.514830:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783952166.514836:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783952166.514841:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783952166.514846:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952166.514851:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3850 00000100:00080000:1.0:1783952166.514862:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952166.514889:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b04ef1d880 x1870605465575424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952166.514903:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465575296:0@lo:400:kworker.0 00000100:00080000:1.0:1783952166.514914:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783952166.514917:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783952166.514920:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783952166.514923:0:3642:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952166.514927:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3850 00000100:00080000:1.0:1783952166.514931:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952166.514944:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049892d80 x1870605465575552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952166.514954:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465574784:0@lo:400:kworker.0 00000100:00100000:3.0:1783952166.515851:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465574656:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783952166.515994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952166.516028:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465575424:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783952166.516053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952166.516071:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465575552:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783952166.516093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952166.516133:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465574656 00000100:00100000:3.0:1783952166.516140:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465574656 00000100:00100000:3.0:1783952166.516173:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465575424 00000100:00100000:3.0:1783952166.516176:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465575424 00000100:00100000:3.0:1783952166.516190:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465575552 00000100:00100000:3.0:1783952166.516192:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465575552 00000100:00100000:3.0:1783952166.516209:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1783952166.516215:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465574656:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1783952166.516242:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952166.516282:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465574656:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 65us (288us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952166.516289:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1783952166.516305:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1783952166.516309:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465575424:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1783952166.516332:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952166.516357:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465575424:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 45us (302us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952166.516363:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1783952166.516375:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1783952166.516379:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465575552:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1783952166.516388:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952166.516411:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1870605465575552:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (317us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952166.516417:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00080000:3.0:1783952166.516452:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952166.516457:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952166.516461:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465574656:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1783952166.516471:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952166.516474:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952166.516477:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465575424:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1783952166.516485:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952166.516489:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952166.516491:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465575552:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783952166.516860:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465575168:0@lo:400:kworker.0 00000100:00100000:3.0:1783952166.516900:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952166.518046:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952166.518061:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465575040:0@lo:400:kworker.0 00000100:00100000:3.0:1783952166.518127:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952166.518181:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465575168 00000100:00100000:3.0:1783952166.518189:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465575168 00000100:00100000:3.0:1783952166.518253:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465575040 00000100:00100000:3.0:1783952166.518256:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465575040 00000100:00100000:3.0:1783952166.518282:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:3.0:1783952166.518290:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465575168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952166.518348:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465575168:12345-0@lo:400:kworker.0 Request processed in 59us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952166.518355:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00000100:00100000:3.0:1783952166.518371:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845 00000100:00100000:3.0:1783952166.518377:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465575040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952166.518402:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465575040:12345-0@lo:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952166.518408:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845 00000100:00100000:3.0:1783952166.518457:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465575040:0@lo:400:kworker.0 00000100:00100000:3.0:1783952166.518471:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465575168:0@lo:400:kworker.0 00000100:00080000:3.0:1783952166.518494:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952166.518499:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952166.524240:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783952166.524251:0:3644:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783952166.524266:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783952166.524275:0:3644:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952166.524281:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3850 00000100:00080000:2.0:1783952166.524292:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952166.524341:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ee0e00 x1870605465575680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952166.524416:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465574400:0@lo:400:kworker.0 00000100:00100000:2.0:1783952166.524471:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465575680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783952166.524565:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952166.524644:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465575680 00000100:00100000:2.0:1783952166.524653:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465575680 00000100:00100000:2.0:1783952166.524697:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:2.0:1783952166.524706:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465575680:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1783952166.524735:0:26467:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952166.524780:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465575680:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 73us (215us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952166.524788:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00080000:2.0:1783952166.524826:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952166.524830:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952166.524834:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465575680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783952167.408561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952167.409325:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447777024 00000100:00100000:3.0:1783952167.409341:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447777024 00000100:00100000:1.0:1783952167.409532:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:1.0:1783952167.409557:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447776896 offset 0 length 224: 4 00000100:00100000:1.0:1783952167.409577:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952167.410508:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952167.410545:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447777280 00000100:00100000:1.0:1783952167.410554:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447777280 00000100:00100000:1.0:1783952167.410638:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447777408 00000100:00100000:1.0:1783952167.410641:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447777408 00000100:00100000:1.0:1783952167.410677:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2846 00000100:00100000:1.0:1783952167.410688:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447777280:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952167.410803:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447777280:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 116us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952167.410813:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2846 00000100:00100000:1.0:1783952167.410834:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2847 00000100:00100000:1.0:1783952167.410842:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2401:x1870605447777408:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952167.410870:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2401:x1870605447777408:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952167.410876:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2847 00000100:00100000:3.0:1783952167.419895:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447777152 00000100:00100000:3.0:1783952167.419918:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447777152 00000100:00100000:3.0:1783952167.420023:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1380 00000100:00100000:3.0:1783952167.420035:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:2401:x1870605447777152:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952167.420173:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:2401:x1870605447777152:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 140us (10594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952167.420203:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1380 00000100:00100000:3.0:1783952167.420225:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1405 00000100:00100000:3.0:1783952167.420231:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1870605447777024:12345-192.168.202.48@tcp:400:kworker.0 00000020:00080000:3.0:1783952167.420239:0:66236:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.48@tcp 00000100:00100000:3.0:1783952167.420270:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1870605447777024:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 37us (11722us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783952167.420276:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1405 00000100:00080000:3.0:1783952167.420313:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952167.420319:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952167.420322:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783952167.457689:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952167.460002:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952167.460091:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447777536 00000100:00100000:2.0:1783952167.460108:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447777536 00000100:00100000:2.0:1783952167.460186:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1406 00000100:00100000:2.0:1783952167.460206:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1870605447777536:12345-192.168.202.48@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1783952167.460270:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952167.460370:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1870605447777536:12345-192.168.202.48@tcp:38:ptlrpcd_01_01.0 Request processed in 160us (380us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952167.460379:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1406 00000001:00100000:3.0:1783952168.038953:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783952168.038978:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411472 is committed 00000020:00000080:3.0:1783952168.038986:0:75694:0:(genops.c:906:class_export_put()) final put ffff97b046a93800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783952168.039034:0:75694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411471 is committed 00010000:00010000:2.0:1783952168.039147:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039162:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039171:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039178:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2da00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952168.039184:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039203:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039226:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff97b164ef8900) 00010000:00010000:2.0:1783952168.039229:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952168.039235:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039242:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2da00/0x22c73c7857bb5eac lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039286:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039311:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039317:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039323:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2c200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952168.039327:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039333:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039342:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff97b164ef8800) 00010000:00010000:2.0:1783952168.039344:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952168.039347:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039353:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2c200/0x22c73c7857bb5ec1 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039367:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039374:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039379:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039385:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952168.039394:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039401:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039409:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff97b164ef8f00) 00010000:00010000:2.0:1783952168.039412:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952168.039414:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039420:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b047b2d800/0x22c73c7857bb5f07 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039435:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039441:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039446:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039451:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952168.039454:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039459:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039466:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff97b1767edb00) 00010000:00010000:2.0:1783952168.039468:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952168.039478:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952168.039484:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b04db71600/0x22c73c7857bb5f1c lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783952168.039679:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046a93800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1783952168.039763:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b046a94000 for lustre-MDT0001 00010000:00010000:2.0:1783952168.480932:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952168.544983:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783952168.545013:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465575808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952168.545094:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952168.545210:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952168.545219:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465575936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952168.545256:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952168.545294:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465575808 00000100:00100000:3.0:1783952168.545302:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465575808 00000100:00100000:3.0:1783952168.545360:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465575936 00000100:00100000:3.0:1783952168.545364:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465575936 00000100:00100000:3.0:1783952168.545385:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223 00000100:00100000:3.0:1783952168.545395:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465575808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783952168.545435:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952168.545496:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465575808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952168.545525:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223 00000100:00100000:3.0:1783952168.545557:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:3.0:1783952168.545564:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465575936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783952168.545583:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952168.545641:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465575936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952168.545647:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 00000100:00080000:3.0:1783952168.545671:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952168.545676:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952168.545720:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465575936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952168.545763:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465575808:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1783952169.058698:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783952169.058712:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b14de87000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783952169.058805:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968958 is committed 00000020:00000080:1.0:1783952169.058867:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b14de87000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783952169.059006:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b14de80800 for lustre-OST0001 00010000:00010000:3.0:1783952169.505114:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952170.533252:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783952171.109657:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783952171.109671:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b144764000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783952171.109769:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b144764000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783952171.109847:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b144767000 for lustre-OST0000 00010000:00010000:3.0:1783952171.552826:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952171.617029:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465576064:0@lo:400:kworker.0 00000400:00000100:0.0:1783952171.617123:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465576064 offset 0 length 224: 4 00000100:00080000:3.0:1783952171.617264:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952171.617270:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952171.617275:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952171.617281:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3881 00000100:00080000:3.0:1783952171.617288:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783952171.617297:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952171.617330:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049c31c00 x1870605465576192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952171.617388:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952171.617393:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952171.617395:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952171.617419:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3881 00000100:00080000:3.0:1783952171.617422:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783952171.617426:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952171.617442:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049c30380 x1870605465576448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952171.617476:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952171.617480:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952171.617481:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952171.617485:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3881 00000100:00080000:3.0:1783952171.617488:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783952171.617491:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952171.617504:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049c30a80 x1870605465576704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952171.617581:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465576192:0@lo:38:kworker.0 00000100:00100000:2.0:1783952171.617663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952171.617693:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465576448:0@lo:38:kworker.0 00000100:00100000:2.0:1783952171.617717:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952171.617749:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465576704:0@lo:38:kworker.0 00000100:00100000:2.0:1783952171.617778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952171.617829:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465576704 00000100:00100000:2.0:1783952171.617839:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465576704 00000100:00100000:2.0:1783952171.617886:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:2.0:1783952171.617895:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465576704:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952171.617922:0:23862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952171.617971:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465576704:12345-0@lo:38:kworker.0 Request processed in 75us (191us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952171.617978:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00080000:2.0:1783952171.618028:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952171.618034:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952171.618046:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465576704:0@lo:38:kworker.0 00000100:00100000:2.0:1783952171.618111:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465576576:0@lo:400:kworker.0 00000100:00100000:2.0:1783952171.618143:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952171.618169:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783952171.618176:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465576320:0@lo:400:kworker.0 00000100:00100000:2.0:1783952171.618200:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952171.618244:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465576192 00000100:00100000:2.0:1783952171.618249:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465576192 00000100:00100000:2.0:1783952171.618271:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465576448 00000100:00100000:2.0:1783952171.618274:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465576448 00000100:00100000:2.0:1783952171.618287:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465576576 00000100:00100000:2.0:1783952171.618289:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465576576 00000100:00100000:2.0:1783952171.618326:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465576320 00000100:00100000:2.0:1783952171.618329:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465576320 00000100:00100000:2.0:1783952171.618343:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:2.0:1783952171.618349:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465576576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952171.618400:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465576576:12345-0@lo:400:kworker.0 Request processed in 51us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952171.618407:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:2.0:1783952171.618419:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:2.0:1783952171.618424:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465576320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952171.618451:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465576320:12345-0@lo:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952171.618470:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:2.0:1783952171.618484:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1783952171.618488:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465576192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952171.618500:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952171.618541:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465576192:12345-0@lo:38:kworker.0 Request processed in 52us (878us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952171.618546:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1783952171.618559:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:2.0:1783952171.618563:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465576448:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952171.618573:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952171.618628:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465576448:12345-0@lo:38:kworker.0 Request processed in 63us (910us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952171.618633:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:2.0:1783952171.618675:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465576320:0@lo:400:kworker.0 00000100:00100000:2.0:1783952171.618686:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465576576:0@lo:400:kworker.0 00000100:00080000:2.0:1783952171.618714:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952171.618718:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952171.618721:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465576192:0@lo:38:kworker.0 00000100:00080000:2.0:1783952171.618728:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952171.618732:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952171.618735:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465576448:0@lo:38:kworker.0 00000100:00080000:2.0:1783952171.618775:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952171.619414:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465576832:0@lo:400:kworker.0 00000100:00100000:1.0:1783952171.619480:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952171.619694:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465576832 00000100:00100000:2.0:1783952171.619702:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465576832 00000100:00100000:2.0:1783952171.619770:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:2.0:1783952171.619778:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465576832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952171.619825:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465576832:12345-0@lo:400:kworker.0 Request processed in 48us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952171.619846:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00080000:1.0:1783952171.619961:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952171.619988:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465576832:0@lo:400:kworker.0 00000100:00100000:1.0:1783952171.628563:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1783952171.628604:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952171.628610:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952171.628615:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952171.628625:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3881 00000100:00080000:3.0:1783952171.628633:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783952171.628642:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952171.628674:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049c31880 x1870605465577088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952171.634500:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465577088:0@lo:38:kworker.0 00000100:00100000:2.0:1783952171.634654:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952171.637291:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465577088 00000100:00100000:3.0:1783952171.637315:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465577088 00000100:00100000:3.0:1783952171.637405:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1783952171.637416:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465577088:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952171.637477:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952171.637652:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465577088:12345-0@lo:38:kworker.0 Request processed in 235us (2997us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952171.637659:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00080000:0.0:1783952171.637831:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952171.637839:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952171.637852:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465577088:0@lo:38:kworker.0 00000100:00100000:1.0:1783952171.641261:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465576960:0@lo:400:kworker.0 00000100:00100000:1.0:1783952171.641374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952171.641576:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465576960 00000100:00100000:0.0:1783952171.641614:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465576960 00000100:00100000:0.0:1783952171.641694:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:0.0:1783952171.641705:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465576960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952171.641803:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465576960:12345-0@lo:400:kworker.0 Request processed in 100us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952171.641811:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:2.0:1783952171.641923:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465576960:0@lo:400:kworker.0 00000100:00080000:1.0:1783952171.642004:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952172.525746:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952172.525794:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:2.0:1783952172.525822:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447777664 offset 0 length 224: 4 00000100:00100000:2.0:1783952172.525839:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952172.525866:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952172.525907:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447777920 00000100:00100000:2.0:1783952172.525920:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447777920 00000100:00100000:2.0:1783952172.525996:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447777792 00000100:00100000:2.0:1783952172.526000:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447777792 00000100:00100000:2.0:1783952172.526020:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1383 00000100:00100000:2.0:1783952172.526034:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2398:x1870605447777920:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952172.526141:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2398:x1870605447777920:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 110us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952172.526149:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1383 00000100:00100000:2.0:1783952172.526171:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1410 00000100:00100000:2.0:1783952172.526176:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447777792:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:2.0:1783952172.526202:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952172.526231:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447777792:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 52us (363us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952172.526237:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1410 00000100:00100000:1.0:1783952172.526282:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447778176 00000100:00100000:1.0:1783952172.526292:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447778176 00000100:00080000:2.0:1783952172.526309:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952172.526313:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952172.526325:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447778048 00000100:00100000:1.0:1783952172.526328:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447778048 00000100:00100000:1.0:1783952172.526357:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2850 00000100:00100000:1.0:1783952172.526364:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447778176:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952172.526395:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447778176:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 31us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952172.526401:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2850 00000100:00100000:1.0:1783952172.526415:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2851 00000100:00100000:1.0:1783952172.526422:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447778048:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952172.526446:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447778048:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952172.526464:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2851 00000100:00080000:1.0:1783952172.526499:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783952172.583850:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952173.603272:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952173.665308:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465577216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952173.665415:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952173.665488:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952173.665496:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17483b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465577344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952173.665520:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465577216 00000100:00100000:2.0:1783952173.665524:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952173.665531:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465577216 00000100:00100000:2.0:1783952173.665565:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465577344 00000100:00100000:2.0:1783952173.665570:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465577344 00000100:00080000:3.0:1783952173.666428:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952173.666434:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952173.671348:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000100:00100000:2.0:1783952173.671386:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465577216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952173.671452:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952173.671846:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465577216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 480us (6431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952173.671855:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000100:00100000:3.0:1783952173.672433:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465577216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952173.672511:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226 00000100:00100000:3.0:1783952173.672527:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465577344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783952173.672557:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952173.672660:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465577344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (7134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952173.672668:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226 00000100:00100000:2.0:1783952173.672733:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17483b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465577344:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783952174.624949:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952175.649002:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952176.672959:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783952176.737113:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952176.737123:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952176.737128:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952176.737139:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3886 00000100:00080000:2.0:1783952176.737146:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783952176.737156:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952176.737187:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16e9b6680 x1870605465577600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952176.737406:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465577472:0@lo:400:kworker.0 00000400:00000100:1.0:1783952176.737480:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465577472 offset 0 length 224: 4 00000100:00080000:2.0:1783952176.737744:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952176.737748:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952176.737820:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952176.737826:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3886 00000100:00080000:2.0:1783952176.737830:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783952176.737834:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952176.737851:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16e9b4a80 x1870605465577856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952176.737881:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952176.737885:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952176.737887:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952176.737891:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3886 00000100:00080000:2.0:1783952176.737893:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783952176.737896:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952176.737909:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16e9b7b80 x1870605465578112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952176.737930:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952176.737933:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952176.737935:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952176.737938:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3886 00000100:00080000:2.0:1783952176.737941:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783952176.737944:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952176.737954:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ac5c00 x1870605465578496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952176.737991:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465577984:0@lo:400:kworker.0 00000100:00100000:2.0:1783952176.738044:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952176.738074:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952176.738081:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465578240:0@lo:400:kworker.0 00000100:00100000:2.0:1783952176.738174:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952176.738225:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465578240 00000100:00100000:1.0:1783952176.738336:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465578368:0@lo:400:kworker.0 00000100:00100000:0.0:1783952176.738341:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465577728:0@lo:400:kworker.0 00000100:00100000:1.0:1783952176.738369:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952176.738371:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952176.738430:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465578368 00000100:00100000:1.0:1783952176.738435:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465578368 00000100:00100000:1.0:1783952176.738517:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:1.0:1783952176.738529:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465578368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952176.738729:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465578240 00000100:00100000:1.0:1783952176.738871:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465578368:12345-0@lo:400:kworker.0 Request processed in 344us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952176.738892:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:1.0:1783952176.738914:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:1.0:1783952176.738921:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465578240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952176.738961:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465578240:12345-0@lo:400:kworker.0 Request processed in 41us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952176.738967:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:3.0:1783952176.739066:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465577600:0@lo:38:kworker.0 00000100:00100000:3.0:1783952176.739104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952176.739142:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465577856:0@lo:38:kworker.0 00000100:00100000:3.0:1783952176.739166:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952176.739184:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465578112:0@lo:38:kworker.0 00000100:00100000:3.0:1783952176.739209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952176.739229:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465578496:0@lo:38:kworker.0 00000100:00100000:3.0:1783952176.739266:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952176.739304:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465577984 00000100:00100000:3.0:1783952176.739309:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465577984 00000100:00100000:3.0:1783952176.739355:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465577728 00000100:00100000:3.0:1783952176.739359:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465577728 00000100:00100000:3.0:1783952176.739372:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465577600 00000100:00100000:3.0:1783952176.739375:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465577600 00000100:00100000:3.0:1783952176.739383:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465577856 00000100:00100000:3.0:1783952176.739386:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465577856 00000100:00100000:3.0:1783952176.739393:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465578496 00000100:00100000:3.0:1783952176.739396:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465578496 00000100:00100000:3.0:1783952176.739406:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1783952176.739422:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465577984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952176.739457:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465577984:12345-0@lo:400:kworker.0 Request processed in 45us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952176.739463:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1783952176.739477:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:3.0:1783952176.739483:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465577728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952176.739519:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465577728:12345-0@lo:400:kworker.0 Request processed in 37us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952176.739525:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:3.0:1783952176.739537:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1783952176.739541:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465577600:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952176.739563:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952176.739634:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465577600:12345-0@lo:38:kworker.0 Request processed in 91us (529us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952176.739640:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1783952176.739652:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1783952176.739656:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465577856:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952176.739664:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952176.739695:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465577856:12345-0@lo:38:kworker.0 Request processed in 37us (528us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952176.739700:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1783952176.739711:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1783952176.739715:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465578496:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952176.739724:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952176.739744:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465578496:12345-0@lo:38:kworker.0 Request processed in 28us (478us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952176.739749:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00080000:3.0:1783952176.739963:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952176.739969:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952176.739970:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952176.743020:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465578368:0@lo:400:kworker.0 00000100:00100000:2.0:1783952176.743946:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465578240:0@lo:400:kworker.0 00000100:00100000:2.0:1783952176.743969:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465577984:0@lo:400:kworker.0 00000100:00100000:2.0:1783952176.744225:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465577728:0@lo:400:kworker.0 00000100:00080000:2.0:1783952176.744343:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952176.744349:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952176.744353:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465577600:0@lo:38:kworker.0 00000100:00080000:2.0:1783952176.744366:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952176.744372:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952176.744375:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465577856:0@lo:38:kworker.0 00000100:00080000:2.0:1783952176.744387:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952176.744391:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952176.744394:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465578496:0@lo:38:kworker.0 00000100:00100000:1.0:1783952176.744525:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465578112 00000100:00100000:1.0:1783952176.744535:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465578112 00000100:00100000:1.0:1783952176.744994:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:1.0:1783952176.745005:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465578112:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952176.745036:0:8445:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952176.745995:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465578112:12345-0@lo:38:kworker.0 Request processed in 985us (6778us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952176.746007:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00080000:2.0:1783952176.746106:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952176.746182:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952176.746187:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465578112:0@lo:38:kworker.0 00000400:00000100:1.0:1783952177.648026:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447778304 offset 0 length 224: 4 00000100:00100000:1.0:1783952177.648077:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952177.648119:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952177.648160:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952177.648193:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952177.648292:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447778560 00000100:00100000:0.0:1783952177.648307:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447778560 00000100:00100000:0.0:1783952177.648396:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447778432 00000100:00100000:0.0:1783952177.648399:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447778432 00000100:00100000:0.0:1783952177.648433:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1386 00000100:00100000:0.0:1783952177.648445:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2399:x1870605447778560:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952177.648560:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2399:x1870605447778560:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 118us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952177.648569:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1386 00000100:00100000:0.0:1783952177.648645:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1414 00000100:00100000:0.0:1783952177.648651:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447778432:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:0.0:1783952177.648676:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952177.648706:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870605447778432:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 54us (545us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952177.648733:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1414 00000100:00100000:3.0:1783952177.649126:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447778816 00000100:00100000:3.0:1783952177.649133:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447778816 00000100:00100000:3.0:1783952177.649185:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447778688 00000100:00100000:3.0:1783952177.649190:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447778688 00000100:00100000:3.0:1783952177.649222:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2854 00000100:00100000:3.0:1783952177.649231:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447778816:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952177.649294:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447778816:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 65us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952177.649301:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2854 00000100:00100000:3.0:1783952177.649315:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4956 00000100:00100000:3.0:1783952177.649322:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447778688:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:3.0:1783952177.649347:0:26201:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb58d2 00000100:00080000:3.0:1783952177.649358:0:26201:0:(import.c:65:import_set_state_nolock()) ffff97b046ae6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783952177.649422:0:26201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968956 00000100:00100000:3.0:1783952177.649792:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+2:2397:x1870605447778688:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 468us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952177.649800:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4956 00010000:00010000:3.0:1783952177.649885:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783952177.650494:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952177.650501:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952177.650505:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783952177.703080:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952178.723058:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952178.785984:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952178.786010:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465578624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952178.786115:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952178.786211:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465578752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952178.786250:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952178.786811:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465578624 00000100:00100000:0.0:1783952178.786823:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465578624 00000100:00100000:0.0:1783952178.786943:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465578752 00000100:00100000:0.0:1783952178.786948:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465578752 00000100:00100000:0.0:1783952178.786995:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227 00000100:00100000:0.0:1783952178.787010:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465578624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952178.787073:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952178.787182:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228 00000100:00100000:0.0:1783952178.787188:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465578624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952178.787201:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227 00000100:00100000:1.0:1783952178.787207:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465578752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952178.787256:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952178.787292:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465578624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952178.787337:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465578752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952178.787351:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228 00000100:00100000:1.0:1783952178.787450:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465578752:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783952178.792211:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952178.792227:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783952179.744748:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952180.769788:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952181.795073:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783952181.857735:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952181.857742:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952181.857745:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952181.857753:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3891 00000100:00080000:3.0:1783952181.857759:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783952181.857766:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952181.857789:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049c33480 x1870605465579008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952181.857824:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952181.857828:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952181.857830:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952181.857833:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3891 00000100:00080000:3.0:1783952181.857836:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783952181.857839:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952181.857852:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049c30a80 x1870605465579264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952181.857867:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952181.857870:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952181.857872:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952181.857903:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3891 00000100:00080000:3.0:1783952181.857907:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783952181.857911:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952181.857926:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b147742a00 x1870605465579520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952181.857952:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952181.857954:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952181.857956:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952181.857959:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3891 00000100:00080000:3.0:1783952181.857962:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783952181.857965:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952181.857976:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de8d880 x1870605465579904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952181.858005:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04796e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465579648:0@lo:400:kworker.0 00000100:00100000:3.0:1783952181.858074:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952181.858114:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783952181.858120:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465578880:0@lo:400:kworker.0 00000400:00000100:3.0:1783952181.858140:0:3642:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465578880 offset 0 length 224: 4 00000100:00100000:3.0:1783952181.858160:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465579776:0@lo:400:kworker.0 00000100:00100000:3.0:1783952181.858180:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952181.858206:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465579008:0@lo:38:kworker.0 00000100:00100000:3.0:1783952181.858230:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952181.858247:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465579264:0@lo:38:kworker.0 00000100:00100000:3.0:1783952181.858267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952181.858292:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465579520:0@lo:38:kworker.0 00000100:00100000:3.0:1783952181.858313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952181.858328:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465579904:0@lo:38:kworker.0 00000100:00100000:3.0:1783952181.858348:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952181.858389:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465579392:0@lo:400:kworker.0 00000100:00100000:3.0:1783952181.858413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952181.858431:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952181.858437:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465579136:0@lo:400:kworker.0 00000100:00100000:3.0:1783952181.858455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952181.858498:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465579648 00000100:00100000:3.0:1783952181.858505:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465579648 00000100:00100000:3.0:1783952181.858552:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465579776 00000100:00100000:3.0:1783952181.858555:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465579776 00000100:00100000:3.0:1783952181.858576:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:3.0:1783952181.858585:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465579648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952181.858662:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465579648:12345-0@lo:400:kworker.0 Request processed in 78us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952181.858669:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:3.0:1783952181.858686:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:3.0:1783952181.858691:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465579776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952181.858718:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465579776:12345-0@lo:400:kworker.0 Request processed in 27us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952181.858725:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000100:00100000:3.0:1783952181.858746:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465579008 00000100:00100000:3.0:1783952181.858749:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465579008 00000100:00100000:3.0:1783952181.858768:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465579264 00000100:00100000:3.0:1783952181.858770:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465579264 00000100:00100000:3.0:1783952181.858786:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465579904 00000100:00100000:3.0:1783952181.858788:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465579904 00000100:00100000:3.0:1783952181.858795:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465579392 00000100:00100000:3.0:1783952181.858797:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465579392 00000100:00100000:3.0:1783952181.858812:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465579136 00000100:00100000:3.0:1783952181.858814:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465579136 00000100:00100000:3.0:1783952181.858827:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:3.0:1783952181.858832:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465579392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952181.858865:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465579392:12345-0@lo:400:kworker.0 Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952181.858872:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:3.0:1783952181.858883:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1783952181.858889:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465579136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952181.858914:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465579136:12345-0@lo:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952181.858919:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1783952181.858930:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1783952181.858934:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465579008:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952181.858951:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952181.858982:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465579008:12345-0@lo:38:kworker.0 Request processed in 46us (751us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952181.858988:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1783952181.858999:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1783952181.859003:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465579264:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952181.859012:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952181.859035:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465579264:12345-0@lo:38:kworker.0 Request processed in 30us (766us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952181.859046:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1783952181.859057:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1783952181.859061:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465579904:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952181.859070:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952181.859094:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465579904:12345-0@lo:38:kworker.0 Request processed in 31us (745us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952181.859099:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1783952181.859120:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465579520 00000100:00100000:3.0:1783952181.859124:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465579520 00000100:00100000:3.0:1783952181.859147:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:3.0:1783952181.859152:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465579520:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952181.859161:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952181.859186:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465579520:12345-0@lo:38:kworker.0 Request processed in 33us (871us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952181.859192:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00080000:3.0:1783952181.859213:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952181.859217:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952181.859219:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952181.859261:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465579136:0@lo:400:kworker.0 00000100:00100000:3.0:1783952181.859272:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465579392:0@lo:400:kworker.0 00000100:00080000:3.0:1783952181.859306:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952181.859311:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952181.859314:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465579008:0@lo:38:kworker.0 00000100:00080000:3.0:1783952181.859322:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952181.859332:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952181.859335:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465579264:0@lo:38:kworker.0 00000100:00080000:3.0:1783952181.859345:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952181.859348:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952181.859351:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465579520:0@lo:38:kworker.0 00000100:00080000:3.0:1783952181.859358:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952181.859361:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952181.859376:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465579904:0@lo:38:kworker.0 00000100:00100000:3.0:1783952181.859409:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465579776:0@lo:400:kworker.0 00000100:00100000:3.0:1783952181.859419:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04796e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465579648:0@lo:400:kworker.0 00000100:00100000:1.0:1783952182.772779:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:1.0:1783952182.772807:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447778944 offset 0 length 224: 4 00000100:00100000:1.0:1783952182.772848:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952182.772885:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447779328 00000100:00100000:1.0:1783952182.772896:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447779328 00000100:00100000:1.0:1783952182.772970:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2857 00000100:00100000:1.0:1783952182.772981:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447779328:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952182.773070:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447779328:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952182.773078:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2857 00000100:00100000:3.0:1783952182.773502:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447779200 00000100:00100000:3.0:1783952182.773507:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447779200 00000100:00100000:3.0:1783952182.773552:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1389 00000100:00100000:3.0:1783952182.773561:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2399:x1870605447779200:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952182.773635:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2399:x1870605447779200:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 76us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952182.773643:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1389 00000100:00080000:3.0:1783952182.773661:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952182.773665:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952182.790140:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952182.791931:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447779072 00000100:00100000:2.0:1783952182.791944:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447779072 00000100:00100000:2.0:1783952182.792046:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1418 00000100:00100000:2.0:1783952182.792066:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447779072:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:2.0:1783952182.792090:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952182.792163:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447779072:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 97us (2803us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952182.792170:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1418 00000100:00000400:0.0:1783952182.817112:0:3643:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783952166/real 1783952166] req@ffff97b1762f1c00 x1870605465574144/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783952182 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952182.817144:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff97b1762f1c00 x1870605465574144/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783952182 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952182.817153:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783952182.817156:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1783952182.817160:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.148@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783952182.817162:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783952182.817166:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b1762f1c00 x1870605465574144/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783952182 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952182.817174:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b049c30000 x1870605465576064/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952187 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952182.817200:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b16e9b6300 x1870605465577472/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952192 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952182.817243:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97b049c31c00 x1870605465578880/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952197 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783952182.817258:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783952182.817262:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783952182.817263:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783952182.817265:0:3643:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1783952182.817306:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465574144:0@lo:400:kworker.0 00000100:00100000:0.0:1783952182.817376:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465577472:0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.818733:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465576064:0@lo:400:kworker.0 00000100:00080000:2.0:1783952182.818806:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952182.818811:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783952182.818814:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952182.818819:0:86521:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3845 00000100:00080000:2.0:1783952182.818827:0:86521:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952182.818880:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ac6d80 x1870605465580032/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952182.818943:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952182.818947:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952182.818949:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952182.818953:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3896 00000100:00080000:2.0:1783952182.818955:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783952182.818960:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952182.818977:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ac7b80 x1870605465580160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952182.819001:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952182.819005:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952182.819006:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952182.819009:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3896 00000100:00080000:2.0:1783952182.819012:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783952182.819015:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952182.819026:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ac4a80 x1870605465580416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952182.820082:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465580032:0@lo:250:kworker.0 00000400:00000100:1.0:1783952182.820140:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870605465580032 offset 0 length 520: 4 00000100:00100000:1.0:1783952182.820183:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465580160:0@lo:38:kworker.0 00000100:00100000:1.0:1783952182.820242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952182.820277:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465580416:0@lo:38:kworker.0 00000100:00100000:1.0:1783952182.820297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952182.820348:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465580160 00000100:00100000:1.0:1783952182.820365:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465580160 00000100:00100000:1.0:1783952182.820394:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465580416 00000100:00100000:1.0:1783952182.820406:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465580416 00000100:00100000:1.0:1783952182.820424:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1783952182.820430:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465580160:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952182.820450:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952182.820496:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465580160:12345-0@lo:38:kworker.0 Request processed in 65us (254us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952182.820502:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1783952182.820516:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1783952182.820520:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465580416:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952182.820529:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952182.820547:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465580416:12345-0@lo:38:kworker.0 Request processed in 26us (250us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952182.820552:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00080000:1.0:1783952182.820623:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952182.820628:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783952182.820631:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465580160:0@lo:38:kworker.0 00000100:00080000:1.0:1783952182.820638:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952182.820641:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783952182.820644:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465580416:0@lo:38:kworker.0 00000100:00100000:1.0:1783952182.823807:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465578880:0@lo:400:kworker.0 00000100:00080000:2.0:1783952182.824581:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952182.824599:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952182.824603:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952182.824610:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3896 00000100:00080000:2.0:1783952182.824614:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783952182.824621:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952182.824663:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ac5180 x1870605465580672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952182.824738:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783952182.824741:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783952182.824743:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952182.824746:0:86521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3896 00000100:00080000:2.0:1783952182.824749:0:86521:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783952182.824753:0:86521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:2.0:1783952182.824765:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049ac7b80 x1870605465581056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952182.824816:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465580544:0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.824888:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952182.824897:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465580672:0@lo:38:kworker.0 00000100:00100000:2.0:1783952182.824942:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783952182.824949:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465580288:0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.824977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952182.825021:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465580928:0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.825067:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952182.825093:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783952182.825098:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465580800:0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.825122:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952182.825155:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465580544 00000100:00100000:2.0:1783952182.825162:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465580544 00000100:00100000:2.0:1783952182.825210:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465580288 00000100:00100000:2.0:1783952182.825214:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465580288 00000100:00100000:2.0:1783952182.825237:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1783952182.825246:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465580544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.825302:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465580544:12345-0@lo:400:kworker.0 Request processed in 58us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952182.825319:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1783952182.825340:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1783952182.825348:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465580288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.825387:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465580288:12345-0@lo:400:kworker.0 Request processed in 41us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952182.825393:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1783952182.825415:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465580928 00000100:00100000:2.0:1783952182.825419:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465580928 00000100:00100000:2.0:1783952182.825441:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465580800 00000100:00100000:2.0:1783952182.825444:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465580800 00000100:00100000:2.0:1783952182.825487:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:2.0:1783952182.825494:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465580928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.825527:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465580928:12345-0@lo:400:kworker.0 Request processed in 35us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952182.825532:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:2.0:1783952182.825543:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:2.0:1783952182.825549:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465580800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.825582:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465580800:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952182.825614:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:2.0:1783952182.825669:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465580288:0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.825682:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465580544:0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.825721:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465580800:0@lo:400:kworker.0 00000100:00100000:2.0:1783952182.825730:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465580928:0@lo:400:kworker.0 00000100:00100000:1.0:1783952182.827890:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783952182.828017:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952182.828048:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465581056:0@lo:38:kworker.0 00000100:00100000:1.0:1783952182.828093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952182.828152:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465580672 00000100:00100000:1.0:1783952182.828152:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465581056 00000100:00100000:2.0:1783952182.828161:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465580672 00000100:00100000:2.0:1783952182.828199:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:2.0:1783952182.828206:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465580672:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952182.828230:0:23862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952182.828232:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465581056 00000100:00100000:1.0:1783952182.828257:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1783952182.828262:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465581056:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952182.828272:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952182.828280:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465580672:12345-0@lo:38:kworker.0 Request processed in 74us (401us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952182.828287:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00100000:1.0:1783952182.828296:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465581056:12345-0@lo:38:kworker.0 Request processed in 34us (203us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952182.828301:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00080000:1.0:1783952182.828338:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952182.828343:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783952182.828347:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465580672:0@lo:38:kworker.0 00000100:00080000:1.0:1783952182.828366:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952182.828369:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783952182.828372:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465581056:0@lo:38:kworker.0 00000001:00100000:1.0:1783952182.887913:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000020:00000080:1.0:1783952182.887932:0:8429:0:(genops.c:906:class_export_put()) final put ffff97b046ae1000/d33551be-a709-4ba2-a74c-f4d7b53c6817 00000020:00000080:3.0:1783952182.888019:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b046ae1000/d33551be-a709-4ba2-a74c-f4d7b53c6817 for lustre-OST0000 00000020:00000080:3.0:1783952182.888075:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b046ae6800 for lustre-OST0000 00010000:00010000:3.0:1783952183.840711:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952183.853216:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000400:00000100:1.0:1783952183.853252:0:3635:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.48@tcp portal 26 match 1870605447779456 offset 0 length 520: 4 00000100:00100000:1.0:1783952183.853270:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952183.853314:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952183.853452:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447779712 00000100:00100000:3.0:1783952183.853461:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447779712 00000100:00100000:3.0:1783952183.853514:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447779584 00000100:00100000:3.0:1783952183.853517:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447779584 00000100:00100000:3.0:1783952183.853537:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1392 00000100:00100000:3.0:1783952183.853547:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447779712:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952183.853643:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447779712:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 98us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952183.853651:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1392 00000100:00100000:3.0:1783952183.853667:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1422 00000100:00100000:3.0:1783952183.853671:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447779584:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783952183.853691:0:66236:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952183.853714:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447779584:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 42us (443us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952183.853721:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1422 00000100:00100000:0.0:1783952183.854468:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447779840 00000100:00100000:0.0:1783952183.854476:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447779840 00000100:00100000:0.0:1783952183.854523:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4957 00000100:00100000:0.0:1783952183.854531:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447779840:12345-192.168.202.48@tcp:9:kworker.0 00000020:00000080:0.0:1783952183.854554:0:8433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb5e0b 00000100:00080000:0.0:1783952183.854564:0:8433:0:(import.c:65:import_set_state_nolock()) ffff97b1514bc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783952183.854628:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968958 00000100:00100000:0.0:1783952183.854776:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+2:2397:x1870605447779840:12345-192.168.202.48@tcp:9:kworker.0 Request processed in 245us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952183.854783:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4957 00010000:00010000:3.0:1783952183.855280:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952183.904826:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465581184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952183.904895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952183.904969:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465581184 00000100:00100000:0.0:1783952183.904977:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465581184 00000100:00100000:0.0:1783952183.905040:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229 00000100:00100000:0.0:1783952183.905050:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465581184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952183.905079:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952183.905119:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465581184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952183.905125:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229 00000100:00100000:1.0:1783952183.905208:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465581184:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783952183.905209:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952183.906384:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465581312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952183.906435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952183.906548:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465581312 00000100:00100000:2.0:1783952183.906554:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465581312 00000100:00100000:2.0:1783952183.906632:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2230 00000100:00100000:2.0:1783952183.906646:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465581312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952183.906672:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952183.906711:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465581312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00080000:0.0:1783952183.906761:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952183.906790:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465581312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952183.919536:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2230 00010000:00010000:2.0:1783952184.874954:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952185.900184:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952186.913043:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952187.886294:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952187.887143:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447779968 00000100:00100000:3.0:1783952187.887155:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447779968 00000100:00100000:3.0:1783952187.887198:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1423 00000100:00100000:3.0:1783952187.887208:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447779968:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:3.0:1783952187.887232:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952187.887295:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2397:x1870605447779968:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 87us (1010us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952187.887302:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1423 00000100:00100000:1.0:1783952187.891895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952187.891985:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447780096 00000100:00100000:3.0:1783952187.892001:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447780096 00000100:00080000:1.0:1783952187.892059:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952187.892079:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1393 00000100:00100000:3.0:1783952187.892090:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447780096:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952187.892174:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447780096:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952187.892181:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1393 00010000:00010000:3.0:1783952187.936882:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783952188.004737:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952188.004745:0:40998:0:(pinger.c:247:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783952188.004749:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952188.004752:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952188.004756:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952188.004763:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3897 00000100:00080000:3.0:1783952188.004767:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783952188.004775:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952188.004835:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1756e0700 x1870605465581440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952188.004886:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952188.004889:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952188.004892:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952188.004895:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3897 00000100:00080000:3.0:1783952188.004898:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783952188.004902:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952188.004912:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1756e2d80 x1870605465581696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952188.004946:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952188.004949:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952188.004951:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952188.004954:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3897 00000100:00080000:3.0:1783952188.004957:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783952188.004960:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952188.004971:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1756e2680 x1870605465581952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952188.005033:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952188.005036:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783952188.005038:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783952188.005042:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3897 00000100:00080000:3.0:1783952188.005044:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783952188.005047:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952188.005058:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1756e1f80 x1870605465582336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783952188.005086:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465581824:0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.005149:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952188.005186:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952188.005192:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465581568:0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.005214:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952188.005244:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465581824 00000100:00100000:3.0:1783952188.005251:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465581824 00000100:00100000:3.0:1783952188.005321:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465581568 00000100:00100000:3.0:1783952188.005331:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465581568 00000100:00100000:3.0:1783952188.005363:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:3.0:1783952188.005370:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465581824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.005431:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465581824:12345-0@lo:400:kworker.0 Request processed in 60us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952188.005438:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:3.0:1783952188.005453:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:3.0:1783952188.005458:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465581568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.005484:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1870605465581568:12345-0@lo:400:kworker.0 Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952188.005489:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00080000:3.0:1783952188.005507:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952188.005521:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465582080:0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.005548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952188.005571:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952188.005577:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465582208:0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.005634:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952188.005678:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465582080 00000100:00100000:3.0:1783952188.005682:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465582080 00000100:00100000:3.0:1783952188.005712:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465582208 00000100:00100000:3.0:1783952188.005715:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465582208 00000100:00100000:3.0:1783952188.005733:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:3.0:1783952188.005738:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465582080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.005771:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465582080:12345-0@lo:400:kworker.0 Request processed in 33us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952188.005777:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:3.0:1783952188.005787:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:3.0:1783952188.005800:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17738c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465582208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.005831:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17738c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465582208:12345-0@lo:400:kworker.0 Request processed in 32us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952188.005836:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:2.0:1783952188.005905:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465581440:0@lo:38:kworker.0 00000100:00100000:2.0:1783952188.005946:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952188.005974:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465581696:0@lo:38:kworker.0 00000100:00100000:2.0:1783952188.006014:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952188.006036:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465581952:0@lo:38:kworker.0 00000100:00100000:3.0:1783952188.006057:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465581440 00000100:00100000:3.0:1783952188.006062:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465581440 00000100:00100000:2.0:1783952188.006067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952188.006086:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465581696 00000100:00100000:2.0:1783952188.006091:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465582336:0@lo:38:kworker.0 00000100:00100000:3.0:1783952188.006092:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465581696 00000100:00100000:3.0:1783952188.006109:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1783952188.006115:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465581440:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783952188.006129:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:3.0:1783952188.006133:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952188.006177:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465581440:12345-0@lo:38:kworker.0 Request processed in 61us (230us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952188.006184:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1783952188.006197:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465582336 00000100:00100000:3.0:1783952188.006200:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465582336 00000100:00080000:2.0:1783952188.006209:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783952188.006212:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00080000:2.0:1783952188.006217:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952188.006220:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465581696:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783952188.006225:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465581440:0@lo:38:kworker.0 00010000:00020000:3.0:1783952188.006234:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952188.006263:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465581696:12345-0@lo:38:kworker.0 Request processed in 43us (261us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952188.006270:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00080000:2.0:1783952188.006276:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952188.006282:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783952188.006287:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1783952188.006289:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465581696:0@lo:38:kworker.0 00000100:00100000:3.0:1783952188.006296:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465582336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952188.006322:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952188.006364:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465582336:12345-0@lo:38:kworker.0 Request processed in 70us (236us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952188.006376:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1783952188.006457:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465581952 00000100:00100000:3.0:1783952188.006460:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465581952 00000100:00100000:3.0:1783952188.006498:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1783952188.006503:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465581952:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952188.006513:0:8444:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952188.006542:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465581952:12345-0@lo:38:kworker.0 Request processed in 38us (476us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952188.006547:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00080000:3.0:1783952188.006568:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952188.006570:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952188.006611:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1870605465581568:0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.006625:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465581824:0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.006649:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465582208:0@lo:400:kworker.0 00000100:00100000:3.0:1783952188.006659:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465582080:0@lo:400:kworker.0 00000100:00080000:2.0:1783952188.006921:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952188.006926:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952188.006930:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465581952:0@lo:38:kworker.0 00000100:00080000:2.0:1783952188.006939:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952188.006943:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952188.006945:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465582336:0@lo:38:kworker.0 00000100:00100000:0.0:1783952188.922197:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952188.922307:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952188.922338:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447780352 00000100:00100000:0.0:1783952188.922347:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447780352 00000100:00100000:0.0:1783952188.922395:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447780224 00000100:00100000:0.0:1783952188.922409:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447780224 00000100:00100000:0.0:1783952188.922430:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1396 00000100:00100000:0.0:1783952188.922441:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447780352:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952188.922510:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447780352:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 72us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952188.922519:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1396 00000100:00100000:0.0:1783952188.922537:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1427 00000100:00100000:0.0:1783952188.922541:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447780224:12345-192.168.202.48@tcp:38:kworker.0 00010000:00020000:0.0:1783952188.922561:0:68591:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952188.922607:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1870605447780224:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 44us (289us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952188.922613:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1427 00010000:00010000:2.0:1783952188.971236:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952189.026566:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465582464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952189.026699:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952189.026864:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465582464 00000100:00100000:0.0:1783952189.026872:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465582464 00000100:00100000:0.0:1783952189.026926:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231 00000100:00100000:0.0:1783952189.026935:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465582464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952189.026965:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952189.027032:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465582464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952189.027040:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231 00000100:00100000:3.0:1783952189.027318:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465582464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952189.031783:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783952189.031805:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465582592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952189.031871:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952189.031971:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465582592 00000100:00100000:2.0:1783952189.031979:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465582592 00000100:00100000:2.0:1783952189.032041:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232 00000100:00100000:2.0:1783952189.032050:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465582592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952189.032079:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952189.032126:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465582592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952189.032133:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232 00000100:00100000:3.0:1783952189.032268:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465582592:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783952189.989264:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783952190.053408:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000020:00000080:0.0:1783952190.053417:0:9513:0:(genops.c:906:class_export_put()) final put ffff97b1514b8000/d33551be-a709-4ba2-a74c-f4d7b53c6817 00000020:00000080:2.0:1783952190.053477:0:86521:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1514b8000/d33551be-a709-4ba2-a74c-f4d7b53c6817 for lustre-OST0001 00000020:00000080:2.0:1783952190.053543:0:86521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1514bc800 for lustre-OST0001 00010000:00010000:2.0:1783952191.011051:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783952191.244571:0:94404:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783952191.244577:0:94404:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783952191.244579:0:94404:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783952191.244725:0:94404:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97b04661c800 00000020:01000004:2.0:1783952191.244741:0:94404:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783952191.244755:0:94404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783952191.244770:0:94404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97b1454599c0) 00000020:00000080:2.0:1783952191.244787:0:94404:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783952191.432507:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783952191.433240:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783952191.435625:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1783952191.435918:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1783952191.436184:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1783952191.436763:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783952191.437714:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1783952191.439480:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1783952191.440177:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1783952191.440806:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783952191.441052:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1783952191.442116:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783952191.447270:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783952191.447843:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783952191.463294:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783952191.464500:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.464785:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.465570:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.465825:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.466055:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.466270:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.466958:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.471140:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.471772:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.472658:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.472968:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.473220:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.473533:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.473872:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.474089:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.474514:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.474743:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.475458:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.475699:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.476101:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.476543:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.476871:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.477141:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.477470:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.477878:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783952191.481783:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.482212:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.483640:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.484327:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783952191.484930:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783952191.488146:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783952191.489121:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783952191.496091:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:3.0:1783952191.496138:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:3.0:1783952191.496168:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00100000:10000000:3.0:1783952191.497066:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783952191.497554:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1783952191.503181:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783952191.504115:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783952191.504413:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783952191.504732:0:94404:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1783952191.513370:0:94404:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783952191.513709:0:94404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783952191.513718:0:94404:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783952191.513731:0:94404:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5f31 00000020:01000004:2.0:1783952191.513737:0:94404:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783952191.513749:0:94404:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783952191.513754:0:94404:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b04661c800 from MGS 00000020:01000004:2.0:1783952191.513757:0:94404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783952191.513767:0:94404:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97b14545cd40) 00000020:00000080:2.0:1783952191.513779:0:94404:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1783952191.513847:0:94404:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b04661c800 from MGS, refs=2 00080000:01000000:2.0:1783952191.513853:0:94404:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783952191.513862:0:94404:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5f3f 00010000:00010000:2.0:1783952191.514185:0:94404:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1783952191.530380:0:94404:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1783952191.547122:0:94408:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783952191.549423:0:94404:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783952191.549496:0:94404:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783952191.550787:0:94404:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783952191.551487:0:94404:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783952191.553262:0:94404:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783952191.553271:0:94404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783952191.557441:0:94404:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783952191.557455:0:94404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783952191.558199:0:94404:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783952191.558207:0:94404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783952191.558732:0:94404:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783952191.558755:0:94404:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1783952191.558756:0:94404:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1783952191.558765:0:94404:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1783952191.558771:0:94404:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 93, was 0): CONNECTING 00000100:00100000:2.0:1783952191.558777:0:94404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00010000:00010000:3.0:1783952192.034468:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952192.097072:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783952182/real 1783952182] req@ffff97b049ac6d80 x1870605465580032/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783952192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952192.097109:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97b049ac6d80 x1870605465580032/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783952192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952192.097137:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952192.097164:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00080000:0.0:1783952192.097282:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952192.097288:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783952192.097291:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952192.097297:0:40998:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3897 00000100:00080000:0.0:1783952192.097302:0:40998:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783952192.097309:0:40998:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952192.097346:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049e74700 x1870605465582720/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952192.097361:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952192.097365:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952192.097367:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952192.097370:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3902 00000100:00080000:0.0:1783952192.097373:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952192.097377:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952192.097414:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049e75500 x1870605465582848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952192.097454:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952192.097458:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952192.097460:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952192.097463:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3902 00000100:00080000:0.0:1783952192.097466:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952192.097469:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952192.097480:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1762f3100 x1870605465583104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952192.097495:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952192.097498:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952192.097500:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952192.097504:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3902 00000100:00080000:0.0:1783952192.097506:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952192.097509:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952192.097521:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b164e3d500 x1870605465583360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783952192.097552:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952192.097555:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783952192.097557:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952192.097560:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3902 00000100:00080000:0.0:1783952192.097562:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783952192.097566:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952192.097583:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b164e3f100 x1870605465583744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952192.097639:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465583616:0@lo:400:kworker.0 00000100:00100000:0.0:1783952192.097706:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952192.097737:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783952192.097743:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465583488:0@lo:400:kworker.0 00000100:00100000:0.0:1783952192.097765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.098302:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465580032:0@lo:250:kworker.0 00000100:00100000:3.0:1783952192.098395:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465582976:0@lo:400:kworker.0 00000100:00100000:3.0:1783952192.098434:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.098461:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952192.098467:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465583232:0@lo:400:kworker.0 00000100:00100000:3.0:1783952192.098490:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.098530:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465583616 00000100:00100000:3.0:1783952192.098537:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465583616 00000100:00100000:3.0:1783952192.098601:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465583488 00000100:00100000:3.0:1783952192.098605:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465583488 00000100:00100000:3.0:1783952192.098629:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:3.0:1783952192.098638:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465583616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952192.098692:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465583616:12345-0@lo:400:kworker.0 Request processed in 55us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952192.098710:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000100:00100000:3.0:1783952192.098726:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:3.0:1783952192.098732:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465583488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952192.098763:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465583488:12345-0@lo:400:kworker.0 Request processed in 31us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952192.098769:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:3.0:1783952192.098793:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465582976 00000100:00100000:3.0:1783952192.098796:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465582976 00000100:00100000:3.0:1783952192.098818:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465583232 00000100:00100000:3.0:1783952192.098821:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465583232 00000100:00100000:3.0:1783952192.098841:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1783952192.098848:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465582976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952192.099628:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465582976:12345-0@lo:400:kworker.0 Request processed in 778us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952192.099638:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1783952192.099657:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1783952192.099666:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465583232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952192.099707:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465583232:12345-0@lo:400:kworker.0 Request processed in 43us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952192.099713:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00080000:3.0:1783952192.099737:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952192.099742:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952192.099745:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952192.099791:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465583232:0@lo:400:kworker.0 00000100:00100000:3.0:1783952192.099804:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465582976:0@lo:400:kworker.0 00000100:00100000:3.0:1783952192.099858:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465583488:0@lo:400:kworker.0 00000100:00100000:3.0:1783952192.099872:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465583616:0@lo:400:kworker.0 10000000:01000000:2.0:1783952192.100228:0:94404:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1783952192.100245:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb583f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5846 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100257:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb583f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5846 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100281:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1783952192.100300:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100309:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86b600/0x22c73c7857bb583f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5846 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100328:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216b400/0x22c73c7857bb5c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5c59 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100335:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216b400/0x22c73c7857bb5c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5c59 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100339:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783952192.100342:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100346:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216b400/0x22c73c7857bb5c52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5c59 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100354:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb5c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5c67 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100360:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb5c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5c67 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100458:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783952192.100462:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100467:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb5c60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5c67 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100477:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb5c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5c75 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100483:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb5c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5c75 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100489:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783952192.100492:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100495:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a400/0x22c73c7857bb5c6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5c75 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100504:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb5c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5c83 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100511:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb5c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5c83 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100516:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783952192.100519:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100522:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a000/0x22c73c7857bb5c7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5c83 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100531:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a15c00/0x22c73c7857bb5c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5c91 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100547:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a15c00/0x22c73c7857bb5c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5c91 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100553:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783952192.100556:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100560:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a15c00/0x22c73c7857bb5c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5c91 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100569:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb5c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5c9f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100576:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb5c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5c9f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100581:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783952192.100584:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100621:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb5c98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5c9f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100632:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5cad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100639:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5cad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100645:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783952192.100649:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100653:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a15600/0x22c73c7857bb5ca6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5cad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100677:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb57b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb57ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100684:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb57b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb57ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100689:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783952192.100692:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100696:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762af000/0x22c73c7857bb57b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb57ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100706:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb57cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb57d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100712:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb57cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb57d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100717:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1783952192.100721:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100724:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb57cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb57d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100734:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb57dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb57e4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100741:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb57dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb57e4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100746:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783952192.100756:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100760:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb57dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb57e4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100769:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b050cbc400/0x22c73c7857bb5807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb580e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952192.100775:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b050cbc400/0x22c73c7857bb5807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb580e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.100780:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783952192.100783:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.100786:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b050cbc400/0x22c73c7857bb5807 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb580e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.100794:0:94404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb5831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x22c73c7857bb5838 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00020000:1.0:1783952192.102046:0:3641:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff97b049e74700 x1870605465582720/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952192.102063:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952192.102078:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1783952192.102082:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:0:1870605465582720:0@lo:250:kworker.0 00000100:00100000:1.0:1783952192.102107:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465582848:0@lo:38:kworker.0 00000100:00100000:1.0:1783952192.102166:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1783952192.102228:0:94404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb5831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x22c73c7857bb5838 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.102240:0:94404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783952192.102254:0:94404:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783952192.102263:0:94404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b18216a200/0x22c73c7857bb5831 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x22c73c7857bb5838 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783952192.102318:0:94404:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97b1476fa000 already not connected (conn 94, was 0): DISCONN 00000100:00080000:2.0:1783952192.102324:0:94404:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783952192.102328:0:94404:0:(import.c:510:import_select_connection()) MGC192.168.202.148@tcp: connect to NID 0@lo last attempt 3907 00000100:00080000:2.0:1783952192.102332:0:94404:0:(import.c:589:import_select_connection()) MGC192.168.202.148@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783952192.102338:0:94404:0:(import.c:624:import_select_connection()) MGC192.168.202.148@tcp: import ffff97b1476fa000 using connection 192.168.202.148@tcp/0@lo 00000100:00080000:0.0:1783952192.102363:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952192.102368:0:40998:0:(pinger.c:247:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783952192.102419:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465583104:0@lo:38:kworker.0 00000100:00100000:1.0:1783952192.102448:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.102449:0:94404:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16e9b7b80 x1870605465583872/t0(0) o250->MGC192.168.202.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783952192.102463:0:94404:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1783952192.102475:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465583360:0@lo:38:kworker.0 00000100:00100000:1.0:1783952192.102506:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.102527:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465583744:0@lo:38:kworker.0 00000100:00100000:3.0:1783952192.102529:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465582848 00000100:00100000:3.0:1783952192.102537:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465582848 00000100:00100000:1.0:1783952192.102547:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.102567:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465583104 00000100:00100000:3.0:1783952192.102569:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465583104 00000100:00100000:1.0:1783952192.102573:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465583872:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783952192.102581:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465583744 00000100:00100000:3.0:1783952192.102583:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465583744 00000100:00100000:1.0:1783952192.102617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.102619:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1783952192.102626:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465582848:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783952192.102647:0:83761:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952192.102650:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1783952192.102655:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465583104:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783952192.102663:0:66237:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952192.102720:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465583360 00000100:00100000:0.0:1783952192.102722:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1783952192.102724:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465583360 00000100:00100000:0.0:1783952192.102727:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b046acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465583744:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783952192.102737:0:67035:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952192.102747:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:2.0:1783952192.102752:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b046acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465583360:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783952192.102761:0:23862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783952192.102786:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465582848:12345-0@lo:38:kworker.0 Request processed in 158us (619us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952192.102792:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1783952192.102853:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465583872 00000100:00100000:3.0:1783952192.102857:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465583872 00000100:00100000:3.0:1783952192.102874:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783952192.102879:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3641:x1870605465583872:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783952192.102895:0:94410:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo t0 exp 0000000000000000 cur 3907 last 0 00000020:00000080:3.0:1783952192.102921:0:94410:0:(genops.c:1406:class_connect()) connect: client 75da5dc4-aa7e-42cf-a965-1b5f01232c6f, cookie 0x22c73c7857bb5f46 00000100:00080000:3.0:1783952192.103057:0:94410:0:(import.c:65:import_set_state_nolock()) ffff97b1445c2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952192.107680:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1870605465583104:12345-0@lo:38:kworker.0 Request processed in 5012us (5219us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952192.107696:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1783952192.112689:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b046acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465583744:12345-0@lo:38:kworker.0 Request processed in 9949us (10128us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952192.112706:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1783952192.115850:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:3641:x1870605465583872:12345-0@lo:250:mount.lustre.0 Request processed in 12959us (13222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952192.115865:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783952192.115872:0:3641:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.148@tcp: committing for last_committed 0 gen 29 00000100:00080000:1.0:1783952192.115893:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.148@tcp: connect to target with instance 0 00000100:00080000:1.0:1783952192.115902:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783952192.115907:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783952192.115912:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1476fa000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783952192.115914:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783952192.115962:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783952192.116373:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3641:1870605465583872:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1783952192.116396:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952192.116413:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783952192.116417:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465582848:0@lo:38:kworker.0 00000100:00080000:1.0:1783952192.116431:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952192.116435:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783952192.116438:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465583104:0@lo:38:kworker.0 00000100:00080000:0.0:1783952192.116488:0:94404:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1783952192.116502:0:94404:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783952192.116544:0:94404:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783952192.116549:0:94404:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783952192.116678:0:94404:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783952192.116712:0:94404:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783952192.116715:0:94404:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783952192.116717:0:94404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783952192.116718:0:94404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952192.116719:0:94404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952192.116720:0:94404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952192.116722:0:94404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952192.116723:0:94404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783952192.116728:0:94404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783952192.116729:0:94404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952192.116731:0:94404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783952192.116733:0:94404:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783952192.116735:0:94404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783952192.116736:0:94404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783952192.116737:0:94404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952192.116738:0:94404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952192.116739:0:94404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952192.116740:0:94404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952192.116740:0:94404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783952192.116741:0:94404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783952192.116742:0:94404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952192.116743:0:94404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783952192.116765:0:94404:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783952192.116784:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465584000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783952192.116848:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952192.116895:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434aa300 going to sleep for 11 seconds 00000100:00100000:0.0:1783952192.116920:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465584000 00000100:00100000:0.0:1783952192.116926:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465584000 00000100:00100000:0.0:1783952192.116980:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783952192.116989:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:94404:x1870605465584000:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783952192.117028:0:94411:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783952192.117031:0:94411:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783952192.117034:0:94411:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000020:01000000:3.0:1783952192.117916:0:40998:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.148@tcp 10000000:01000000:3.0:1783952192.117935:0:40998:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1783952192.117944:0:40998:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783952192.117945:0:40998:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783952192.117947:0:40998:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952192.117948:0:40998:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952192.117949:0:40998:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952192.117950:0:40998:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952192.117951:0:40998:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783952192.117953:0:40998:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952192.117954:0:40998:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783952192.117989:0:40998:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783952192.117997:0:40998:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1783952192.117999:0:40998:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783952192.118001:0:40998:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783952192.118001:0:40998:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952192.118002:0:40998:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952192.118003:0:40998:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952192.118004:0:40998:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952192.118005:0:40998:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783952192.118006:0:40998:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952192.118007:0:40998:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783952192.118018:0:40998:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783952192.118022:0:40998:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1783952192.118023:0:40998:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783952192.118025:0:40998:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783952192.118025:0:40998:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952192.118027:0:40998:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952192.118028:0:40998:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952192.118029:0:40998:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952192.118030:0:40998:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783952192.118031:0:40998:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952192.118032:0:40998:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783952192.118047:0:40998:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1783952192.118078:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465584128:0@lo:253:kworker.0 10000000:01000000:0.0:1783952192.118080:0:94413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1783952192.118129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:0.0:1783952192.118162:0:94411:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 123 00000100:00100000:3.0:1783952192.118182:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952192.118187:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465584256:0@lo:253:kworker.0 00000100:00100000:3.0:1783952192.118214:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.118254:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465584384:0@lo:253:kworker.0 00000100:00100000:3.0:1783952192.118317:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.118345:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465584128 00000100:00100000:3.0:1783952192.118350:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465584128 20000000:01000000:0.0:1783952192.119110:0:94414:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783952192.119115:0:94414:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783952192.119119:0:94414:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783952192.119122:0:94414:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783952192.119138:0:94414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000100:00100000:3.0:1783952192.119252:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465584256 00000100:00100000:3.0:1783952192.119258:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465584256 00000100:00100000:3.0:1783952192.119288:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465584384 00000100:00100000:3.0:1783952192.119291:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465584384 20000000:01000000:0.0:1783952192.119302:0:94411:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783952192.119303:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783952192.119312:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3644:x1870605465584128:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783952192.119313:0:94411:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783952192.119345:0:94412:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783952192.119359:0:94412:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783952192.120686:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:94404:x1870605465584000:12345-0@lo:253:mount.lustre.0 Request processed in 3693us (3832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.120708:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783952192.120745:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783952192.120754:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:3644:x1870605465584256:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783952192.120777:0:94411:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1783952192.120824:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465584000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783952192.120836:0:94404:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783952192.120839:0:94404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783952192.120841:0:94404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783952192.120842:0:94404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952192.120843:0:94404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952192.120845:0:94404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952192.120846:0:94404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952192.120847:0:94404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783952192.120849:0:94404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783952192.120850:0:94404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952192.120852:0:94404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783952192.120871:0:94404:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b04661c800 from lustre-MDT0000 20000000:01000000:3.0:1783952192.122422:0:94412:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783952192.122437:0:94412:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783952192.122569:0:94411:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783952192.122724:0:94413:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783952192.122729:0:94413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783952192.122755:0:94413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.122774:0:94413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783952192.122784:0:94413:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000055315s 00010000:00010000:3.0:1783952192.122789:0:94413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.122796:0:94413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.122803:0:94413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.122828:0:94413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.122835:0:94413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952192.122839:0:94413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.122848:0:94413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.122863:0:94413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.122870:0:94413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.122876:0:94413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762afa00/0x22c73c7857bb5f4d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952192.123077:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b046acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465583360:12345-0@lo:38:kworker.0 Request processed in 20318us (20565us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952192.123088:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 10000000:01000000:0.0:1783952192.123348:0:94404:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783952192.123353:0:94404:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783952192.123363:0:94404:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97b04661c800 10000000:01000000:0.0:1783952192.123367:0:94404:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783952192.123372:0:94404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97b04661c800 10000000:01000000:0.0:1783952192.123374:0:94404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783952192.123378:0:94404:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b04661c800 from 1 10000000:01000000:0.0:1783952192.123380:0:94404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783952192.123414:0:94404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.123424:0:94404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.123446:0:94404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952192.123470:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465584512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783952192.123531:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952192.123567:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f3f840 going to sleep for 11 seconds 00000100:00100000:3.0:1783952192.123709:0:94410:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1783952192.123717:0:94410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1783952192.124498:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465584512 00000100:00100000:3.0:1783952192.124507:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465584512 00000100:00100000:3.0:1783952192.124820:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783952192.124831:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3642:x1870605465584384:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783952192.124861:0:94415:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1783952192.125114:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3644:x1870605465584128:12345-0@lo:253:kworker.0 Request processed in 5802us (6982us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.125123:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783952192.125155:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783952192.125162:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:94404:x1870605465584512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783952192.125173:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952192.125195:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b047b2cc00/0x22c73c7857bb5f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5f54 expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.126335:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2cc00/0x22c73c7857bb5f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5f54 expref: 8 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.126351:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b047b2cc00/0x22c73c7857bb5f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5f54 expref: 8 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.126360:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2cc00, rc 0) 00000100:00100000:0.0:1783952192.126417:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:94404:x1870605465584512:12345-0@lo:101:mount.lustre.0 Request processed in 1254us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.126425:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783952192.126486:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465584512:0@lo:101:mount.lustre.0 00000020:01000004:3.0:1783952192.126503:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783952192.126505:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783952192.126507:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952192.126508:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952192.126514:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952192.126515:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952192.126517:0:3644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:0.0:1783952192.126517:0:94404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5f5b expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783952192.126519:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952192.126520:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783952192.126523:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465584128:0@lo:253:kworker.0 00010000:00010000:0.0:1783952192.126526:0:94404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5f5b expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952192.126540:0:94404:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783952192.126550:0:94404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5f54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5f5b expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.126557:0:94404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b047b2ce00/0x22c73c7857bb5f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5f5b expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952192.129008:0:94404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783952192.129023:0:94404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783952192.129031:0:94404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97b04661c800 10000000:01000000:0.0:1783952192.129034:0:94404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783952192.129038:0:94404:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783952192.129041:0:94404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783952192.129084:0:94404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.129095:0:94404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.129106:0:94404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952192.129130:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465584640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783952192.130992:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952192.131049:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f3f840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952192.131080:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465584640 00000100:00100000:2.0:1783952192.131089:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465584640 00000100:00100000:2.0:1783952192.131153:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783952192.131163:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:94404:x1870605465584640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783952192.131180:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952192.131200:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5f69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb5f62 expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.131228:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb5f62 expref: 9 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.131238:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5f62 expref: 9 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.131246:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a15c00, rc 0) 00000100:00100000:2.0:1783952192.131311:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:94404:x1870605465584640:12345-0@lo:101:mount.lustre.0 Request processed in 149us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952192.131334:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783952192.131491:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465584640:0@lo:101:mount.lustre.0 00000100:00080000:1.0:1783952192.131492:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952192.131497:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783952192.131500:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465583360:0@lo:38:kworker.0 00010000:00010000:0.0:1783952192.131508:0:94404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783952192.131511:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952192.131514:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783952192.131517:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465583744:0@lo:38:kworker.0 00010000:00010000:0.0:1783952192.131518:0:94404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952192.131634:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465584768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783952192.131666:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952192.131691:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f3f840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952192.131747:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465584768 00000100:00100000:2.0:1783952192.131751:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465584768 00000100:00100000:2.0:1783952192.131783:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783952192.131791:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:94404:x1870605465584768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783952192.131924:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94404:x1870605465584768:12345-0@lo:501:mount.lustre.0 Request processed in 133us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952192.131932:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783952192.133563:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465584768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783952192.133652:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465584896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783952192.133725:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952192.133755:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f3f840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952192.133879:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465584896 00000100:00100000:2.0:1783952192.133887:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465584896 00000100:00100000:2.0:1783952192.133932:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783952192.133939:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94404:x1870605465584896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783952192.134091:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94404:x1870605465584896:12345-0@lo:503:mount.lustre.0 Request processed in 152us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952192.134099:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783952192.134192:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465584896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783952192.134747:0:94416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b046acca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94416:1870605465585024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952192.134791:0:94416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.134825:0:94416:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049a33f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783952192.134878:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465585024 00000100:00100000:2.0:1783952192.134883:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465585024 00000100:00100000:2.0:1783952192.134905:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783952192.134911:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94416:x1870605465585024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952192.135427:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94416:x1870605465585024:12345-0@lo:502:llog_process_th.0 Request processed in 514us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952192.135436:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783952192.135629:0:94416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b046acca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94416:1870605465585024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783952192.135658:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783952192.135669:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952192.135672:0:94416:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783952192.135676:0:94416:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783952192.135679:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783952192.135694:0:94416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97b0468a0000) 00000020:00000080:1.0:1783952192.135717:0:94416:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1783952192.135724:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783952192.135811:0:94416:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783952192.135819:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5f77 00000020:00000080:1.0:1783952192.136064:0:94416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783952192.136069:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952192.136073:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952192.136075:0:94416:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783952192.136078:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783952192.136081:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952192.136082:0:94416:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783952192.136085:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783952192.136093:0:94416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97b0468a4d40) 00000020:00000080:1.0:1783952192.136105:0:94416:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1783952192.136109:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783952192.136111:0:94416:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783952192.136114:0:94416:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783952192.136119:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783952192.136169:0:94416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b04661c800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783952192.136181:0:94416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97b0468a3380) 00000020:00000080:1.0:1783952192.136191:0:94416:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1783952192.136246:0:94416:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783952192.136251:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5f8c 00000020:00000080:1.0:1783952192.136350:0:94416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783952192.136358:0:94416:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783952192.136362:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x22c73c7857bb5f93 00080000:01000000:1.0:1783952192.136379:0:94416:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783952192.136383:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5f9a 20000000:01000000:0.0:1783952192.140764:0:94411:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783952192.140780:0:94411:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783952192.141068:0:94413:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783952192.141074:0:94413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783952192.141099:0:94413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.141133:0:94413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783952192.141144:0:94413:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000070552s 00010000:00010000:2.0:1783952192.141149:0:94413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.141155:0:94413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.141162:0:94413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.141169:0:94413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.141175:0:94413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952192.141179:0:94413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.141187:0:94413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.141199:0:94413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.141207:0:94413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.141213:0:94413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952192.141421:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:3644:x1870605465584256:12345-0@lo:253:kworker.0 Request processed in 20664us (23201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.141433:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1783952192.141534:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783952192.141538:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783952192.141539:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783952192.141540:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783952192.141541:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783952192.141543:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783952192.141544:0:3644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783952192.141546:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783952192.141548:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783952192.141551:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465584256:0@lo:253:kworker.0 20000000:01000000:3.0:1783952192.145761:0:94415:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783952192.165326:0:94415:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783952192.165349:0:94415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1783952192.165473:0:94413:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783952192.165478:0:94413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783952192.165504:0:94413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.165520:0:94413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783952192.165531:0:94413:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000070552s 00010000:00010000:2.0:1783952192.165536:0:94413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.165543:0:94413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.165551:0:94413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.165559:0:94413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.165566:0:94413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952192.165583:0:94413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.165614:0:94413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.165629:0:94413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.165637:0:94413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.165643:0:94413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b175a15600/0x22c73c7857bb5fa8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952192.166016:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:3642:x1870605465584384:12345-0@lo:253:kworker.0 Request processed in 41183us (47694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.166031:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1783952192.166183:0:3642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783952192.166185:0:3642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783952192.166187:0:3642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783952192.166188:0:3642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783952192.166189:0:3642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783952192.166191:0:3642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783952192.166192:0:3642:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783952192.166194:0:3642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783952192.166196:0:3642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783952192.166199:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465584384:0@lo:253:kworker.0 00010000:00010000:3.0:1783952192.223804:0:94416:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1783952192.223950:0:94416:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 115964116996 srv lr: 120259084288 lx: 0 gen 22 00000001:00080000:3.0:1783952192.223999:0:94416:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: d33551be-a709-4ba2-a74c-f4d7b53c6817 idx: 2 lr: 0 srv lr: 120259084288 lx: 0 gen 24 00000001:00000004:3.0:1783952192.224020:0:94416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 120259084288 00000001:00080000:3.0:1783952192.224122:0:94416:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1783952192.224173:0:94416:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b176bc6cc0: xid 1870605465564928, transno 120259084295, client gen 22, slot idx 0 00000001:00080000:3.0:1783952192.224181:0:94416:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b176bc6c00: xid 1870605465566848, transno 120259084296, client gen 22, slot idx 1 00000001:00080000:3.0:1783952192.224186:0:94416:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b1748af600: xid 1870605447767808, transno 120259084294, client gen 24, slot idx 2 00000001:00080000:3.0:1783952192.224191:0:94416:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff97b1748af780: xid 1870605447767424, transno 120259084293, client gen 24, slot idx 3 00000020:00000080:3.0:1783952192.224720:0:94416:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97b0489b8000) 00000020:00000080:3.0:1783952192.224739:0:94416:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1783952192.224800:0:94416:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783952192.224806:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5fc4 00000020:00000080:2.0:1783952192.225224:0:94416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783952192.231467:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x22c73c7857bb5fcb 00000020:00000080:0.0:1783952192.231880:0:94416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783952192.231895:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783952192.231902:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952192.231904:0:94416:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783952192.231907:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783952192.231910:0:94416:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1783952192.231918:0:94416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783952192.231920:0:94416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783952192.231921:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783952192.231924:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952192.231925:0:94416:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783952192.231928:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952192.231934:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952192.231935:0:94416:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783952192.231941:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783952192.232000:0:94416:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783952192.232018:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783952192.232022:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952192.232023:0:94416:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783952192.232026:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952192.232029:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952192.232031:0:94416:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783952192.232033:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783952192.232038:0:94416:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:00000080:0.0:1783952192.232065:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783952192.232080:0:94416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff97b048b5b380) 00000020:00000080:0.0:1783952192.232097:0:94416:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1783952192.232103:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783952192.232164:0:94416:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783952192.232170:0:94416:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783952192.232177:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5fd9 00010000:00080000:0.0:1783952192.232210:0:94416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b15036a000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:0.0:1783952192.233918:0:94416:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1783952192.236736:0:94416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783952192.236751:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783952192.236787:0:94416:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783952192.236810:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5fe0 00000100:00080000:3.0:1783952192.236821:0:94416:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783952192.236827:0:94416:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97b15036a000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952192.236862:0:94416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1756e0a80 x1870605465585152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783952192.236892:0:94416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783952192.236946:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952192.236950:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.236952:0:94416:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783952192.236955:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783952192.236958:0:94416:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1783952192.236960:0:94416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783952192.236962:0:94416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783952192.236964:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00100000:1.0:1783952192.237163:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465585152:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783952192.237234:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.237323:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465585152 00000100:00100000:1.0:1783952192.237330:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465585152 00000100:00100000:1.0:1783952192.237362:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:1.0:1783952192.237369:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b046acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465585152:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783952192.237393:0:8444:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3907 last 0 00000020:00000080:1.0:1783952192.237422:0:8444:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5fe7 00000004:00100000:1.0:1783952192.237436:0:8444:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783952192.237682:0:8444:0:(import.c:65:import_set_state_nolock()) ffff97b04965b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952192.237781:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b046acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465585152:12345-0@lo:38:llog_process_th.0 Request processed in 410us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.237789:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000020:00000080:3.0:1783952192.237847:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.237849:0:94416:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783952192.237856:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783952192.237862:0:94416:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783952192.237865:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.237867:0:94416:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783952192.237870:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783952192.237874:0:94416:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:3.0:1783952192.237895:0:94416:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783952192.237898:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783952192.237912:0:94416:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97b0489bb380) 00000020:00000080:3.0:1783952192.237931:0:94416:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783952192.237937:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783952192.238023:0:94416:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783952192.238029:0:94416:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783952192.238036:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb5ff5 00010000:00080000:3.0:1783952192.238061:0:94416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b143af6800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:3.0:1783952192.238278:0:94416:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:3.0:1783952192.239171:0:94416:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783952192.239194:0:94416:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783952192.241921:0:94416:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:3.0:1783952192.242766:0:94416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783952192.242804:0:94416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].29, 64 off10048 00000100:00100000:0.0:1783952192.243737:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783952192.243750:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1783952192.243760:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783952192.243766:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783952192.243770:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b15036a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783952192.245431:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465585152:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1783952192.246262:0:94416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].1, 64 off8256 00000100:00100000:2.0:1783952192.246904:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952192.246922:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465585280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783952192.247011:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.247171:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465585280 00000100:00100000:1.0:1783952192.247178:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465585280 00000100:00100000:1.0:1783952192.247227:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:1.0:1783952192.247237:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465585280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783952192.247281:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:1.0:1783952192.247329:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465585280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.247335:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00100000:2.0:1783952192.247462:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465585280:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1783952192.247663:0:94422:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:0.0:1783952192.247668:0:94422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1783952192.247863:0:94422:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:0.0:1783952192.247885:0:94422:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1783952192.248030:0:94422:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:0.0:1783952192.248034:0:94422:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783952192.249109:0:94416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783952192.249124:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783952192.249164:0:94416:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783952192.249190:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb5ffc 00000100:00080000:3.0:1783952192.249201:0:94416:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783952192.249206:0:94416:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b143af6800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952192.249241:0:94416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1756e2680 x1870605465585408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952192.249306:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465585408:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783952192.249373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783952192.249423:0:94416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783952192.249505:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952192.249510:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.249513:0:94416:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783952192.249516:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783952192.249518:0:94416:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1783952192.249520:0:94416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783952192.249522:0:94416:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783952192.249524:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783952192.249526:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.249528:0:94416:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783952192.249530:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783952192.249535:0:94416:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783952192.249538:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.249539:0:94416:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783952192.249542:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783952192.249546:0:94416:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.148@tcp to nid 0x20000c0a8ca94 (192.168.202.148@tcp) 00000020:01000000:3.0:1783952192.249568:0:94416:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783952192.249571:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783952192.249582:0:94416:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97b0489b99c0) 00000020:00000080:3.0:1783952192.249626:0:94416:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1783952192.249641:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783952192.249701:0:94416:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783952192.249708:0:94416:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1783952192.249715:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22c73c7857bb600a 00010000:00080000:3.0:1783952192.249743:0:94416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b14f00d800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:3.0:1783952192.249932:0:94416:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1783952192.250167:0:94416:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783952192.250184:0:94416:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783952192.250923:0:94416:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:3.0:1783952192.251739:0:94416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783952192.251772:0:94416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].29, 64 off10048 00000040:00080000:3.0:1783952192.251885:0:94416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x76:0x0].1, 64 off8256 00000100:00100000:1.0:1783952192.252298:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465585408 00000100:00100000:1.0:1783952192.252309:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465585408 00000100:00100000:1.0:1783952192.252353:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4958 00000100:00100000:1.0:1783952192.252361:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3641:x1870605465585408:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783952192.252396:0:26198:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3907 last 0 00000020:00000080:1.0:1783952192.252426:0:26198:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb6011 00002000:00100000:1.0:1783952192.252441:0:26198:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97b04965e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783952192.252453:0:26198:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783952192.252456:0:26198:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783952192.252513:0:26198:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783952192.252538:0:26198:0:(import.c:65:import_set_state_nolock()) ffff97b04965f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952192.252647:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465585408:12345-0@lo:8:llog_process_th.0 Request processed in 286us (3273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.252654:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4958 00000100:00100000:2.0:1783952192.252826:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783952192.252836:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783952192.252852:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783952192.252858:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783952192.252861:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783952192.252885:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783952192.252891:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465585408:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1783952192.252920:0:94422:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783952192.253090:0:94422:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3907195500643ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783952192.253098:0:94422:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783952192.254373:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952192.254390:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465585536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952192.254452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.254740:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465585536 00000100:00100000:1.0:1783952192.254748:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465585536 00000100:00100000:1.0:1783952192.254799:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233 00000100:00100000:1.0:1783952192.254807:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465585536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783952192.254841:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952192.254889:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465585536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.254896:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233 00000100:00100000:1.0:1783952192.254946:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465585536:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783952192.255076:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783952192.255447:0:94405:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1783952192.255818:0:94424:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:0.0:1783952192.255824:0:94424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783952192.256024:0:94424:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000040:00080000:0.0:1783952192.256050:0:94424:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783952192.256173:0:94424:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:0.0:1783952192.256176:0:94424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783952192.257155:0:94416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783952192.257167:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783952192.257208:0:94416:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783952192.257233:0:94416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb6018 00000100:00080000:3.0:1783952192.257243:0:94416:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783952192.257248:0:94416:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97b14f00d800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:3.0:1783952192.257293:0:94416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1756e0700 x1870605465585664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952192.257363:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465585664:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783952192.257426:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783952192.257495:0:94416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783952192.257626:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952192.257645:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.257648:0:94416:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783952192.257651:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952192.257663:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.257665:0:94416:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783952192.257669:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783952192.257671:0:94416:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783952192.257673:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952192.257676:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.257677:0:94416:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783952192.257680:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952192.257682:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.257684:0:94416:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783952192.257687:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783952192.257693:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952192.257696:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.257697:0:94416:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000020:01000000:3.0:1783952192.257700:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952192.257703:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.257704:0:94416:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:3.0:1783952192.257707:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1783952192.257751:0:94416:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:3.0:1783952192.258170:0:94416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94416:1870605465585792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952192.258222:0:94416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.258247:0:94416:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783952192.258330:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465585664 00000100:00100000:0.0:1783952192.258338:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465585664 00000100:00100000:0.0:1783952192.258372:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4959 00000100:00100000:0.0:1783952192.258379:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3641:x1870605465585664:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783952192.258406:0:15187:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3907 last 0 00000020:00000080:0.0:1783952192.258430:0:15187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22c73c7857bb601f 00002000:00100000:0.0:1783952192.258444:0:15187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97b174b11800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783952192.258447:0:15187:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783952192.258450:0:15187:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783952192.258513:0:15187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783952192.258537:0:15187:0:(import.c:65:import_set_state_nolock()) ffff97b174b12000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952192.258657:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465585792 00000100:00100000:3.0:1783952192.258662:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465585792 00000100:00100000:3.0:1783952192.258692:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783952192.258699:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:94416:x1870605465585792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952192.258791:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:94416:x1870605465585792:12345-0@lo:502:llog_process_th.0 Request processed in 90us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952192.258798:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783952192.258853:0:94416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94416:1870605465585792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952192.258878:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952192.258888:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.258889:0:94416:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:3.0:1783952192.258893:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952192.258897:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952192.258898:0:94416:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1783952192.258901:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1783952192.258912:0:94416:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:0.0:1783952192.259193:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3641:x1870605465585664:12345-0@lo:8:llog_process_th.0 Request processed in 812us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.259200:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4959 00000100:00100000:2.0:1783952192.259256:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783952192.259264:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783952192.259281:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783952192.259286:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783952192.259290:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b14f00d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783952192.259344:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783952192.259350:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465585664:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1783952192.259526:0:94424:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783952192.259581:0:94424:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3907201992087ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783952192.259614:0:94424:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783952192.259814:0:94416:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94416:1870605465585920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952192.259857:0:94416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.260070:0:94416:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1434f60c0 going to sleep for 11 seconds 00000020:01000004:3.0:1783952192.260106:0:94426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b04661c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783952192.260109:0:94426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b04661c800 4 00000100:00100000:2.0:1783952192.260713:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952192.260725:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465586048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952192.260760:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.260797:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465586048 00000100:00100000:2.0:1783952192.260804:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465586048 00000100:00100000:2.0:1783952192.260855:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234 00000100:00100000:2.0:1783952192.260863:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465586048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783952192.260887:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952192.260929:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465586048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952192.260944:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234 00000100:00080000:2.0:1783952192.260980:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952192.261008:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465586048:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1783952192.261887:0:94405:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783952192.262139:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465585920 00000100:00100000:1.0:1783952192.262146:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465585920 00000100:00100000:1.0:1783952192.262218:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783952192.262226:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:94416:x1870605465585920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952192.262385:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:94416:x1870605465585920:12345-0@lo:502:llog_process_th.0 Request processed in 160us (2527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.262393:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783952192.262485:0:94416:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94416:1870605465585920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783952192.262520:0:94416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783952192.262527:0:94416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952192.262529:0:94416:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1783952192.262535:0:94416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:2.0:1783952192.262696:0:94404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:2.0:1783952192.262722:0:94404:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783952192.262740:0:94404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.262752:0:94404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.262761:0:94404:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b04661c800 from 1 10000000:01000000:2.0:1783952192.262764:0:94404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783952192.262796:0:94404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.262805:0:94404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.262815:0:94404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952192.262835:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465586176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783952192.262877:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.263173:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7900 going to sleep for 11 seconds 00000100:00100000:3.0:1783952192.263214:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465586176 00000100:00100000:3.0:1783952192.263219:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465586176 00000100:00100000:0.0:1783952192.263266:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783952192.263285:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:94404:x1870605465586176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783952192.263298:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952192.263311:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb602d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6026 expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.263331:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb602d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6026 expref: 9 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.263342:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb602d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6026 expref: 9 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.263350:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d200, rc 0) 00000100:00100000:0.0:1783952192.263393:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:94404:x1870605465586176:12345-0@lo:101:mount.lustre.0 Request processed in 110us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.263400:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783952192.263512:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465586176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783952192.263525:0:94404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.263534:0:94404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952192.264235:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465586304:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783952192.264294:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.264362:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7900 going to sleep for 11 seconds 00000100:00100000:3.0:1783952192.264478:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465586304 00000100:00100000:3.0:1783952192.264484:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465586304 00000100:00100000:1.0:1783952192.264576:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783952192.264612:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:94404:x1870605465586304:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783952192.264632:0:94410:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783952192.264650:0:94410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783952192.264654:0:94410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783952192.264657:0:94410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783952192.264659:0:94410:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 126 00000100:00100000:1.0:1783952192.264744:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:94404:x1870605465586304:12345-0@lo:256:mount.lustre.0 Request processed in 160us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.264752:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783952192.264847:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465586304:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783952192.265429:0:94404:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783952192.265453:0:94404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.265464:0:94404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952192.265472:0:94404:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b04661c800 from 1 10000000:01000000:2.0:1783952192.265475:0:94404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783952192.265502:0:94404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb6034 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.265510:0:94404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb6034 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.265531:0:94404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb6034 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952192.265549:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465586432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783952192.265612:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.265638:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7900 going to sleep for 11 seconds 00000100:00100000:1.0:1783952192.265778:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465586432 00000100:00100000:1.0:1783952192.265783:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465586432 00000100:00100000:1.0:1783952192.265821:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783952192.265828:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:94404:x1870605465586432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783952192.265839:0:94411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952192.265854:0:94411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71000/0x22c73c7857bb603b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6034 expref: -99 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952192.265873:0:94411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71000/0x22c73c7857bb603b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6034 expref: 10 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952192.265883:0:94411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71000/0x22c73c7857bb603b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6034 expref: 10 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952192.265892:0:94411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71000, rc 0) 00000100:00100000:1.0:1783952192.265925:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94404:x1870605465586432:12345-0@lo:101:mount.lustre.0 Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.265931:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783952192.265980:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465586432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783952192.265999:0:94404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb6034 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb603b expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952192.266008:0:94404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb6034 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb603b expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952192.266068:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465586560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783952192.266094:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.266111:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b177815cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952192.266124:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465586560 00000100:00100000:1.0:1783952192.266128:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465586560 00000100:00100000:1.0:1783952192.266146:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783952192.266151:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94404:x1870605465586560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783952192.266290:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94404:x1870605465586560:12345-0@lo:501:mount.lustre.0 Request processed in 137us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.266297:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783952192.266329:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465586560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783952192.266356:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465586688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783952192.266393:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.266405:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b177815cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952192.266417:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465586688 00000100:00100000:1.0:1783952192.266420:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465586688 00000100:00100000:1.0:1783952192.266437:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783952192.266443:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94404:x1870605465586688:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783952192.266529:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94404:x1870605465586688:12345-0@lo:503:mount.lustre.0 Request processed in 85us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.266544:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783952192.266613:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465586688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783952192.267284:0:94427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94427:1870605465586816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952192.267323:0:94427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.267385:0:94427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b047bc7900 going to sleep for 11 seconds 00000100:00100000:1.0:1783952192.267417:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465586816 00000100:00100000:1.0:1783952192.267421:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465586816 00000100:00100000:1.0:1783952192.267489:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783952192.267496:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94427:x1870605465586816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952192.267995:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94427:x1870605465586816:12345-0@lo:502:llog_process_th.0 Request processed in 499us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.268003:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783952192.268099:0:94427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94427:1870605465586816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783952192.268127:0:94427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783952192.268137:0:94427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952192.268139:0:94427:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783952192.268147:0:94427:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b04661c800 00000020:00000080:2.0:1783952192.268150:0:94427:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783952192.268158:0:94427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783952192.268160:0:94427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952192.268162:0:94427:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783952192.268164:0:94427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783952192.268167:0:94427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952192.268168:0:94427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783952192.268172:0:94427:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b04661c800 00000020:00000080:2.0:1783952192.268174:0:94427:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783952192.268247:0:94427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94427:1870605465586944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952192.268292:0:94427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.268545:0:94427:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144984d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783952192.268634:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465586944 00000100:00100000:3.0:1783952192.268640:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465586944 00000100:00100000:3.0:1783952192.268678:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783952192.268685:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94427:x1870605465586944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952192.268785:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94427:x1870605465586944:12345-0@lo:502:llog_process_th.0 Request processed in 100us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952192.268792:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783952192.268922:0:94427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94427:1870605465586944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783952192.268952:0:94427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783952192.268956:0:94427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952192.268958:0:94427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783952192.268961:0:94427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783952192.269306:0:94404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783952192.269330:0:94404:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783952192.269353:0:94404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb6034 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb603b expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.269363:0:94404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb6034 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb603b expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952192.269427:0:94404:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783952192.269430:0:94404:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97b04661c800 10000000:01000000:3.0:1783952192.269433:0:94404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97b04661c800 10000000:01000000:3.0:1783952192.269437:0:94404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783952192.269443:0:94404:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b04661c800 from 1 10000000:01000000:3.0:1783952192.269445:0:94404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783952192.269470:0:94404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.269480:0:94404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.269490:0:94404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952192.269508:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465587072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783952192.269540:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.269564:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166f3f780 going to sleep for 11 seconds 00000100:00100000:3.0:1783952192.269579:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465587072 00000100:00100000:3.0:1783952192.269583:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465587072 00000100:00100000:3.0:1783952192.269642:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783952192.269649:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:94404:x1870605465587072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783952192.269658:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952192.269670:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762af600/0x22c73c7857bb6049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6042 expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.269690:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762af600/0x22c73c7857bb6049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6042 expref: 11 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.269713:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762af600/0x22c73c7857bb6049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6042 expref: 11 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.269723:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af600, rc 0) 00000100:00100000:3.0:1783952192.269755:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94404:x1870605465587072:12345-0@lo:101:mount.lustre.0 Request processed in 107us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952192.269762:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783952192.269799:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465587072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783952192.269812:0:94404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952192.269821:0:94404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952192.269866:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465587200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783952192.269891:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.269904:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b15063b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952192.269916:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465587200 00000100:00100000:3.0:1783952192.269920:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465587200 00000100:00100000:3.0:1783952192.269937:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783952192.269943:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94404:x1870605465587200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783952192.270125:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94404:x1870605465587200:12345-0@lo:501:mount.lustre.0 Request processed in 181us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952192.270132:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783952192.270164:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465587200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783952192.270200:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465587328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783952192.270234:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952192.270248:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b15063b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952192.270261:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465587328 00000100:00100000:3.0:1783952192.270264:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465587328 00000100:00100000:3.0:1783952192.270294:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783952192.270300:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94404:x1870605465587328:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783952192.270374:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94404:x1870605465587328:12345-0@lo:503:mount.lustre.0 Request processed in 74us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952192.270381:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783952192.270420:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465587328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783952192.277145:0:94428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94428:1870605465587456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952192.277228:0:94428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.277278:0:94428:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b177815600 going to sleep for 11 seconds 00000100:00100000:0.0:1783952192.279120:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465587456 00000100:00100000:0.0:1783952192.279131:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465587456 00000100:00100000:0.0:1783952192.280152:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783952192.280167:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94428:x1870605465587456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952192.280365:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94428:x1870605465587456:12345-0@lo:502:llog_process_th.0 Request processed in 201us (3136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.280373:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783952192.280498:0:94428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94428:1870605465587456:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783952192.280565:0:94428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783952192.280580:0:94428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97b1447b99c0) 00000020:00000080:1.0:1783952192.280620:0:94428:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1783952192.289388:0:94428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b04661c800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783952192.289400:0:94428:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b04661c800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783952192.289403:0:94428:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b04661c800 4 00010000:00080000:1.0:1783952192.289450:0:94428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b176be7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.148@tcp at head 00010000:00010000:1.0:1783952192.293501:0:94428:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1783952192.293635:0:94428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783952192.293684:0:94428:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783952192.293698:0:94428:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x22c73c7857bb6057 00000100:00080000:1.0:1783952192.293710:0:94428:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783952192.293716:0:94428:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b176be7000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952192.293767:0:94428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049e74700 x1870605465587584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952192.293801:0:94428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783952192.295094:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465587584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783952192.295182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952192.295256:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465587584 00000100:00100000:0.0:1783952192.295265:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465587584 00000100:00100000:0.0:1783952192.295312:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:0.0:1783952192.295320:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465587584:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783952192.295387:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465587584:12345-0@lo:38:llog_process_th.0 Request processed in 66us (205us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783952192.295395:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1783952192.295702:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783952192.295711:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b176be7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952192.295715:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783952192.295719:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465587584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783952192.297322:0:94428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94428:1870605465587712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952192.297394:0:94428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.297431:0:94428:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952192.297482:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465587712 00000100:00100000:2.0:1783952192.297489:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465587712 00000100:00100000:2.0:1783952192.297563:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783952192.297573:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94428:x1870605465587712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952192.298138:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94428:x1870605465587712:12345-0@lo:502:llog_process_th.0 Request processed in 565us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952192.298147:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783952192.298421:0:94428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94428:1870605465587712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952192.298475:0:94428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94428:1870605465587840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952192.298513:0:94428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952192.298581:0:94428:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952192.298643:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465587840 00000100:00100000:2.0:1783952192.298649:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465587840 00000100:00100000:2.0:1783952192.298722:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783952192.298731:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94428:x1870605465587840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952192.298812:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94428:x1870605465587840:12345-0@lo:502:llog_process_th.0 Request processed in 82us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952192.298820:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783952192.298879:0:94428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94428:1870605465587840:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783952192.298899:0:94428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1783952192.299148:0:94404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:2.0:1783952192.299174:0:94404:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783952192.299197:0:94404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.299209:0:94404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783952192.299288:0:94404:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783952192.299291:0:94404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783952192.299297:0:94404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783952192.299298:0:94404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783952192.299300:0:94404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783952192.299301:0:94404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783952192.299302:0:94404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783952192.299304:0:94404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783952192.299305:0:94404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783952192.299307:0:94404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783952192.299311:0:94404:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783952192.299313:0:94404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783952192.299315:0:94404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783952192.299316:0:94404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783952192.299317:0:94404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783952192.299318:0:94404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783952192.299319:0:94404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783952192.299320:0:94404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783952192.299321:0:94404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783952192.299322:0:94404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783952192.299323:0:94404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783952192.299339:0:94404:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783952192.299349:0:94404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465587968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783952192.299385:0:94404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.299409:0:94404:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144984840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952192.299423:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465587968 00000100:00100000:2.0:1783952192.299427:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465587968 00000100:00100000:2.0:1783952192.299538:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783952192.299546:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94404:x1870605465587968:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783952192.299569:0:94415:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783952192.299583:0:94415:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783952192.300939:0:94415:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783952192.301036:0:94415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783952192.301319:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:94404:x1870605465587968:12345-0@lo:253:mount.lustre.0 Request processed in 1769us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952192.301329:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 20000000:01000000:2.0:1783952192.301384:0:94413:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783952192.301389:0:94413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783952192.301409:0:94413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.301422:0:94413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb602d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6026 expref: 10 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.301441:0:94413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.301473:0:94413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb602d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb6026 expref: 10 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952192.301487:0:94413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb602d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb6026 expref: 10 pid: 94410 timeout: 4007 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952192.301500:0:94413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94413:1870605465588096:0@lo:104: 00000100:00100000:2.0:1783952192.301534:0:94413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.301574:0:94413:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144984600 going to sleep for 11 seconds 00000100:00100000:0.0:1783952192.301746:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465588096 00000100:00100000:0.0:1783952192.301754:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465588096 00000100:00100000:0.0:1783952192.301800:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1783952192.301808:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:94413:x1870605465588096:12345-0@lo:104: 00010000:00010000:0.0:1783952192.301821:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.301880:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783952192.301886:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:94413:x1870605465588096:12345-0@lo:104: Request processed in 79us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.301892:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00010000:0.0:1783952192.301912:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952192.301919:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.301926:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a14000 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952192.301929:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.301939:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952192.301954:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952192.301959:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1783952192.302068:0:94413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94413:1870605465588096:0@lo:104: 00010000:00010000:1.0:1783952192.302090:0:94413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302162:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302170:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952192.302193:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302200:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb6026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb602d expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302215:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952192.302217:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952192.302218:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952192.302230:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465588224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952192.302261:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952192.302316:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465588224 00000100:00100000:0.0:1783952192.302320:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465588224 00010000:00010000:0.0:1783952192.302342:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb602d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6026 expref: 11 pid: 94410 timeout: 4007 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952192.302365:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1783952192.302372:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:3642:x1870605465588224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952192.302383:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952192.302388:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb602d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6026 expref: 11 pid: 94410 timeout: 4007 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302406:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb602d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb6026 expref: 11 pid: 94410 timeout: 4007 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302421:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb602d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb6026 expref: 11 pid: 94410 timeout: 4007 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302436:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302443:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783952192.302457:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001068447s 00010000:00010000:0.0:1783952192.302461:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302467:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302472:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302478:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302482:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952192.302486:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302492:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302510:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952192.302519:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952192.302547:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:3642:x1870605465588224:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.302553:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1783952192.302582:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465588224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952192.302677:0:94413:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952192.302685:0:94413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952192.302691:0:94413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b175a15e00/0x22c73c7857bb605e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952192.303238:0:94404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:94404:1870605465587968:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783952192.303250:0:94404:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783952192.303253:0:94404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783952192.303255:0:94404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783952192.303257:0:94404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952192.303258:0:94404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952192.303259:0:94404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952192.303261:0:94404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952192.303262:0:94404:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783952192.303264:0:94404:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783952192.303266:0:94404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952192.303277:0:94404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783952192.303289:0:94404:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1783952192.318070:0:94404:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411352 00000040:01000000:3.0:1783952192.318425:0:94404:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1783952192.320403:0:94436:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1783952192.320928:0:94436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783952192.323183:0:94436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783952192.323294:0:94436:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1783952192.323625:0:94404:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1783952192.327733:0:94437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94437:1870605465588352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783952192.327813:0:94437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.327853:0:94437:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144984cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952192.327922:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465588352 00000100:00100000:0.0:1783952192.327930:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465588352 00000100:00100000:0.0:1783952192.327999:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:0.0:1783952192.328009:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94437:x1870605465588352:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783952192.328092:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94437:x1870605465588352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.328100:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:2.0:1783952192.328245:0:94437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94437:1870605465588352:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1783952192.328284:0:94437:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783952192.328311:0:94437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94437:1870605465588480:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783952192.328341:0:94437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.328366:0:94437:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144984cc0 going to sleep for 11 seconds 00000020:00080000:1.0:1783952192.328458:0:94435:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411352 00000020:00080000:1.0:1783952192.328462:0:94435:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411352 00000100:00100000:0.0:1783952192.328551:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465588480 00000100:00100000:0.0:1783952192.328556:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465588480 00000100:00100000:0.0:1783952192.328618:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:0.0:1783952192.328627:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94437:x1870605465588480:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783952192.328733:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94437:x1870605465588480:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 107us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.328740:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:2.0:1783952192.328817:0:94437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94437:1870605465588480:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783952192.328875:0:94437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94437:1870605465588608:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783952192.328901:0:94437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952192.328925:0:94437:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b144984cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952192.329082:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465588608 00000100:00100000:0.0:1783952192.329087:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465588608 00000100:00100000:0.0:1783952192.329119:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:0.0:1783952192.329126:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94437:x1870605465588608:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783952192.329195:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94437:x1870605465588608:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 69us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952192.329203:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1783952192.329306:0:94437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94437:1870605465588608:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783952192.329351:0:94437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783952192.331460:0:94404:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783952192.331504:0:94404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783952192.332099:0:94404:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783952192.332107:0:94404:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783952192.332145:0:94404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783952192.333820:0:94437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783952192.333893:0:94437:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783952192.333898:0:94437:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1783952192.334416:0:94404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783952192.339450:0:94404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783952192.339521:0:94404:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783952192.339721:0:94404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1783952192.340391:0:94404:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00010000:00080000:2.0:1783952192.344740:0:94404:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 120259084296 00010000:00080000:2.0:1783952192.349936:0:94438:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94438 00010000:02000000:2.0:1783952192.350039:0:94438:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1783952192.350044:0:94438:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783952192.350049:0:94438:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1783952192.350753:0:94404:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783952192.350774:0:94404:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783952192.350801:0:94404:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1783952192.350821:0:94404:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1783952192.353758:0:94404:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783952192.357777:0:94404:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783952193.022668:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952193.022716:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952193.022748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952193.022783:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447780608 00000100:00100000:1.0:1783952193.022794:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447780608 00000100:00100000:1.0:1783952193.022828:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447780736 00000100:00100000:1.0:1783952193.022831:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447780736 00000100:00100000:1.0:1783952193.022888:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1399 00000100:00100000:1.0:1783952193.022898:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447780736:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952193.023041:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447780480 00000100:00100000:3.0:1783952193.023046:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447780480 00000100:00100000:3.0:1783952193.023070:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 26 00000100:00100000:3.0:1783952193.023075:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1870605447780480:12345-192.168.202.48@tcp:250:kworker.0 00010000:00080000:3.0:1783952193.023098:0:94410:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp t0 exp 0000000000000000 cur 3907 last 0 00000020:00000080:3.0:1783952193.023127:0:94410:0:(genops.c:1406:class_connect()) connect: client e617e28a-7c0f-459e-8765-f628898cec50, cookie 0x22c73c7857bb6065 00000100:00080000:3.0:1783952193.023290:0:94410:0:(import.c:65:import_set_state_nolock()) ffff97b0497f4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952193.023347:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+5:2397:x1870605447780480:12345-192.168.202.48@tcp:250:kworker.0 Request processed in 270us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952193.023355:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 26 00000100:00100000:1.0:1783952193.023506:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447780736:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 609us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952193.023525:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1399 00000100:00100000:1.0:1783952193.023543:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1432 00000100:00100000:1.0:1783952193.023547:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1870605447780608:12345-192.168.202.48@tcp:38:kworker.0 00010000:00080000:1.0:1783952193.023566:0:66236:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'd33551be-a709-4ba2-a74c-f4d7b53c6817' at ffff97b1445c3800, cookie 0x22c73c7857bb5fb6 00010000:00080000:1.0:1783952193.023571:0:66236:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp recovering/t120259084297 exp ffff97b1445c3800 cur 3907 last 1783952192 00010000:02000400:1.0:1783952193.023578:0:66236:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1783952193.023585:0:66236:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1783952193.023678:0:66236:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783952193.023792:0:66236:0:(import.c:65:import_set_state_nolock()) ffff97b174692800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952193.023822:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447780608:12345-192.168.202.48@tcp:38:kworker.0 Request processed in 273us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952193.023830:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1432 00000100:00080000:1.0:1783952193.023857:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952193.043137:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952193.043195:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447772032 00000100:00100000:3.0:1783952193.043205:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447772032 00000100:00100000:3.0:1783952193.043340:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1433 00000100:00100000:3.0:1783952193.043351:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447772032:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00080000:3.0:1783952193.043373:0:83761:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 120259084297, current: 120259084297, replaying 00000100:00100000:3.0:1783952193.043392:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447772032:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 44us (265us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952193.043412:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1433 00010000:00080000:2.0:1783952193.043422:0:94438:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1783952193.057330:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952194.081071:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783952194.081137:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783952194.081141:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b04661c800 from 127 10000000:01000000:2.0:1783952194.081146:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783952194.081196:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.081208:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.081218:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952194.081244:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465588736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.081322:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952194.081360:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.081411:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465588736 00000100:00100000:3.0:1783952194.081419:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465588736 00000100:00100000:3.0:1783952194.081476:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783952194.081486:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+10:6514:x1870605465588736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952194.081500:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952194.081515:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb606c expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.081537:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb606c expref: 11 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.081547:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb606c expref: 11 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.081555:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762ae600, rc 0) 00000100:00100000:3.0:1783952194.081623:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465588736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.081629:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783952194.081631:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465588736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952194.081644:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.081671:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952194.081730:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465588864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.081760:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952194.081787:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.081865:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465588864 00000100:00100000:3.0:1783952194.081870:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465588864 00000100:00100000:3.0:1783952194.081899:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783952194.081906:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465588864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783952194.081919:0:94410:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783952194.081944:0:94410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783952194.081948:0:94410:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 127 00000100:00100000:3.0:1783952194.082055:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465588864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.082068:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783952194.082075:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465588864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783952194.082119:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783952194.082126:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.082134:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952194.082142:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783952194.082144:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b151231000 from 58 10000000:01000000:2.0:1783952194.082146:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783952194.082174:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.082181:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.082188:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952194.082201:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465588992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.082232:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952194.082261:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3480 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.082317:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465588992 00000100:00100000:1.0:1783952194.082322:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465588992 00000100:00100000:1.0:1783952194.082354:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783952194.082361:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+11:6514:x1870605465588992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952194.082369:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952194.082378:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb6081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb607a expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.082392:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb6081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb607a expref: 12 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.082402:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb6081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb607a expref: 12 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.082415:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71e00, rc 0) 00000100:00100000:1.0:1783952194.082455:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465588992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.082461:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783952194.082536:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465588992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952194.082557:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.082565:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952194.082641:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.082665:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952194.082692:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1783952194.082746:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465589120 00000100:00100000:0.0:1783952194.082751:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465589120 00000100:00100000:0.0:1783952194.082788:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783952194.082796:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465589120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.082931:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465589120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952194.082938:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783952194.083010:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.083040:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.083082:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.083116:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:0.0:1783952194.083167:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465589248 00000100:00100000:0.0:1783952194.083171:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465589248 00000100:00100000:0.0:1783952194.083200:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783952194.083207:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465589248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.083287:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465589248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952194.083293:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783952194.083367:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783952194.084225:0:94498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:0.0:1783952194.084938:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:0.0:1783952194.084962:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783952194.084972:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.084984:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952194.085012:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783952194.085014:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b151231000 from 124 10000000:01000000:0.0:1783952194.085016:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783952194.085046:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.085055:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.085063:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952194.085086:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.085142:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952194.085188:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6180 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.085316:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465589376 00000100:00100000:1.0:1783952194.085323:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465589376 00000100:00100000:1.0:1783952194.085368:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783952194.085376:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+12:6514:x1870605465589376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952194.085388:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952194.085400:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6088 expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.085420:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6088 expref: 13 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.085430:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6088 expref: 13 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.085438:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70e00, rc 0) 00000100:00100000:1.0:1783952194.085481:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465589376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.085487:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783952194.085691:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952194.085704:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.085713:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952194.085758:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.085797:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952194.085911:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6180 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.092984:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465589504 00000100:00100000:3.0:1783952194.092999:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465589504 00000100:00100000:3.0:1783952194.093065:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783952194.093075:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465589504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783952194.093101:0:94412:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783952194.093124:0:94412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783952194.093128:0:94412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783952194.093131:0:94412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783952194.093134:0:94412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783952194.093137:0:94412:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:3.0:1783952194.093286:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465589504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 212us (7487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.093294:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783952194.093308:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783952194.093396:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783952194.093410:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.093419:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952194.093428:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783952194.093430:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:0.0:1783952194.093434:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783952194.093464:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.093471:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.093479:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952194.093498:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.093531:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952194.093571:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6180 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.093657:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465589632 00000100:00100000:1.0:1783952194.093661:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465589632 00000100:00100000:1.0:1783952194.093685:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783952194.093692:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+13:6514:x1870605465589632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952194.093701:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952194.093713:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb609d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6096 expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.093734:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb609d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6096 expref: 14 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.093743:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb609d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6096 expref: 14 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.093751:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70a00, rc 0) 00000100:00100000:1.0:1783952194.093779:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465589632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.093785:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783952194.093913:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952194.093926:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.093935:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952194.093986:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.094019:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952194.094046:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6180 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.094088:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465589760 00000100:00100000:1.0:1783952194.094092:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465589760 00000100:00100000:1.0:1783952194.094120:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783952194.094126:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465589760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.094261:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465589760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.094268:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783952194.094376:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.094402:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.094441:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952194.094464:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952194.094533:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465589888 00000100:00100000:2.0:1783952194.094538:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465589888 00000100:00100000:2.0:1783952194.094565:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783952194.094573:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465589888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.094683:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465589888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952194.094689:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783952194.094861:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465589888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952194.097643:0:94499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:2.0:1783952194.097824:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:2.0:1783952194.097847:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783952194.097859:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.097871:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952194.097896:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1783952194.097899:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97b151231000 from 1 10000000:01000000:2.0:1783952194.097901:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783952194.097937:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb60a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.097945:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb60a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.097956:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb60a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952194.097980:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.098045:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952194.098091:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952194.098249:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465590016 00000100:00100000:0.0:1783952194.098265:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465590016 00000100:00100000:0.0:1783952194.098306:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783952194.098314:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+14:6514:x1870605465590016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952194.098329:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952194.098341:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb60ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb60a4 expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.098363:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb60ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb60a4 expref: 15 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.098372:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b047b2c000/0x22c73c7857bb60ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60a4 expref: 15 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.098380:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2c000, rc 0) 00000100:00100000:0.0:1783952194.098419:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465590016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952194.098426:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783952194.098635:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952194.098648:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb60a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.098656:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb60a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb60ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952194.098670:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783952194.098674:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb60a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.098681:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a14000/0x22c73c7857bb60a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952194.098698:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783952194.098700:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b151231000 from 7 10000000:01000000:2.0:1783952194.098702:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783952194.098716:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb60b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.098723:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb60b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.098729:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb60b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952194.098741:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.098764:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952194.098792:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.099067:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465590144 00000100:00100000:3.0:1783952194.099072:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465590144 00000100:00100000:3.0:1783952194.099108:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783952194.099117:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465590144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952194.099125:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952194.099135:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762afc00/0x22c73c7857bb60b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb60b2 expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.099158:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762afc00/0x22c73c7857bb60b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb60b2 expref: 16 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.099168:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762afc00/0x22c73c7857bb60b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60b2 expref: 16 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.099186:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762afc00, rc 0) 00000100:00100000:3.0:1783952194.099228:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465590144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.099235:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783952194.099264:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952194.099274:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb60b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.099282:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb60b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb60b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952194.099336:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.099360:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952194.099382:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.099443:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465590272 00000100:00100000:3.0:1783952194.099447:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465590272 00000100:00100000:3.0:1783952194.099477:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783952194.099484:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465590272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.099624:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465590272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.099630:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783952194.099701:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.099739:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.099778:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952194.099804:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1752cb600 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.099974:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465590400 00000100:00100000:3.0:1783952194.099978:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465590400 00000100:00100000:3.0:1783952194.100010:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783952194.100016:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465590400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.100144:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465590400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.100159:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783952194.100340:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783952194.101223:0:94500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783952194.101458:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783952194.101477:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783952194.101486:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb60b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.101497:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb60b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952194.101507:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783952194.101509:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b046482800 from 58 10000000:01000000:0.0:1783952194.101512:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783952194.101542:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.101550:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.101560:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952194.101581:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.101662:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952194.101698:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048d79000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.101825:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465590528 00000100:00100000:3.0:1783952194.101832:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465590528 00000100:00100000:3.0:1783952194.101874:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783952194.101883:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465590528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952194.101895:0:94411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952194.101907:0:94411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb60c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb60c0 expref: -99 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.101938:0:94411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb60c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb60c0 expref: 17 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.101949:0:94411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb60c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60c0 expref: 17 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.101958:0:94411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762ae200, rc 0) 00000100:00100000:3.0:1783952194.102004:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465590528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.102011:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783952194.102089:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952194.102101:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.102116:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952194.102175:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.102199:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952194.102225:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048d79000 going to sleep for 11 seconds 00000100:00100000:2.0:1783952194.102320:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465590656 00000100:00100000:2.0:1783952194.102325:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465590656 00000100:00100000:2.0:1783952194.102359:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783952194.102367:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f3b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465590656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.102483:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f3b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465590656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952194.102488:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783952194.102553:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.102582:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.102655:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.102673:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b145359c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783952194.102738:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465590784 00000100:00100000:0.0:1783952194.102742:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465590784 00000100:00100000:0.0:1783952194.102765:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783952194.102771:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465590784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.102841:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465590784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952194.102848:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783952194.102930:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783952194.103851:0:94501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1783952194.104007:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1783952194.104029:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783952194.104037:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.104046:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952194.104054:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783952194.104057:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1783952194.104059:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783952194.104086:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.104093:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.104100:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952194.104119:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.104173:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.104200:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:0.0:1783952194.104380:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465590912 00000100:00100000:0.0:1783952194.104386:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465590912 00000100:00100000:0.0:1783952194.104469:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783952194.104478:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465590912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952194.104491:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952194.104503:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb60d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb60ce expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.104523:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb60d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb60ce expref: 18 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.104533:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb60d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60ce expref: 18 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.104556:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d200, rc 0) 00000100:00100000:0.0:1783952194.104623:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465590912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952194.104629:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783952194.104736:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465590912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952194.104749:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.104758:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952194.104808:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.104834:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.108985:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.117180:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465591040 00000100:00100000:3.0:1783952194.117196:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465591040 00000100:00100000:3.0:1783952194.117282:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783952194.117293:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465591040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.117488:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465591040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (12653us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.117496:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783952194.117737:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.117789:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.117843:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.117869:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.117921:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465591168 00000100:00100000:3.0:1783952194.117925:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465591168 00000100:00100000:3.0:1783952194.117955:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783952194.117961:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465591168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.123080:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465591168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5110us (5227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.123095:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783952194.123211:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783952194.124065:0:94502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783952194.124261:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783952194.124286:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783952194.124304:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.124315:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952194.124324:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783952194.124327:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b046482800 from 7 10000000:01000000:3.0:1783952194.124330:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783952194.124365:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb60dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.124373:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb60dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.124382:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb60dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952194.124402:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.124448:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952194.124486:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b145331900 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.124536:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465591296 00000100:00100000:1.0:1783952194.124542:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465591296 00000100:00100000:1.0:1783952194.124625:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783952194.124634:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465591296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952194.124647:0:94411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952194.124661:0:94411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70200/0x22c73c7857bb60e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb60dc expref: -99 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.124685:0:94411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70200/0x22c73c7857bb60e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb60dc expref: 19 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.124706:0:94411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70200/0x22c73c7857bb60e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60dc expref: 19 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.124714:0:94411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70200, rc 0) 00000100:00100000:1.0:1783952194.124762:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465591296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.124768:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783952194.124807:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952194.124819:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb60dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.124827:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb60dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb60e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952194.124872:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.124897:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.124916:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6840 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.124929:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465591424 00000100:00100000:1.0:1783952194.124933:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465591424 00000100:00100000:1.0:1783952194.124955:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783952194.124962:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465591424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.125060:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465591424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.125066:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783952194.125093:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.125124:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.125157:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.125169:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6840 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.125180:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465591552 00000100:00100000:1.0:1783952194.125183:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465591552 00000100:00100000:1.0:1783952194.125201:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783952194.125206:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465591552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.125286:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465591552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.125292:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783952194.125328:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783952194.135542:0:94503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783952194.135816:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783952194.135846:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783952194.135858:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb60dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.135871:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb60dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952194.135881:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783952194.135884:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174849000 from 58 10000000:01000000:2.0:1783952194.135886:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783952194.135930:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.135938:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.135948:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952194.135976:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.136044:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952194.136112:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.138333:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465591680 00000100:00100000:1.0:1783952194.138348:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465591680 00000100:00100000:1.0:1783952194.138424:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783952194.138435:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465591680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952194.138451:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952194.138469:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70800/0x22c73c7857bb60f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb60ea expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.138496:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70800/0x22c73c7857bb60f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb60ea expref: 20 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.138507:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70800/0x22c73c7857bb60f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60ea expref: 20 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.138515:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70800, rc 0) 00000100:00100000:1.0:1783952194.138623:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465591680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.138631:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783952194.139312:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952194.139331:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952194.139340:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952194.139418:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.139456:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952194.139496:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147240600 going to sleep for 11 seconds 00000100:00100000:2.0:1783952194.139546:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465591808 00000100:00100000:2.0:1783952194.139553:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465591808 00000100:00100000:2.0:1783952194.139613:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783952194.139621:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465591808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.139735:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465591808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952194.139742:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783952194.139941:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.139972:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.140013:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952194.140040:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b147240600 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.140079:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465591936 00000100:00100000:1.0:1783952194.140084:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465591936 00000100:00100000:1.0:1783952194.140118:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783952194.140125:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465591936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.140225:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465591936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.140233:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783952194.140381:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465591936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.144886:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465592064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952194.144953:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952194.145015:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465592064 00000100:00100000:3.0:1783952194.145022:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465592064 00000100:00100000:3.0:1783952194.145071:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2235 00000100:00100000:3.0:1783952194.145081:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465592064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783952194.145113:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952194.145157:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465592064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.145177:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2235 00000100:00080000:3.0:1783952194.145198:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952194.145246:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465592064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952194.148507:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465592192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952194.148583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.148721:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465592192 00000100:00100000:1.0:1783952194.148729:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465592192 00000100:00100000:1.0:1783952194.148788:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236 00000100:00100000:1.0:1783952194.148799:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465592192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952194.148833:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952194.148877:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465592192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.148884:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236 00000100:00080000:3.0:1783952194.148935:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952194.148973:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465592192:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1783952194.150118:0:94504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1783952194.150301:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1783952194.150323:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783952194.150334:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.150345:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952194.150355:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783952194.150357:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1783952194.150360:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783952194.150396:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.150404:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.150413:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952194.150437:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.150510:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952194.150553:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b145331240 going to sleep for 11 seconds 00000100:00100000:2.0:1783952194.150634:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465592320 00000100:00100000:2.0:1783952194.150641:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465592320 00000100:00100000:2.0:1783952194.150681:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783952194.150689:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465592320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952194.150702:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952194.150715:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b175a14600/0x22c73c7857bb60ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb60f8 expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.150739:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b175a14600/0x22c73c7857bb60ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb60f8 expref: 21 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.150750:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b175a14600/0x22c73c7857bb60ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60f8 expref: 21 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.150758:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a14600, rc 0) 00000100:00100000:2.0:1783952194.150805:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465592320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952194.150812:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783952194.150961:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952194.150976:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.150984:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952194.151038:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.151064:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952194.151090:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b145331240 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.151138:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465592448 00000100:00100000:1.0:1783952194.151144:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465592448 00000100:00100000:1.0:1783952194.151176:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783952194.151183:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465592448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.151328:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465592448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.151336:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783952194.151401:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.151442:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.151483:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952194.151511:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b145331240 going to sleep for 11 seconds 00000100:00100000:1.0:1783952194.151555:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465592576 00000100:00100000:1.0:1783952194.151559:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465592576 00000100:00100000:1.0:1783952194.151627:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783952194.151634:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465592576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.152486:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465592576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 850us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952194.152495:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783952194.152617:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783952194.153682:0:94505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1783952194.153927:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1783952194.153951:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783952194.153961:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.153972:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952194.153981:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783952194.153984:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b174849000 from 7 10000000:01000000:1.0:1783952194.153986:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783952194.154019:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.154027:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.154038:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952194.154060:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.154111:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.154146:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.154233:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465592704 00000100:00100000:3.0:1783952194.154240:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465592704 00000100:00100000:3.0:1783952194.154294:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783952194.154302:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465592704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952194.154316:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952194.154328:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762af000/0x22c73c7857bb610d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6106 expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.154366:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762af000/0x22c73c7857bb610d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6106 expref: 22 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.154377:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762af000/0x22c73c7857bb610d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6106 expref: 22 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.154385:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af000, rc 0) 00000100:00100000:3.0:1783952194.154429:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465592704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.154437:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783952194.154762:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952194.154785:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.154795:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952194.154855:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.154881:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.154908:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:0.0:1783952194.155178:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465592832 00000100:00100000:0.0:1783952194.155184:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465592832 00000100:00100000:0.0:1783952194.155221:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783952194.155229:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465592832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.155369:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465592832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952194.155376:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783952194.155475:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.155506:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.155558:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.155576:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.155730:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465592960 00000100:00100000:3.0:1783952194.155734:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465592960 00000100:00100000:3.0:1783952194.155755:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783952194.155762:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175079450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465592960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952194.155844:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175079450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465592960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.155851:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783952194.156076:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465592960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783952194.156952:0:94506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783952194.157182:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783952194.157201:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783952194.157211:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.157222:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952194.157231:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1783952194.157233:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97b167c90000 from 1 10000000:01000000:1.0:1783952194.157235:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783952194.157280:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71800/0x22c73c7857bb6114 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.157301:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db71800/0x22c73c7857bb6114 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.157311:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db71800/0x22c73c7857bb6114 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952194.157332:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465593088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.157378:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.157412:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952194.157611:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465593088 00000100:00100000:2.0:1783952194.157617:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465593088 00000100:00100000:2.0:1783952194.158296:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783952194.158306:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175079850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465593088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952194.158321:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952194.158336:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b175a14a00/0x22c73c7857bb611b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6114 expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.158359:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b175a14a00/0x22c73c7857bb611b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6114 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.158369:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b175a14a00/0x22c73c7857bb611b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6114 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.158378:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a14a00, rc 0) 00000100:00100000:2.0:1783952194.158474:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175079850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465593088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952194.158481:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783952194.165791:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465593088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952194.165821:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db71800/0x22c73c7857bb6114 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb611b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.165835:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db71800/0x22c73c7857bb6114 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb611b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952194.165858:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1783952194.165864:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71800/0x22c73c7857bb6114 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb611b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.165871:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db71800/0x22c73c7857bb6114 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb611b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952194.165881:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783952194.165884:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97b167c90000 from 1 10000000:01000000:1.0:1783952194.165886:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783952194.165922:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.165948:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.165959:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952194.165979:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465593216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.166040:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.166084:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:3.0:1783952194.166132:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465593216 00000100:00100000:3.0:1783952194.166140:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465593216 00000100:00100000:3.0:1783952194.166200:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783952194.166210:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17507b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465593216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952194.166224:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952194.166238:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb6129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6122 expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.166269:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb6129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6122 expref: 24 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.166288:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb6129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6122 expref: 24 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.166300:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762aee00, rc 0) 00000100:00100000:3.0:1783952194.166359:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17507b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465593216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.166367:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783952194.166743:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465593216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952194.166755:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.166763:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952194.166822:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465593344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952194.166850:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952194.166911:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952194.170420:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465593344 00000100:00100000:2.0:1783952194.170435:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465593344 00000100:00100000:2.0:1783952194.170551:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783952194.170562:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b143746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465593344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952194.170729:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b143746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465593344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (3877us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783952194.170736:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783952194.170829:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465593344:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783952194.170876:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783952194.170885:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952194.170897:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952194.928523:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952194.928659:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447780864 00000100:00100000:3.0:1783952194.928669:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447780864 00000100:00100000:3.0:1783952194.928725:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:3.0:1783952194.928736:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+5:70975:x1870605447780864:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952194.928754:0:94411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952194.928773:0:94411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4f8 expref: -99 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.928799:0:94411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f8 expref: 6 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.928811:0:94411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f8 expref: 6 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.928820:0:94411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af400, rc 0) 00000100:00100000:3.0:1783952194.928874:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+6:70975:x1870605447780864:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 140us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.928881:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 62 00000100:00100000:0.0:1783952194.943830:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952194.943929:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447780992 00000100:00100000:3.0:1783952194.943940:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447780992 00000100:00100000:3.0:1783952194.944022:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:3.0:1783952194.944033:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+6:70975:x1870605447780992:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783952194.944059:0:94415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1783952194.944077:0:94415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783952194.944081:0:94415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783952194.944084:0:94415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783952194.944087:0:94415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783952194.944090:0:94415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:2.0:1783952194.953661:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+6:70975:x1870605447780992:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 Request processed in 9618us (9829us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952194.953677:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 63 00000100:00100000:3.0:1783952194.957220:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952194.957267:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447781120 00000100:00100000:3.0:1783952194.957276:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447781120 00000100:00100000:3.0:1783952194.957326:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:3.0:1783952194.957335:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+6:70975:x1870605447781120:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952194.957353:0:94411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952194.957372:0:94411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb6137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a4ff expref: -99 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.957404:0:94411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb6137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ff expref: 7 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.957415:0:94411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb6137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ff expref: 7 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952194.957425:0:94411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762ae800, rc 0) 00000100:00100000:3.0:1783952194.957484:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+7:70975:x1870605447781120:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 149us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952194.957491:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 64 00000100:00100000:2.0:1783952194.965285:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952194.967472:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447781248 00000100:00100000:0.0:1783952194.967489:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447781248 00000100:00100000:0.0:1783952194.967654:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:0.0:1783952194.967666:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+7:70975:x1870605447781248:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.967839:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447781248:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 175us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952194.967848:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 65 00000100:00100000:2.0:1783952194.974538:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952194.977131:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447781376 00000100:00100000:0.0:1783952194.977144:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447781376 00000100:00100000:0.0:1783952194.977201:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:0.0:1783952194.977210:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447781376:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.977357:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447781376:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 147us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952194.977365:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 66 00000100:00100000:1.0:1783952194.985003:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952194.986450:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447781504 00000100:00100000:2.0:1783952194.986464:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447781504 00000100:00100000:2.0:1783952194.986579:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:2.0:1783952194.986604:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447781504:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952194.986622:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952194.986641:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb613e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a506 expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.986671:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb613e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a506 expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.986683:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb613e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a506 expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952194.986693:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b175a14c00, rc 0) 00000100:00100000:2.0:1783952194.986754:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447781504:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 165us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952194.986760:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 67 00000100:00100000:0.0:1783952194.988523:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952194.988610:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447781632 00000100:00100000:1.0:1783952194.988618:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447781632 00000100:00100000:1.0:1783952194.988667:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:1.0:1783952194.988677:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447781632:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.989262:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447781632:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 585us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952194.989271:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 68 00000100:00100000:1.0:1783952194.991460:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952194.991552:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447781760 00000100:00100000:0.0:1783952194.991562:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447781760 00000100:00100000:0.0:1783952194.991658:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:0.0:1783952194.991668:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447781760:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952194.991806:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447781760:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952194.991814:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 69 00000100:00100000:2.0:1783952194.999519:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952195.000144:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447781888 00000100:00100000:0.0:1783952195.000207:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447781888 00000100:00100000:0.0:1783952195.000313:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:0.0:1783952195.000324:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447781888:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952195.000354:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952195.000372:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb6145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a50d expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952195.000404:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb6145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a50d expref: 10 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952195.000416:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb6145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a50d expref: 10 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952195.000426:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d600, rc 0) 00000100:00100000:0.0:1783952195.000486:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447781888:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 164us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952195.000493:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 70 00000100:00100000:2.0:1783952195.004130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952195.004299:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447782016 00000100:00100000:1.0:1783952195.004309:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447782016 00000100:00100000:1.0:1783952195.004465:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 71 00000100:00100000:1.0:1783952195.004476:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447782016:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952195.004613:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447782016:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 139us (492us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783952195.004621:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 71 00010000:00010000:3.0:1783952195.108789:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952196.132026:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952197.152718:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783952197.603270:0:94689:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1783952197.728765:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952197.728772:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952197.728776:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952197.728784:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3907 00000100:00080000:1.0:1783952197.728788:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952197.728795:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b1746ca800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952197.728818:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16e9b7100 x1870605465593600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952197.728853:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952197.728865:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952197.728867:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952197.728871:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3907 00000100:00080000:1.0:1783952197.728873:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952197.728877:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97b046b43800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952197.728890:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14dee1880 x1870605465593856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952197.728910:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952197.728912:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952197.728914:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783952197.731508:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465593472:0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.731607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952197.731674:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465593728:0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.731701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952197.731722:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783952197.731727:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465593984:0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.731745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952197.731771:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465593472 00000100:00100000:3.0:1783952197.731778:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465593472 00000100:00100000:3.0:1783952197.731819:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783952197.731827:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465593472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.731882:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465593472:12345-0@lo:400:kworker.0 Request processed in 55us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.731889:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783952197.731934:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465593728 00000100:00100000:3.0:1783952197.731938:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465593728 00000100:00100000:3.0:1783952197.731970:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465593984 00000100:00100000:3.0:1783952197.731973:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465593984 00000100:00100000:3.0:1783952197.731992:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1783952197.731998:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465593728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.732034:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465593728:12345-0@lo:400:kworker.0 Request processed in 36us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.732040:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1783952197.732051:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1783952197.732057:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465593984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.732096:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465593984:12345-0@lo:400:kworker.0 Request processed in 40us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.732103:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00080000:3.0:1783952197.732124:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952197.732160:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465593984:0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.732168:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465593728:0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.732194:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465593472:0@lo:400:kworker.0 00000100:00100000:2.0:1783952197.740772:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465593600:0@lo:38:kworker.0 00000100:00100000:2.0:1783952197.740844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952197.740887:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465593856:0@lo:38:kworker.0 00000100:00100000:2.0:1783952197.740911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952197.741012:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952197.741027:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465594112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952197.741063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952197.741101:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465594112 00000100:00100000:3.0:1783952197.741108:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465594112 00000100:00100000:3.0:1783952197.741154:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:3.0:1783952197.741162:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465594112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952197.741197:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:3.0:1783952197.741250:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465594112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.741258:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:3.0:1783952197.743118:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465593600 00000100:00100000:3.0:1783952197.743131:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465593600 00000100:00100000:3.0:1783952197.743160:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465593856 00000100:00100000:3.0:1783952197.743163:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465593856 00000100:00100000:3.0:1783952197.743184:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1783952197.743191:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465593600:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783952197.743230:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3912 last 0 00000020:00000080:3.0:1783952197.743279:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x22c73c7857bb614c 00000004:00100000:3.0:1783952197.743296:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783952197.744169:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b0497f1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952197.744268:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870605465593600:12345-0@lo:38:kworker.0 Request processed in 1076us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.744278:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1783952197.744305:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1783952197.744311:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465593856:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783952197.744343:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3912 last 0 00000020:00000080:3.0:1783952197.744370:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x22c73c7857bb6153 00000004:00100000:3.0:1783952197.744381:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783952197.744732:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b0497f1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952197.744769:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870605465593856:12345-0@lo:38:kworker.0 Request processed in 457us (3857us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.744776:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1783952197.744832:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465594112:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1783952197.745196:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b16e9b7100 x1870605465593600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.745233:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00080000:2.0:1783952197.746504:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff97b16e9b7100 x1870605465593600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952222 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.746514:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783952197.746520:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783952197.746524:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783952197.746529:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465593600:0@lo:38:kworker.0 00010000:00080000:2.0:1783952197.746553:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b14dee1880 x1870605465593856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.746565:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 29 00000100:00080000:2.0:1783952197.749210:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff97b14dee1880 x1870605465593856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952222 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.749235:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783952197.749240:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b046b43800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783952197.749244:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783952197.749250:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1870605465593856:0@lo:38:kworker.0 00000100:00080000:1.0:1783952197.750646:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3907 00000100:00080000:1.0:1783952197.750652:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952197.750660:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97b048caf800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952197.750734:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14dee1c00 x1870605465594240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952197.750816:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952197.750820:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952197.750823:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952197.750827:0:40998:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3907 00000100:00080000:1.0:1783952197.750829:0:40998:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783952197.750833:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97b0410da800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952197.750845:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14dee2680 x1870605465594624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783952197.750866:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783952197.750882:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783952197.750884:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b176be7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952197.750890:0:40998:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97b176be7000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952197.750902:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047acf480 x1870605465595008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952197.752482:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465594240:0@lo:38:kworker.0 00000100:00100000:2.0:1783952197.752556:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952197.752621:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465594624:0@lo:38:kworker.0 00000100:00100000:2.0:1783952197.752649:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952197.752670:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465595008:0@lo:38:kworker.0 00000100:00100000:2.0:1783952197.752697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952197.753252:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465594880:0@lo:400:kworker.0 00000100:00100000:0.0:1783952197.753292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952197.753329:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952197.753337:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465594368:0@lo:400:kworker.0 00000100:00100000:0.0:1783952197.753359:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952197.753570:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465594880 00000100:00100000:0.0:1783952197.753610:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465594880 00000100:00100000:0.0:1783952197.753663:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465594368 00000100:00100000:0.0:1783952197.753667:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465594368 00000100:00100000:0.0:1783952197.753692:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:0.0:1783952197.753700:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465594880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952197.753750:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465594880:12345-0@lo:400:kworker.0 Request processed in 51us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952197.753757:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00100000:0.0:1783952197.753770:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:0.0:1783952197.753776:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465594368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952197.753802:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465594368:12345-0@lo:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952197.753807:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00080000:0.0:1783952197.753827:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952197.753831:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952197.753855:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465594368:0@lo:400:kworker.0 00000100:00100000:0.0:1783952197.753866:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465594880:0@lo:400:kworker.0 00000100:00100000:1.0:1783952197.754071:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465594240 00000100:00100000:1.0:1783952197.754076:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465594240 00000100:00100000:1.0:1783952197.754111:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:1.0:1783952197.754116:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3641:x1870605465594240:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783952197.754141:0:26467:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff97b1445c5000, cookie 0x22c73c7857bb5faf 00010000:00080000:1.0:1783952197.754147:0:26467:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t120259084299 exp ffff97b1445c5000 cur 3912 last 1783952192 00000004:00100000:1.0:1783952197.754163:0:26467:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783952197.754192:0:26467:0:(import.c:65:import_set_state_nolock()) ffff97b14de85000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783952197.754254:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465594240:12345-0@lo:38:kworker.0 Request processed in 137us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952197.754261:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00010000:00080000:1.0:1783952197.754285:0:94438:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783952197.754291:0:94438:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 120259084297 00000020:00080000:1.0:1783952197.754296:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783952197.754299:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084297, next_transno: 120259084297 00010000:00080000:1.0:1783952197.754303:0:94438:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (120259084297) 00000020:00080000:1.0:1783952197.754306:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783952197.754328:0:94438:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447772032 t120259084297 from 192.168.202.48@tcp req@ffff97b164e3df80 x1870605447772032/t0(120259084297) o36->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:454/0 lens 528/0 e 0 to 0 dl 1783952204 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783952197.754927:0:94438:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 550us 00000100:00080000:2.0:1783952197.758214:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 29 00000100:00080000:2.0:1783952197.758244:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1783952197.758251:0:3641:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1783952197.758254:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:2.0:1783952197.758265:0:3641:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff97b049ded880 x1870605465572224/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783952177 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.758274:0:3641:0:(recover.c:53:ptlrpc_replay_next()) import ffff97b048caf800 from lustre-MDT0000_UUID committed 120259084296 last 0 00000100:00080000:2.0:1783952197.758280:0:3641:0:(client.c:3553:ptlrpc_replay_req()) @@@ REPLAY req@ffff97b049ded880 x1870605465572224/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783952177 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952197.758292:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465594240:0@lo:38:kworker.0 00000100:00100000:2.0:1783952197.758334:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465572224:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783952197.758393:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952197.760701:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465572224 00000100:00100000:0.0:1783952197.760714:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465572224 00000100:00100000:0.0:1783952197.760781:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:0.0:1783952197.760790:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465572224:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1783952197.760810:0:8444:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 120259084297, current: 120259084299, replaying 00000100:00100000:0.0:1783952197.760817:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870605465572224:12345-0@lo:1000:osp_up0-1.0 Request processed in 29us (2424us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783952197.760823:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:3.0:1783952197.762488:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465594624 00000100:00100000:3.0:1783952197.762501:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465594624 00000100:00100000:3.0:1783952197.762542:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465595008 00000100:00100000:3.0:1783952197.762546:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465595008 00000100:00100000:3.0:1783952197.762571:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:3.0:1783952197.762616:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465594624:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783952197.762650:0:67035:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3912 last 0 00000020:00000080:3.0:1783952197.762691:0:67035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x22c73c7857bb615a 00000004:00100000:3.0:1783952197.762708:0:67035:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783952197.762740:0:67035:0:(import.c:65:import_set_state_nolock()) ffff97b0497f4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952197.762836:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870605465594624:12345-0@lo:38:kworker.0 Request processed in 247us (10185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.762843:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:3.0:1783952197.762862:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1783952197.762866:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465595008:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783952197.762880:0:67035:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3912 last 0 00000020:00000080:3.0:1783952197.762902:0:67035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x22c73c7857bb6161 00000004:00100000:3.0:1783952197.762910:0:67035:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783952197.762937:0:67035:0:(import.c:65:import_set_state_nolock()) ffff97b046ae4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952197.762970:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870605465595008:12345-0@lo:38:kworker.0 Request processed in 102us (10272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.762976:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1783952197.763023:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465594752:0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.763061:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952197.763089:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952197.763095:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465594496:0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.763117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952197.763146:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465594752 00000100:00100000:3.0:1783952197.763151:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465594752 00000100:00100000:3.0:1783952197.763183:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465594496 00000100:00100000:3.0:1783952197.763185:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465594496 00000100:00100000:3.0:1783952197.763206:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:3.0:1783952197.763211:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465594752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.763264:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465594752:12345-0@lo:400:kworker.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.763271:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:3.0:1783952197.763283:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:3.0:1783952197.763297:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465594496:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1783952197.763881:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b14dee2680 x1870605465594624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.763899:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 29 00000100:00080000:2.0:1783952197.765030:0:3641:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff97b14dee2680 x1870605465594624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952222 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.765042:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1783952197.765047:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0410da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783952197.765051:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783952197.765056:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870605465594624:0@lo:38:kworker.0 00010000:00080000:2.0:1783952197.765081:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b047acf480 x1870605465595008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.765093:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 29 00000100:00080000:2.0:1783952197.765115:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783952197.765119:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783952197.765122:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b176be7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783952197.765126:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870605465595008:0@lo:38:kworker.0 00000100:00080000:0.0:1783952197.765550:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952197.765555:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952197.767697:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465594496:12345-0@lo:400:kworker.0 Request processed in 4390us (4567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.767713:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00100000:3.0:1783952197.767797:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465594496:0@lo:400:kworker.0 00000100:00100000:3.0:1783952197.767812:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465594752:0@lo:400:kworker.0 00010000:00010000:3.0:1783952197.800391:0:94438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb6168 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.800542:0:94438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb6168 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.800559:0:94438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb6168 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.800605:0:94438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.800613:0:94438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.800619:0:94438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.801569:0:94438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb6168 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.802010:0:94438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb6168 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.802029:0:94438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb6168 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.802034:0:94438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952197.802038:0:94438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb6168 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.802047:0:94438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb6168 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.802063:0:94438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b176e44800) 00010000:00010000:3.0:1783952197.802066:0:94438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952197.802070:0:94438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb6168 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.802075:0:94438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb6168 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952197.802095:0:94438:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b56f264f reply state 00000000e9928426 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.802106:0:94438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.802112:0:94438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b14396e800) 00010000:00010000:3.0:1783952197.802115:0:94438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952197.802117:0:94438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783952197.803300:0:94438:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1783952197.807033:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.807041:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084298 00000020:00080000:3.0:1783952197.807058:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.807060:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084298 00000100:00100000:3.0:1783952197.812799:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952197.812847:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447772544 00000100:00100000:3.0:1783952197.812856:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447772544 00000100:00100000:3.0:1783952197.812908:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1438 00000100:00100000:3.0:1783952197.812923:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2397:x1870605447772544:12345-192.168.202.48@tcp:36:rm.0 00010000:00080000:3.0:1783952197.812943:0:66237:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 120259084298, current: 120259084298, replaying 00000100:00100000:3.0:1783952197.812955:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2397:x1870605447772544:12345-192.168.202.48@tcp:36:rm.0 Request processed in 39us (166us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952197.812961:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1438 00000020:00080000:3.0:1783952197.812978:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.812981:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 120259084298, next_transno: 120259084298 00010000:00080000:3.0:1783952197.812986:0:94438:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (120259084298) 00000020:00080000:3.0:1783952197.812989:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.812997:0:94438:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447772544 t120259084298 from 192.168.202.48@tcp req@ffff97b1762f3100 x1870605447772544/t0(120259084298) o36->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:458/0 lens 512/0 e 0 to 0 dl 1783952208 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783952197.813076:0:94438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb6176 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.813091:0:94438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb6176 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.813103:0:94438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb6176 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.813113:0:94438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.813133:0:94438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.813140:0:94438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.813236:0:94438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6184 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.813245:0:94438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6184 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.813251:0:94438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6184 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783952197.815130:0:94405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084297 is committed 00010000:00010000:1.0:1783952197.815278:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.815288:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.815296:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.815302:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952197.815306:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.815313:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.816497:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b14396e800) 00010000:00010000:1.0:1783952197.816501:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952197.816506:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.816512:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb616f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816737:0:94438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6184 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816746:0:94438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6184 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816752:0:94438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6184 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816757:0:94438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952197.816761:0:94438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6184 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816768:0:94438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6184 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816776:0:94438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff97b14396e200) 00010000:00010000:3.0:1783952197.816790:0:94438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783952197.816794:0:94438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6184 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816799:0:94438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6184 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816824:0:94438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb6176 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816840:0:94438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb6176 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816845:0:94438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb6176 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816851:0:94438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952197.816853:0:94438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb6176 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816859:0:94438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb6176 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816867:0:94438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:3.0:1783952197.816869:0:94438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952197.816871:0:94438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb6176 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816876:0:94438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb6176 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952197.816898:0:94438:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e65aa1b reply state 00000000974e3512 transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816934:0:94438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.816941:0:94438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b14396e800) 00010000:00010000:3.0:1783952197.816943:0:94438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952197.816946:0:94438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783952197.817037:0:94438:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783952197.817067:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.817070:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084299 00010000:00080000:3.0:1783952197.817075:0:94438:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (120259084299) 00000020:00080000:3.0:1783952197.817077:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.817087:0:94438:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605465572224 t120259084299 from 0@lo req@ffff97b146f00000 x1870605465572224/t0(120259084299) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:458/0 lens 488/0 e 0 to 0 dl 1783952208 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783952197.834276:0:94438:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000100:00080000:2.0:1783952197.834421:0:3641:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ got reply req@ffff97b049ded880 x1870605465572224/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783952213 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.834433:0:3641:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1783952197.834435:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:2.0:1783952197.834440:0:3641:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff97b049ded880 x1870605465572224/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783952213 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.834446:0:3641:0:(recover.c:53:ptlrpc_replay_next()) import ffff97b048caf800 from lustre-MDT0000_UUID committed 120259084296 last 120259084299 00000100:00080000:2.0:1783952197.834453:0:3641:0:(client.c:3553:ptlrpc_replay_req()) @@@ REPLAY req@ffff97b049deea00 x1870605465572480/t120259084300(120259084300) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783952177 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952197.834464:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465572224:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783952197.834483:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465572480:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783952197.834525:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1783952197.834618:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783952197.834622:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000020:00080000:2.0:1783952197.834627:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783952197.834629:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000100:00100000:3.0:1783952197.834814:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465572480 00000100:00100000:3.0:1783952197.834821:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465572480 00000100:00100000:3.0:1783952197.834861:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:3.0:1783952197.834869:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870605465572480:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:3.0:1783952197.834887:0:26467:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 120259084300, current: 120259084300, replaying 00000100:00100000:3.0:1783952197.834899:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870605465572480:12345-0@lo:1000:osp_up0-1.0 Request processed in 31us (374us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952197.834906:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00000100:00100000:0.0:1783952197.835044:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952197.835071:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447782144 00000100:00100000:0.0:1783952197.835075:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447782144 00000100:00100000:0.0:1783952197.835105:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1402 00000100:00100000:0.0:1783952197.835113:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2397:x1870605447782144:12345-192.168.202.48@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1783952197.835126:0:67035:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b164e3c380 x1870605447782144/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:458/0 lens 224/0 e 0 to 0 dl 1783952208 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952197.835136:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2397:x1870605447782144:12345-192.168.202.48@tcp:400:ldlm_lock_repla.0 Request processed in 26us (95us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783952197.835142:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1402 00000020:00080000:3.0:1783952197.836193:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.836200:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 120259084300, next_transno: 120259084300 00010000:00080000:3.0:1783952197.836204:0:94438:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (120259084300) 00000020:00080000:3.0:1783952197.836207:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.836254:0:94438:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605465572480 t120259084300 from 0@lo req@ffff97b146f01180 x1870605465572480/t0(120259084300) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:458/0 lens 488/0 e 0 to 0 dl 1783952208 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783952197.837443:0:94438:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783952197.837475:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.837478:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000020:00080000:3.0:1783952197.837481:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.837483:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000100:00080000:0.0:1783952197.847799:0:3641:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ got reply req@ffff97b049deea00 x1870605465572480/t120259084300(120259084300) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783952213 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952197.847811:0:3641:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783952197.847814:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:0.0:1783952197.847819:0:3641:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff97b049ded880 x1870605465572224/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783952213 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952197.847827:0:3641:0:(recover.c:53:ptlrpc_replay_next()) import ffff97b048caf800 from lustre-MDT0000_UUID committed 120259084296 last 120259084300 00000100:00080000:0.0:1783952197.847832:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1783952197.852350:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465572480:0@lo:1000:osp_up0-1.0 00010000:00080000:1.0:1783952197.852379:0:94699:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1783952197.852383:0:94699:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1783952197.852389:0:94699:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:1.0:1783952197.852874:0:94699:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86b000/0x22c73c7857bb58a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb58af expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952197.852937:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465595136:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1783952197.853008:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783952197.853051:0:94699:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:3.0:1783952197.854756:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465595136 00000100:00100000:3.0:1783952197.854768:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465595136 00000100:00100000:3.0:1783952197.854816:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:3.0:1783952197.854825:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3641:x1870605465595136:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:3.0:1783952197.854850:0:23862:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b047acdf80 x1870605465595136/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:458/0 lens 328/0 e 0 to 0 dl 1783952208 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952197.854865:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3641:x1870605465595136:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 43us (1859us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952197.854871:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000020:00080000:3.0:1783952197.854890:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.854894:0:94438:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 120259084301 00010000:00080000:3.0:1783952197.854898:0:94438:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1783952197.854900:0:94438:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783952197.854906:0:94438:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783952197.854909:0:94438:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783952197.855066:0:94438:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff97b047acdf80 x1870605465595136/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:458/0 lens 328/0 e 0 to 0 dl 1783952208 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783952197.855083:0:94438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952197.855110:0:94438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb618b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb58a8 expref: -99 pid: 94438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.855152:0:94438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb618b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb58a8 expref: 9 pid: 94438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.855166:0:94438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a800/0x22c73c7857bb618b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb58a8 expref: 9 pid: 94438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.855174:0:94438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a800, rc 0) 00010000:00080000:3.0:1783952197.855252:0:94438:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1783952197.855271:0:94438:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00010000:2.0:1783952197.856737:0:3641:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff97b14d86b000/0x22c73c7857bb58a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb618b expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783952197.856752:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1783952197.856782:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465595136:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1783952197.856818:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465595264:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1783952197.856866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952197.857009:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465595264 00000100:00100000:0.0:1783952197.857016:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465595264 00000100:00100000:0.0:1783952197.857058:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:0.0:1783952197.857065:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3641:x1870605465595264:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1783952197.857081:0:26467:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b146f01500 x1870605465595264/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:458/0 lens 224/0 e 0 to 0 dl 1783952208 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952197.857106:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3641:x1870605465595264:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 42us (240us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783952197.857112:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00010000:00080000:0.0:1783952197.857130:0:94438:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1783952197.857248:0:94438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051584 00000001:00100000:0.0:1783952197.858510:0:94405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1783952197.858518:0:94405:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000001:00080000:0.0:1783952197.858525:0:94405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00000001:00080000:0.0:1783952197.858555:0:94405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00000001:00080000:0.0:1783952197.859837:0:94438:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1783952197.859884:0:94438:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1783952197.859901:0:94438:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.48@tcp: req@ffff97b164e3c380 x1870605447782144/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:458/0 lens 224/0 e 0 to 0 dl 1783952208 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783952197.860052:0:94438:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff97b146f01500 x1870605465595264/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:458/0 lens 224/0 e 0 to 0 dl 1783952208 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1783952197.860110:0:94438:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:2.0:1783952197.860524:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.860536:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.860543:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.860550:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86aa00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952197.860554:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.860563:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.860610:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b14396e800) 00010000:00010000:2.0:1783952197.860614:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952197.860619:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.860625:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb617d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952197.860680:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084300 gen 3 00000004:00080000:2.0:1783952197.860686:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084299 committed transno 120259084300 00000004:00080000:2.0:1783952197.860703:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084300 committed transno 120259084300 00000100:00080000:2.0:1783952197.860715:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1783952197.860732:0:3641:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff97b146f03800 x1870605465595264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952213 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.860741:0:3641:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff97b146f03800 x1870605465595264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952213 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952197.860748:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b048caf800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1783952197.860761:0:3641:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1783952197.860767:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000963e4a97): req@ffff97b049ee3480 x1870605465574528/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952182 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952197.860781:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465595264:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1783952197.867521:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465595392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952197.867612:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952197.867808:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465595392 00000100:00100000:3.0:1783952197.867816:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465595392 00000100:00100000:3.0:1783952197.867896:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:3.0:1783952197.867906:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465595392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783952197.867944:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445187584 avail 1298948096 00000100:00100000:3.0:1783952197.867995:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465595392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.868003:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000100:00100000:1.0:1783952197.871520:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952197.882739:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465574528 00000100:00100000:2.0:1783952197.882755:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465574528 00000100:00100000:2.0:1783952197.882849:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:2.0:1783952197.882861:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465574528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952197.882904:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445187584 avail 1298948096 00000100:00100000:2.0:1783952197.882993:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465574528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (11480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952197.883001:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00100000:2.0:1783952197.883063:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465595392:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1783952197.896276:0:94438:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa80a4806be10 00100000:10000000:0.0:1783952197.896290:0:94438:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:1.0:1783952197.899375:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465574528:0@lo:41:osp-pre-0-1.0 00000004:00080000:0.0:1783952197.900354:0:94423:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x723:0x0] 00000100:00100000:0.0:1783952197.900396:0:94423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94423:1870605465595520:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783952197.900456:0:94423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952197.900486:0:94423:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b152405000 going to sleep for 11 seconds 00000100:00100000:0.0:1783952197.900504:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465595520 00000100:00100000:0.0:1783952197.900510:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465595520 00000004:00080000:2.0:1783952197.900575:0:94425:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x722:0x0] 00000100:00100000:2.0:1783952197.900619:0:94425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f01880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94425:1870605465595648:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783952197.900649:0:94425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952197.903966:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4960 00000100:00100000:0.0:1783952197.903988:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:94423:x1870605465595520:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783952197.904034:0:26199:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1921 -> diff = -94 00002000:02000040:0.0:1783952197.904038:0:26199:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1828 to 0x280000401:1921) 00000100:00100000:2.0:1783952197.909429:0:94425:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1460ac9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952197.909481:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465595648 00000100:00100000:2.0:1783952197.909490:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465595648 00000100:00100000:2.0:1783952197.909537:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4961 00000100:00100000:2.0:1783952197.909545:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:94425:x1870605465595648:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783952197.909580:0:26201:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1921 -> diff = -95 00002000:02000040:2.0:1783952197.909600:0:26201:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1827 to 0x2c0000401:1921) 00002000:00010000:0.0:1783952197.918140:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.918154:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb6192 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.918171:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x781:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.918176:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.918182:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb6192 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.918196:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb6192 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.918205:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb6192 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.918212:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb6192 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.919162:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783952197.919582:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x780:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.919615:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c63bc3/0x22c73c7857bb6199 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.919628:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x780:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.919641:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.919646:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c63bc3/0x22c73c7857bb6199 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.919657:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5c63bc3/0x22c73c7857bb6199 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.919666:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c63bc3/0x22c73c7857bb6199 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.919673:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c63bc3/0x22c73c7857bb6199 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.925750:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783952197.925764:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb6192 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.925777:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2ca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952197.925782:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb6192 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.925793:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb6192 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.925815:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb6192 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.925835:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040d72fe6/0x22c73c7857bb6192 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.925861:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952197.925865:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5c63bc3/0x22c73c7857bb6199 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.925895:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2c600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952197.925900:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c63bc3/0x22c73c7857bb6199 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.925908:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c63bc3/0x22c73c7857bb6199 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.925924:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5c63bc3/0x22c73c7857bb6199 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.925933:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952197.925935:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952197.925937:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783952197.931979:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783952197.933955:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783952197.933968:0:26199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5c63bc3/0x22c73c7857bb6199 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952197.934396:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.934403:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb61a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934416:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77f:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.934421:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.934427:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb61a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934441:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb61a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934458:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb61a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934466:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb61a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934483:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.934494:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.934499:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb61a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934507:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2de00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.934511:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb61a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934521:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb61a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934537:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb61a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934545:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040f428de/0x22c73c7857bb61a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934558:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.934566:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.934568:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.934634:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.934640:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb61a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934647:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77e:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.934650:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.934654:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb61a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934662:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb61a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934669:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb61a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934675:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb61a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934688:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.934695:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.934699:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb61a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934705:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2da00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.934709:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb61a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934728:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb61a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934738:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb61a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934744:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a93dd655/0x22c73c7857bb61a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.934758:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.934760:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.934761:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.934807:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.934812:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfbe7a7f/0x22c73c7857bb61ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.934933:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.937759:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77d:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.937773:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.937783:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfbe7a7f/0x22c73c7857bb61ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.937804:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfbe7a7f/0x22c73c7857bb61ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.937815:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfbe7a7f/0x22c73c7857bb61ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.937849:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfbe7a7f/0x22c73c7857bb61ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.937875:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783952197.938003:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.938009:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000844d642c/0x22c73c7857bb61b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938018:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77c:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.938021:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.938025:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000844d642c/0x22c73c7857bb61b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938033:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000844d642c/0x22c73c7857bb61b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938040:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000844d642c/0x22c73c7857bb61b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938046:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000844d642c/0x22c73c7857bb61b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938062:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783952197.938071:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952197.938077:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfbe7a7f/0x22c73c7857bb61ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938090:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2c200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.938095:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfbe7a7f/0x22c73c7857bb61ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938104:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfbe7a7f/0x22c73c7857bb61ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938123:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfbe7a7f/0x22c73c7857bb61ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938130:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfbe7a7f/0x22c73c7857bb61ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938151:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.938155:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000844d642c/0x22c73c7857bb61b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938162:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.938165:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000844d642c/0x22c73c7857bb61b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938173:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000844d642c/0x22c73c7857bb61b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938183:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000844d642c/0x22c73c7857bb61b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938196:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000844d642c/0x22c73c7857bb61b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938211:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.938212:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.938228:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.938276:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.938282:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000086ed93a/0x22c73c7857bb61bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938290:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77b:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.938293:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.938298:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000086ed93a/0x22c73c7857bb61bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938307:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000086ed93a/0x22c73c7857bb61bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938315:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000086ed93a/0x22c73c7857bb61bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938322:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000086ed93a/0x22c73c7857bb61bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938335:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.938349:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.938354:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000086ed93a/0x22c73c7857bb61bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938362:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.938365:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000086ed93a/0x22c73c7857bb61bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938373:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000086ed93a/0x22c73c7857bb61bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938385:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000086ed93a/0x22c73c7857bb61bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938392:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000086ed93a/0x22c73c7857bb61bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938406:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.938407:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.938409:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.938450:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.938456:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6001a4a/0x22c73c7857bb61c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938464:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77a:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.938467:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.938471:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6001a4a/0x22c73c7857bb61c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938490:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6001a4a/0x22c73c7857bb61c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938498:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6001a4a/0x22c73c7857bb61c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938505:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6001a4a/0x22c73c7857bb61c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938520:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.938529:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.938533:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6001a4a/0x22c73c7857bb61c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938539:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.938542:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6001a4a/0x22c73c7857bb61c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938550:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6001a4a/0x22c73c7857bb61c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938560:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6001a4a/0x22c73c7857bb61c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938567:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6001a4a/0x22c73c7857bb61c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938608:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.938610:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.938612:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.938654:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x779:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.938660:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb61ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938668:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x779:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.938671:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x779:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.938676:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb61ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938685:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb61ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938693:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb61ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938700:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb61ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938713:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.938720:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.938724:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb61ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938743:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.938746:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb61ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938755:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb61ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938767:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb61ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938775:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000dec5cc/0x22c73c7857bb61ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938789:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.938790:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.938792:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.938838:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.938843:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b65e547/0x22c73c7857bb61d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938852:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x778:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.938855:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.938859:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b65e547/0x22c73c7857bb61d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938869:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b65e547/0x22c73c7857bb61d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938883:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b65e547/0x22c73c7857bb61d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938890:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b65e547/0x22c73c7857bb61d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938901:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.938909:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.938913:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b65e547/0x22c73c7857bb61d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938920:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.938923:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b65e547/0x22c73c7857bb61d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938931:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b65e547/0x22c73c7857bb61d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938942:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b65e547/0x22c73c7857bb61d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938949:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b65e547/0x22c73c7857bb61d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.938963:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.938970:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.938972:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.939014:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.939019:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb23d7c/0x22c73c7857bb61d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.939028:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x777:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.939031:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.939035:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb23d7c/0x22c73c7857bb61d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.939045:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbb23d7c/0x22c73c7857bb61d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.939053:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbb23d7c/0x22c73c7857bb61d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.939059:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb23d7c/0x22c73c7857bb61d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.939071:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.939077:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.939080:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbb23d7c/0x22c73c7857bb61d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.939088:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.939091:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb23d7c/0x22c73c7857bb61d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.939111:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbb23d7c/0x22c73c7857bb61d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.939122:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbb23d7c/0x22c73c7857bb61d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.939130:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbb23d7c/0x22c73c7857bb61d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.939144:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.939146:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.939148:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783952197.942230:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952197.942246:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004255bf8e/0x22c73c7857bb61df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942262:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x781:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1783952197.942266:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952197.942271:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004255bf8e/0x22c73c7857bb61df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942287:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004255bf8e/0x22c73c7857bb61df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942298:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004255bf8e/0x22c73c7857bb61df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942307:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004255bf8e/0x22c73c7857bb61df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942333:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783952197.942435:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x780:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952197.942440:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028f95620/0x22c73c7857bb61e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942461:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x780:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1783952197.942464:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952197.942468:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028f95620/0x22c73c7857bb61e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942477:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028f95620/0x22c73c7857bb61e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942485:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028f95620/0x22c73c7857bb61e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942492:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028f95620/0x22c73c7857bb61e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942505:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783952197.942548:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952197.942554:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9463a8b/0x22c73c7857bb61ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942562:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77f:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1783952197.942565:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952197.942569:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9463a8b/0x22c73c7857bb61ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942578:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9463a8b/0x22c73c7857bb61ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942624:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9463a8b/0x22c73c7857bb61ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942631:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9463a8b/0x22c73c7857bb61ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942641:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1783952197.942681:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952197.942686:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa1f03f/0x22c73c7857bb61f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942695:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77e:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1783952197.942698:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952197.942702:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fa1f03f/0x22c73c7857bb61f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942712:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fa1f03f/0x22c73c7857bb61f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942720:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa1f03f/0x22c73c7857bb61f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942728:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fa1f03f/0x22c73c7857bb61f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942747:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1783952197.942785:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952197.942790:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb61fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942798:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77d:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1783952197.942801:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952197.942805:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb61fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942814:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb61fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942822:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb61fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942829:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb61fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942838:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1783952197.942873:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952197.942878:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb6202 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942886:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77c:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1783952197.942894:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952197.942899:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb6202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942908:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb6202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942917:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb6202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942925:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb6202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942934:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1783952197.942972:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952197.942977:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb6209 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.942985:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77b:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1783952197.942988:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952197.942992:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb6209 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.943001:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb6209 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.943009:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb6209 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.943022:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb6209 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.943031:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1783952197.944844:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783952197.944854:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004255bf8e/0x22c73c7857bb61df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.944867:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a14400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.944872:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004255bf8e/0x22c73c7857bb61df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.944883:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004255bf8e/0x22c73c7857bb61df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.944902:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004255bf8e/0x22c73c7857bb61df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945060:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004255bf8e/0x22c73c7857bb61df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945085:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783952197.945089:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028f95620/0x22c73c7857bb61e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945095:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.945099:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028f95620/0x22c73c7857bb61e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945107:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028f95620/0x22c73c7857bb61e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945117:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028f95620/0x22c73c7857bb61e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945124:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028f95620/0x22c73c7857bb61e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945134:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783952197.945138:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9463a8b/0x22c73c7857bb61ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945144:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.945151:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9463a8b/0x22c73c7857bb61ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945160:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9463a8b/0x22c73c7857bb61ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945168:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9463a8b/0x22c73c7857bb61ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945174:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9463a8b/0x22c73c7857bb61ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945185:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783952197.945188:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fa1f03f/0x22c73c7857bb61f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945195:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.945198:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa1f03f/0x22c73c7857bb61f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945205:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa1f03f/0x22c73c7857bb61f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945212:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fa1f03f/0x22c73c7857bb61f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945229:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fa1f03f/0x22c73c7857bb61f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945246:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783952197.945249:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb61fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945255:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031e00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.945259:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb61fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945266:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb61fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945275:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb61fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945282:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1ee931/0x22c73c7857bb61fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945293:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952197.945296:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb6202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945302:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.945305:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb6202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945322:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb6202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945332:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb6202 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945340:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b1c30f6/0x22c73c7857bb6202 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945352:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.945355:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb6209 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945361:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.945364:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb6209 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945373:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb6209 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945381:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb6209 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945388:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055bb155c/0x22c73c7857bb6209 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945409:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.945411:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.945413:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.945432:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.945453:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.945457:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.945551:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.945557:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a03e144f/0x22c73c7857bb6210 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945569:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.945573:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.945579:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a03e144f/0x22c73c7857bb6210 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945608:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a03e144f/0x22c73c7857bb6210 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945617:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a03e144f/0x22c73c7857bb6210 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945625:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a03e144f/0x22c73c7857bb6210 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945643:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.945649:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.945657:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a03e144f/0x22c73c7857bb6210 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945664:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216aa00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.945668:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a03e144f/0x22c73c7857bb6210 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945675:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a03e144f/0x22c73c7857bb6210 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945685:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a03e144f/0x22c73c7857bb6210 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945693:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a03e144f/0x22c73c7857bb6210 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945709:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.945710:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.945712:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.945746:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x775:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.945750:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fd645d6/0x22c73c7857bb6217 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.945758:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.945761:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.945766:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fd645d6/0x22c73c7857bb6217 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949349:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fd645d6/0x22c73c7857bb6217 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949363:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fd645d6/0x22c73c7857bb6217 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949372:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fd645d6/0x22c73c7857bb6217 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949462:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.949475:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.949481:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fd645d6/0x22c73c7857bb6217 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949490:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.949495:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd645d6/0x22c73c7857bb6217 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949504:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd645d6/0x22c73c7857bb6217 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949519:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fd645d6/0x22c73c7857bb6217 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949526:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fd645d6/0x22c73c7857bb6217 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949552:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.949554:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.949556:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.949673:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x774:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.949679:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb621e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949690:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.949695:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.949700:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb621e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949709:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb621e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949717:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb621e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949724:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb621e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949736:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.949744:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.949748:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb621e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949766:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.949769:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb621e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949775:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb621e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949786:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb621e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949792:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab3d4a0f/0x22c73c7857bb621e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949805:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.949807:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.949808:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.949865:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x773:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.949871:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b9f310/0x22c73c7857bb6225 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.949879:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.949881:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.949886:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b9f310/0x22c73c7857bb6225 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950082:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b9f310/0x22c73c7857bb6225 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950098:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b9f310/0x22c73c7857bb6225 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950105:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076b9f310/0x22c73c7857bb6225 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950119:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.950127:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.950131:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076b9f310/0x22c73c7857bb6225 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950139:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216b800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.950142:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b9f310/0x22c73c7857bb6225 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950150:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b9f310/0x22c73c7857bb6225 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950162:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076b9f310/0x22c73c7857bb6225 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950169:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b9f310/0x22c73c7857bb6225 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950184:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.950191:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.950193:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.950252:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x772:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.950258:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c63af71/0x22c73c7857bb622c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950266:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.950269:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.950273:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c63af71/0x22c73c7857bb622c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950283:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c63af71/0x22c73c7857bb622c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950290:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c63af71/0x22c73c7857bb622c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950297:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c63af71/0x22c73c7857bb622c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950310:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.950316:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.950321:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c63af71/0x22c73c7857bb622c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950327:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ae00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.950331:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c63af71/0x22c73c7857bb622c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950348:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c63af71/0x22c73c7857bb622c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950359:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c63af71/0x22c73c7857bb622c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950366:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c63af71/0x22c73c7857bb622c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950382:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.950383:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.950385:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.950429:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x771:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.950433:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016714077/0x22c73c7857bb6233 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950441:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.950444:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.950448:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016714077/0x22c73c7857bb6233 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950456:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016714077/0x22c73c7857bb6233 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950464:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016714077/0x22c73c7857bb6233 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950476:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016714077/0x22c73c7857bb6233 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950488:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.950495:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.950499:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016714077/0x22c73c7857bb6233 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950505:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216be00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.950508:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016714077/0x22c73c7857bb6233 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950516:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016714077/0x22c73c7857bb6233 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950527:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016714077/0x22c73c7857bb6233 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950534:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016714077/0x22c73c7857bb6233 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950546:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.950548:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.950550:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.950664:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x770:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.950674:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046141c6f/0x22c73c7857bb623a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950683:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.950686:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.950691:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046141c6f/0x22c73c7857bb623a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950700:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046141c6f/0x22c73c7857bb623a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950708:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046141c6f/0x22c73c7857bb623a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950714:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046141c6f/0x22c73c7857bb623a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950726:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.950732:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.950737:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046141c6f/0x22c73c7857bb623a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950743:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ac00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.950747:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046141c6f/0x22c73c7857bb623a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950754:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046141c6f/0x22c73c7857bb623a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950770:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046141c6f/0x22c73c7857bb623a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950778:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046141c6f/0x22c73c7857bb623a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.950791:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.950793:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.950795:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783952197.952300:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783952197.952312:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb6241 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.952326:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77a:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:2.0:1783952197.952331:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952197.952336:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb6241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.952349:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb6241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.952359:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb6241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.952368:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb6241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.952383:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.952974:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.952982:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb6241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.952992:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031a00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.952997:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb6241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.953006:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb6241 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.953023:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb6241 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.953031:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb6241 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.953063:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.953065:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.953067:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.954018:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x779:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.954026:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091677e82/0x22c73c7857bb6248 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954038:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x779:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.954043:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x779:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.954048:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091677e82/0x22c73c7857bb6248 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954061:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091677e82/0x22c73c7857bb6248 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954070:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091677e82/0x22c73c7857bb6248 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954079:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091677e82/0x22c73c7857bb6248 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954095:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.954104:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.954109:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091677e82/0x22c73c7857bb6248 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954128:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.954132:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091677e82/0x22c73c7857bb6248 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954140:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091677e82/0x22c73c7857bb6248 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954153:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091677e82/0x22c73c7857bb6248 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954161:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091677e82/0x22c73c7857bb6248 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954178:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.954180:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.954182:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.954243:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.954248:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fde968e/0x22c73c7857bb624f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954257:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x778:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.954260:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.954264:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fde968e/0x22c73c7857bb624f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954273:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fde968e/0x22c73c7857bb624f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954288:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fde968e/0x22c73c7857bb624f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954295:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fde968e/0x22c73c7857bb624f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954309:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.954317:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.954321:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fde968e/0x22c73c7857bb624f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954328:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216bc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.954331:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fde968e/0x22c73c7857bb624f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954338:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fde968e/0x22c73c7857bb624f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954348:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fde968e/0x22c73c7857bb624f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954354:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fde968e/0x22c73c7857bb624f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954368:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.954375:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.954377:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.954424:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.954429:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000319e619f/0x22c73c7857bb6256 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954437:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x777:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.954440:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.954444:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000319e619f/0x22c73c7857bb6256 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954452:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000319e619f/0x22c73c7857bb6256 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954459:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000319e619f/0x22c73c7857bb6256 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954465:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000319e619f/0x22c73c7857bb6256 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954477:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.954484:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.954488:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000319e619f/0x22c73c7857bb6256 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954494:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216ba00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.954496:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000319e619f/0x22c73c7857bb6256 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954515:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000319e619f/0x22c73c7857bb6256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954525:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000319e619f/0x22c73c7857bb6256 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954531:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000319e619f/0x22c73c7857bb6256 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954543:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.954545:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.954546:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.954609:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.954614:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f818895/0x22c73c7857bb625d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954621:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x776:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.954625:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.954628:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f818895/0x22c73c7857bb625d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954636:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f818895/0x22c73c7857bb625d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954644:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f818895/0x22c73c7857bb625d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954657:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f818895/0x22c73c7857bb625d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954669:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.954676:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.954680:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f818895/0x22c73c7857bb625d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954686:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b18216a800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.954690:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f818895/0x22c73c7857bb625d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954698:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f818895/0x22c73c7857bb625d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954708:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f818895/0x22c73c7857bb625d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954715:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f818895/0x22c73c7857bb625d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954726:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.954728:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.954729:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.954771:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x775:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.954783:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6264 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954795:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x775:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.954798:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.954801:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6264 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954809:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6264 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954816:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6264 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954822:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6264 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954833:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.954840:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.954843:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6264 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954850:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.954852:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6264 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954859:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6264 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954875:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6264 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954881:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6264 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954893:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.954895:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.954897:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.954944:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x774:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.954948:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb626b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954955:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x774:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.954958:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.954961:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb626b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954969:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb626b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954976:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb626b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.954982:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb626b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955004:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.955011:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.955014:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb626b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955020:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ce00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.955023:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb626b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955031:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb626b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955042:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb626b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955050:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8212e41/0x22c73c7857bb626b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955061:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955063:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955064:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.955105:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x773:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.955110:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb6272 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955117:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x773:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.955126:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.955131:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb6272 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955140:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb6272 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955147:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb6272 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955154:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb6272 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955166:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.955173:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.955177:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb6272 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955184:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.955187:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb6272 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955195:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb6272 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955205:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb6272 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955237:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000815c98df/0x22c73c7857bb6272 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955251:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955252:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955254:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.955299:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x772:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.955305:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb6279 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955313:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x772:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.955316:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.955320:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb6279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955329:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb6279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955336:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb6279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955342:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb6279 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955354:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.955365:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.955369:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb6279 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955376:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.955379:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb6279 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955387:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb6279 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955397:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb6279 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955404:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000316347f2/0x22c73c7857bb6279 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955417:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955418:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955420:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.955457:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x771:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.955462:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb6280 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955469:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x771:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.955472:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.955476:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb6280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955495:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb6280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955503:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb6280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955510:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb6280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955522:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.955530:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.955533:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb6280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955540:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644cc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.955543:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb6280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955550:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb6280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955562:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb6280 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955569:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d836cae2/0x22c73c7857bb6280 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955610:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955612:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955613:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.955656:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x770:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.955661:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb6287 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955668:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x770:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.955670:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.955674:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb6287 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955682:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb6287 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955690:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb6287 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955696:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb6287 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955708:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.955713:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.955717:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb6287 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955734:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.955738:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb6287 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955745:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb6287 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955754:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb6287 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955761:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006e9dadb/0x22c73c7857bb6287 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955773:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955774:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955776:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.955818:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.955824:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb628e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955831:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76f:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.955834:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.955838:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb628e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955847:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb628e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955860:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb628e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955867:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb628e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955881:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.955888:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.955892:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb628e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955898:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.955902:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb628e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955910:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb628e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955920:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb628e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955928:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071a53fd6/0x22c73c7857bb628e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.955942:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955949:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.955951:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.955997:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.956002:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb6295 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956010:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76e:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.956013:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.956018:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb6295 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956027:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb6295 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956035:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb6295 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956042:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb6295 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956055:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.956061:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.956065:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb6295 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956072:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.956075:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb6295 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956094:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb6295 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956105:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb6295 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956112:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000457ce471/0x22c73c7857bb6295 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956125:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.956127:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.956128:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.956170:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.956176:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb629c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956184:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76d:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.956187:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.956191:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb629c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956200:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb629c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956208:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb629c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956236:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb629c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956250:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.956258:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.956262:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb629c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956269:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.956272:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb629c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956280:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb629c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956292:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb629c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956299:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068e976bc/0x22c73c7857bb629c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956313:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.956315:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.956317:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.956356:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.956367:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb62a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956376:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76c:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.956379:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.956384:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb62a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956393:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb62a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956401:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb62a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956408:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb62a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956421:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.956427:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.956431:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb62a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956438:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644de00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.956442:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb62a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956450:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb62a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956469:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb62a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956475:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d54fa3d/0x22c73c7857bb62a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956489:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.956490:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.956492:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.956535:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.956540:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb62aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956547:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76b:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.956550:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.956553:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb62aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956560:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb62aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956568:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb62aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956575:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb62aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956617:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.956624:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.956628:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb62aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956635:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644dc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.956638:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb62aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956646:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb62aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956655:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb62aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956662:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000326b5279/0x22c73c7857bb62aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956674:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.956676:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.956678:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.956720:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.956725:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb62b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956733:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76a:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.956741:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.956745:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb62b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956755:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb62b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956764:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb62b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956772:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb62b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956784:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.956792:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.956796:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb62b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956802:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.956806:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb62b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956813:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb62b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956823:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb62b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956840:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e06b245/0x22c73c7857bb62b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956854:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.956855:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.956857:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.956899:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x769:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.956904:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb62b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956912:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x769:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.956915:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.956919:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb62b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956928:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb62b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956936:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb62b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956944:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb62b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956957:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.956969:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.956973:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb62b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956980:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.956984:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb62b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.956992:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb62b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957003:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb62b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957011:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f34f1e/0x22c73c7857bb62b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957024:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.957026:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.957028:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.957067:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x768:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.957073:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb62bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957081:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x768:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.957084:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.957089:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb62bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957110:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb62bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957119:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb62bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957126:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb62bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957138:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.957145:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.957148:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb62bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957154:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.957158:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb62bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957166:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb62bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957175:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb62bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957182:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dadde7d/0x22c73c7857bb62bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.957202:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.957203:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.957205:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783952197.958083:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952197.958091:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047e67f76/0x22c73c7857bb62c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.958102:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:1.0:1783952197.958105:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952197.958110:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047e67f76/0x22c73c7857bb62c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.958121:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047e67f76/0x22c73c7857bb62c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.958142:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047e67f76/0x22c73c7857bb62c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.958149:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047e67f76/0x22c73c7857bb62c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.958173:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783952197.958247:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952197.958253:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008626b8ff/0x22c73c7857bb62cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.958260:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:1.0:1783952197.958264:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952197.958268:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008626b8ff/0x22c73c7857bb62cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.958277:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008626b8ff/0x22c73c7857bb62cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.958285:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008626b8ff/0x22c73c7857bb62cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.958293:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008626b8ff/0x22c73c7857bb62cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1783952197.959312:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1783952197.959386:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x767:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.959393:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb62d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.959403:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x767:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.959407:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.959411:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb62d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.959421:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb62d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.959429:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb62d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.959437:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb62d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.959522:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783952197.959575:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783952197.959581:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003800ce28/0x22c73c7857bb62db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.959612:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:1.0:1783952197.959615:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952197.959620:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003800ce28/0x22c73c7857bb62db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.959630:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003800ce28/0x22c73c7857bb62db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.959637:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003800ce28/0x22c73c7857bb62db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952197.959645:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003800ce28/0x22c73c7857bb62db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.959732:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783952197.959741:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047e67f76/0x22c73c7857bb62c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.959757:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70c00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.959762:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047e67f76/0x22c73c7857bb62c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.959770:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047e67f76/0x22c73c7857bb62c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.959787:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047e67f76/0x22c73c7857bb62c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.959795:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047e67f76/0x22c73c7857bb62c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960060:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783952197.960067:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008626b8ff/0x22c73c7857bb62cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960075:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952197.960079:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008626b8ff/0x22c73c7857bb62cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960087:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008626b8ff/0x22c73c7857bb62cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960105:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008626b8ff/0x22c73c7857bb62cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960113:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008626b8ff/0x22c73c7857bb62cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960128:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952197.960132:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb62d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960140:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644da00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952197.960143:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb62d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960149:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb62d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960158:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb62d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960165:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952197.960168:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003800ce28/0x22c73c7857bb62db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960174:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952197.960184:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003800ce28/0x22c73c7857bb62db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960193:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003800ce28/0x22c73c7857bb62db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960203:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003800ce28/0x22c73c7857bb62db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952197.960211:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952197.960213:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952197.960225:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.960326:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.960347:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783952197.960353:0:26201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f6b635/0x22c73c7857bb62d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960385:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.960439:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x766:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.960444:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb62e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960453:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x766:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.960457:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.960462:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb62e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960472:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb62e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960481:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb62e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960489:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb62e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960510:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783952197.960546:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x765:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.960551:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb62e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960558:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x765:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.960565:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.960570:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb62e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960579:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb62e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960607:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb62e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960616:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb62e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960628:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783952197.960665:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x764:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.960670:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb62f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960679:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x764:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.960682:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.960686:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb62f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960695:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb62f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960703:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb62f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960716:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb62f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960727:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783952197.960765:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x763:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.960771:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053271b16/0x22c73c7857bb62f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960780:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x763:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.960783:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.960787:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053271b16/0x22c73c7857bb62f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960797:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053271b16/0x22c73c7857bb62f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960804:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053271b16/0x22c73c7857bb62f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.960811:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053271b16/0x22c73c7857bb62f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961003:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783952197.961014:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783952197.961019:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb62e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961033:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.961037:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb62e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961045:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb62e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961057:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb62e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961064:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008632d827/0x22c73c7857bb62e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961081:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783952197.961084:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb62e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961091:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.961094:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb62e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961102:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb62e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961111:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb62e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961125:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081ed941a/0x22c73c7857bb62e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961138:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952197.961141:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb62f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961146:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.961149:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb62f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961157:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb62f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961167:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb62f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961175:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031f9face/0x22c73c7857bb62f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961186:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.961189:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053271b16/0x22c73c7857bb62f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961195:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.961204:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053271b16/0x22c73c7857bb62f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961214:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053271b16/0x22c73c7857bb62f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961237:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053271b16/0x22c73c7857bb62f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961245:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053271b16/0x22c73c7857bb62f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961259:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.961261:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.961263:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783952197.961363:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x762:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.961369:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb62fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961378:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x762:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.961381:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.961386:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb62fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961396:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb62fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961416:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb62fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961424:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb62fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961436:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783952197.961444:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952197.961448:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb62fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961455:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:0.0:1783952197.961459:0:7459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb62fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961467:0:7459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb62fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961479:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb62fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961487:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035513d28/0x22c73c7857bb62fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.961500:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.961507:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.961509:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.961841:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.961848:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952197.962078:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952197.962198:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783952197.962207:0:26199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003800ce28/0x22c73c7857bb62db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783952197.962719:0:26201:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1826 00000100:00100000:0.0:1783952197.962810:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:94425:x1870605465595648:12345-0@lo:5:osp-pre-1-0.0 Request processed in 53262us (62156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952197.962819:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4961 00000100:00100000:3.0:1783952197.963795:0:94425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f01880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94425:1870605465595648:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783952197.963812:0:94425:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x781:0x0] from OST, last_created [0x2c0000401:0x781:0x0]last_used is [0x2c0000401:0x722:0x0] 00000100:00100000:3.0:1783952197.963905:0:94425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94425:1870605465595904:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783952197.964078:0:94425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952197.964104:0:94425:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176bc6240 going to sleep for 11 seconds 00000100:00100000:3.0:1783952197.964150:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952197.964162:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465595776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952197.964189:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952197.964233:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465595904 00000100:00100000:3.0:1783952197.964239:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465595904 00000100:00100000:3.0:1783952197.964279:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4962 00000100:00100000:3.0:1783952197.964287:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:94425:x1870605465595904:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783952197.964328:0:26203:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1922 00010000:00010000:2.0:1783952197.966691:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952197.967084:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:94425:x1870605465595904:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2794us (3003us total) trans 4294968959 rc 0/0 00000100:00100000:3.0:1783952197.967096:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4962 00000100:00100000:3.0:1783952197.967137:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465595776 00000100:00100000:3.0:1783952197.967145:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465595776 00000100:00100000:3.0:1783952197.967185:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237 00000100:00100000:3.0:1783952197.967193:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465595776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952197.967225:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 209216 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952197.967267:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1870605465595776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (3077us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952197.967273:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237 00000100:00100000:3.0:1783952197.967471:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465595776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952197.972498:0:94425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1762f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94425:1870605465595904:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783952197.972518:0:94425:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x781:0x0]-[0x2c0000401:0x7a1:0x0] 00002000:00010000:0.0:1783952197.973163:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.973172:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092c7a121/0x22c73c7857bb6305 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973189:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.973193:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.973199:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092c7a121/0x22c73c7857bb6305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973213:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092c7a121/0x22c73c7857bb6305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973234:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092c7a121/0x22c73c7857bb6305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973241:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092c7a121/0x22c73c7857bb6305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973258:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783952197.973308:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.973313:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f24dff03/0x22c73c7857bb630c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973322:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.973325:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.973329:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f24dff03/0x22c73c7857bb630c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973338:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f24dff03/0x22c73c7857bb630c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973345:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f24dff03/0x22c73c7857bb630c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973351:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f24dff03/0x22c73c7857bb630c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973364:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783952197.973404:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.973410:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a03426b/0x22c73c7857bb6313 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973418:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.973420:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.973424:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a03426b/0x22c73c7857bb6313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973444:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a03426b/0x22c73c7857bb6313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973452:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a03426b/0x22c73c7857bb6313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973460:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a03426b/0x22c73c7857bb6313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973484:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783952197.973523:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x769:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.973528:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000885e1df7/0x22c73c7857bb631a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973536:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.973539:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.973543:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000885e1df7/0x22c73c7857bb631a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973552:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000885e1df7/0x22c73c7857bb631a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973558:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000885e1df7/0x22c73c7857bb631a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973575:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000885e1df7/0x22c73c7857bb631a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973607:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1783952197.973647:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x768:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.973651:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb6321 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973659:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.973662:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.973666:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb6321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973674:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb6321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973681:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb6321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973688:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb6321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973696:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1783952197.973732:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x767:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.973736:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6ba511a/0x22c73c7857bb6328 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973751:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.973754:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.973757:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ba511a/0x22c73c7857bb6328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973766:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6ba511a/0x22c73c7857bb6328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973773:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6ba511a/0x22c73c7857bb6328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973780:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ba511a/0x22c73c7857bb6328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.973787:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1783952197.977399:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x766:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.977414:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb632f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977432:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.977437:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.977443:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb632f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977457:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb632f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977487:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb632f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977495:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb632f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977506:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1783952197.977638:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x765:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.977644:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb6336 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977652:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.977656:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.977660:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb6336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977669:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb6336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977676:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb6336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977683:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb6336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977702:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1783952197.977744:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x764:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.977748:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb633d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977757:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.977760:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.977763:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb633d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977772:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb633d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977779:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb633d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977801:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb633d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977811:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1783952197.977861:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x763:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.977866:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb6344 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977873:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.977882:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.977897:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb6344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.977907:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb6344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978056:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783952197.978065:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092c7a121/0x22c73c7857bb6305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978075:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.978081:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092c7a121/0x22c73c7857bb6305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978101:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092c7a121/0x22c73c7857bb6305 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978118:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092c7a121/0x22c73c7857bb6305 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978125:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092c7a121/0x22c73c7857bb6305 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978150:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783952197.978154:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f24dff03/0x22c73c7857bb630c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978161:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbce00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.978164:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f24dff03/0x22c73c7857bb630c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978172:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f24dff03/0x22c73c7857bb630c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978181:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f24dff03/0x22c73c7857bb630c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978188:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f24dff03/0x22c73c7857bb630c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978213:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783952197.978227:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a03426b/0x22c73c7857bb6313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978233:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc200 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.978235:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a03426b/0x22c73c7857bb6313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978243:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a03426b/0x22c73c7857bb6313 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978253:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a03426b/0x22c73c7857bb6313 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978260:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a03426b/0x22c73c7857bb6313 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978271:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783952197.978275:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000885e1df7/0x22c73c7857bb631a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978281:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbda00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.978283:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000885e1df7/0x22c73c7857bb631a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978300:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000885e1df7/0x22c73c7857bb631a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978310:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000885e1df7/0x22c73c7857bb631a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978317:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000885e1df7/0x22c73c7857bb631a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978331:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783952197.978334:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb6321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978340:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc600 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.978343:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb6321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978350:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb6321 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978360:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb6321 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978366:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034b3e46b/0x22c73c7857bb6321 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978393:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783952197.978397:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6ba511a/0x22c73c7857bb6328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978403:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbde00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.978406:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6ba511a/0x22c73c7857bb6328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978414:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6ba511a/0x22c73c7857bb6328 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978423:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6ba511a/0x22c73c7857bb6328 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978429:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6ba511a/0x22c73c7857bb6328 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978441:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783952197.978444:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb632f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978449:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbdc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.978451:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb632f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978470:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb632f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978481:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb632f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978487:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5bfe73a/0x22c73c7857bb632f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978500:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783952197.978504:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb6336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978510:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc000 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.978512:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb6336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978519:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb6336 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978527:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb6336 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978533:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ebb55c1/0x22c73c7857bb6336 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978556:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952197.978559:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb633d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978564:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbcc00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.978567:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb633d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978574:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb633d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978583:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb633d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978637:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9805b05/0x22c73c7857bb633d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.978649:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.978651:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.978653:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.978660:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.978665:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952197.979234:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb6344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.979243:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb6344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.979268:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783952197.979347:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x762:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783952197.979353:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb634b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.979363:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=3912s v=(0 0) 00010000:00010000:0.0:1783952197.979366:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952197.979371:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb634b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.979382:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb634b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.979390:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb634b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.979405:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb634b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952197.979418:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1783952197.979871:0:26199:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1827 00010000:00010000:2.0:1783952197.980359:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783952197.980366:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb6344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.980390:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.980395:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb6344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.980406:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb6344 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.980420:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb6344 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.980428:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a83cfdd/0x22c73c7857bb6344 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.980447:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952197.980450:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb634b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.980456:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952197.980458:0:15262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb634b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.980465:0:15262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb634b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.980474:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb634b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.980488:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035513d28/0x22c73c7857bb634b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952197.980502:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.980504:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.980505:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.980513:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952197.980717:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952197.981137:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:94423:x1870605465595520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 77153us (80675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952197.981149:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4960 00000100:00100000:1.0:1783952197.988075:0:94423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94423:1870605465595520:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783952197.988096:0:94423:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x781:0x0] from OST, last_created [0x280000401:0x781:0x0]last_used is [0x280000401:0x723:0x0] 00000100:00100000:0.0:1783952197.988257:0:94423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94423:1870605465596160:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783952197.988327:0:94423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952197.988354:0:94423:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049a33d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783952197.988370:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952197.988382:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465596032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952197.988424:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952197.988460:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465596160 00000100:00100000:0.0:1783952197.988466:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465596160 00000100:00100000:0.0:1783952197.988512:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4963 00000100:00100000:0.0:1783952197.988520:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:94423:x1870605465596160:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783952197.988564:0:26196:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1922 00000100:00100000:1.0:1783952197.990650:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465596032 00000100:00100000:1.0:1783952197.990661:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465596032 00000100:00100000:1.0:1783952197.990711:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238 00000100:00100000:1.0:1783952197.990720:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465596032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783952197.990743:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952197.990818:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465596032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952197.990840:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238 00000100:00100000:1.0:1783952197.990907:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465596032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952197.997728:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:94423:x1870605465596160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9198us (9402us total) trans 4294968957 rc 0/0 00000100:00100000:0.0:1783952197.997744:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4963 00000100:00100000:2.0:1783952197.998842:0:94423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94423:1870605465596160:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783952197.998863:0:94423:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x781:0x0]-[0x280000401:0x7a1:0x0] 00000100:00100000:2.0:1783952198.132265:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952198.132318:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952198.132326:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447782400 00000100:00100000:0.0:1783952198.132336:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447782400 00000100:00100000:0.0:1783952198.132419:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1403 00000100:00100000:0.0:1783952198.132429:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2398:x1870605447782400:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952198.132525:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2398:x1870605447782400:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 98us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952198.132533:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1403 00000100:00100000:0.0:1783952198.132555:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447782272 00000100:00100000:0.0:1783952198.132558:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447782272 00000100:00100000:0.0:1783952198.132615:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 73 00000100:00100000:0.0:1783952198.132624:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447782272:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952198.132649:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447782272:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952198.132655:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 73 00000100:00080000:2.0:1783952198.132899:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783952198.177745:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783952198.245496:0:75694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:0.0:1783952198.896442:0:94744:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783952198.897291:0:94744:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783952199.216756:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952199.274865:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465596288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952199.274950:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952199.275041:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465596288 00000100:00100000:1.0:1783952199.275050:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465596288 00000100:00100000:1.0:1783952199.275100:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239 00000100:00100000:1.0:1783952199.275110:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465596288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952199.275141:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 209216 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952199.280485:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465596416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952199.280559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783952199.280638:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952199.285085:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465596416 00000100:00100000:2.0:1783952199.285100:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465596416 00000100:00100000:2.0:1783952199.285162:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240 00000100:00100000:2.0:1783952199.285175:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465596416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952199.285219:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 209216 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952199.285305:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465596416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (4745us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952199.285329:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240 00000100:00080000:2.0:1783952199.285351:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952199.285392:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465596416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952199.285859:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465596288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10748us (10906us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952199.285868:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239 00000100:00100000:3.0:1783952199.295281:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465596288:0@lo:13:osp-pre-1-1.0 00000020:00000004:1.0:1783952200.171142:0:94794:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783952200.176239:0:94794:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783952200.227405:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952201.250475:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952202.273377:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952202.312565:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952202.312788:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447782528 00000100:00100000:3.0:1783952202.312807:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447782528 00000100:00100000:3.0:1783952202.312891:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1439 00000100:00100000:3.0:1783952202.312901:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:72400:x1870605447782528:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952202.312924:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952202.312945:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a200/0x22c73c7857bb6352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a514 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952202.313031:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6359 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952202.313066:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952202.313079:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952202.313136:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00080000:2.0:1783952202.313248:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1783952202.313654:0:66237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952202.313700:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6359 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952202.313730:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a200/0x22c73c7857bb6352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a514 expref: 8 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952202.313749:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6359 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a514 expref: 7 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952202.313757:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:3.0:1783952202.313760:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783952202.313763:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a600, rc 0) 00000100:00100000:3.0:1783952202.313840:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:72400:x1870605447782528:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 940us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952202.313848:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1439 00000100:00100000:0.0:1783952202.322043:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952202.322276:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447782656 00000100:00100000:3.0:1783952202.322286:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447782656 00000100:00100000:3.0:1783952202.322349:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1440 00000100:00100000:3.0:1783952202.322359:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:72400:x1870605447782656:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:3.0:1783952202.322400:0:67035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445187584 avail 1298948096 00000100:00100000:3.0:1783952202.322487:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:72400:x1870605447782656:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 130us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952202.322494:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1440 00000100:00100000:2.0:1783952202.325639:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952202.325760:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447782784 00000100:00100000:0.0:1783952202.325774:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447782784 00000100:00100000:0.0:1783952202.325869:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1441 00000100:00100000:0.0:1783952202.325892:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:72400:x1870605447782784:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:0.0:1783952202.325944:0:66238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:0.0:1783952202.326039:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:72400:x1870605447782784:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 150us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952202.326048:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1441 00000100:00080000:2.0:1783952202.326997:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952202.331947:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952202.332079:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447782912 00000100:00100000:3.0:1783952202.332088:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447782912 00000100:00100000:3.0:1783952202.332129:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4964 00000100:00100000:3.0:1783952202.332136:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1870605447782912:12345-192.168.202.48@tcp:8:lfs.0 00010000:00080000:3.0:1783952202.332191:0:8435:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp t0 exp 0000000000000000 cur 3917 last 0 00000020:00000080:3.0:1783952202.332221:0:8435:0:(genops.c:1406:class_connect()) connect: client d33551be-a709-4ba2-a74c-f4d7b53c6817, cookie 0x22c73c7857bb6360 00002000:00100000:3.0:1783952202.332233:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d33551be-a709-4ba2-a74c-f4d7b53c6817/ffff97b04e288000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783952202.332251:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783952202.332314:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783952202.332341:0:8435:0:(import.c:65:import_set_state_nolock()) ffff97b04e28d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952202.332412:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447782912:12345-192.168.202.48@tcp:8:lfs.0 Request processed in 274us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952202.332419:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4964 00000100:00100000:1.0:1783952202.342190:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952202.342347:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447783040 00000100:00100000:2.0:1783952202.342358:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447783040 00000100:00100000:2.0:1783952202.342440:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2241 00000100:00100000:2.0:1783952202.342451:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:72400:x1870605447783040:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:2.0:1783952202.342480:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952202.342552:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:72400:x1870605447783040:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 103us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952202.342560:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2241 00000100:00080000:0.0:1783952202.342713:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952202.349350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952202.349647:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447783168 00000100:00100000:0.0:1783952202.349661:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447783168 00000100:00100000:0.0:1783952202.349723:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4965 00000100:00100000:0.0:1783952202.349734:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2397:x1870605447783168:12345-192.168.202.48@tcp:8:lfs.0 00010000:00080000:0.0:1783952202.349799:0:15187:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp t0 exp 0000000000000000 cur 3917 last 0 00000020:00000080:0.0:1783952202.349839:0:15187:0:(genops.c:1406:class_connect()) connect: client d33551be-a709-4ba2-a74c-f4d7b53c6817, cookie 0x22c73c7857bb6367 00002000:00100000:0.0:1783952202.349855:0:15187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d33551be-a709-4ba2-a74c-f4d7b53c6817/ffff97b1746c9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783952202.349891:0:15187:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783952202.349983:0:15187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783952202.350020:0:15187:0:(import.c:65:import_set_state_nolock()) ffff97b1746cc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783952202.350120:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447783168:12345-192.168.202.48@tcp:8:lfs.0 Request processed in 386us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952202.350128:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4965 00000100:00100000:1.0:1783952202.352825:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952202.352905:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447783296 00000100:00100000:3.0:1783952202.352917:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447783296 00000100:00100000:3.0:1783952202.353001:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2242 00000100:00100000:3.0:1783952202.353013:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:72400:x1870605447783296:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783952202.353047:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952202.353122:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:72400:x1870605447783296:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 111us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952202.353130:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2242 00000100:00080000:0.0:1783952202.353294:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952202.849107:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465596800:0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.849232:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952202.849291:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465597312:0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.849320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952202.849344:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465597824:0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.849366:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952202.849393:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783952202.849399:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465596928:0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.849422:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952202.849459:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465597440:0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.849482:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952202.849497:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465597952:0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.849516:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952202.849562:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465597312 00000100:00100000:2.0:1783952202.849572:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465597312 00000100:00100000:2.0:1783952202.849666:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465597824 00000100:00100000:2.0:1783952202.849670:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465597824 00000100:00100000:2.0:1783952202.849691:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465597440 00000100:00100000:2.0:1783952202.849694:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465597440 00000100:00100000:2.0:1783952202.849715:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465597952 00000100:00100000:2.0:1783952202.849717:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465597952 00000100:00100000:2.0:1783952202.849739:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:2.0:1783952202.849749:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465597312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.849810:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465597312:12345-0@lo:400:kworker.0 Request processed in 62us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952202.849818:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00000100:00100000:2.0:1783952202.849837:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:2.0:1783952202.849843:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465597824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.849872:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465597824:12345-0@lo:400:kworker.0 Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952202.849878:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:2.0:1783952202.849889:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:2.0:1783952202.849896:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465597440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.849923:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465597440:12345-0@lo:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952202.849929:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00100000:2.0:1783952202.849962:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:2.0:1783952202.849969:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465597952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.849998:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3644:x1870605465597952:12345-0@lo:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952202.850005:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:2.0:1783952202.850055:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465597440:0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.850067:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465597952:0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.850077:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465597312:0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.850086:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465597824:0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.850625:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465596800 00000100:00100000:0.0:1783952202.850632:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465596800 00000100:00100000:0.0:1783952202.850687:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465596928 00000100:00100000:0.0:1783952202.850690:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465596928 00000100:00100000:0.0:1783952202.850717:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1783952202.850724:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465596800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.850777:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465596800:12345-0@lo:400:kworker.0 Request processed in 54us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952202.850784:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1783952202.850799:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1783952202.850804:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465596928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.850834:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465596928:12345-0@lo:400:kworker.0 Request processed in 30us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952202.850840:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00080000:0.0:1783952202.850864:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952202.850869:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952202.850880:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952202.850883:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952202.851247:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465596928:0@lo:400:kworker.0 00000100:00100000:2.0:1783952202.851262:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465596800:0@lo:400:kworker.0 00000100:00100000:3.0:1783952202.851763:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465596672:0@lo:400:kworker.0 00000100:00100000:3.0:1783952202.851831:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952202.851859:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465597184:0@lo:400:kworker.0 00000100:00100000:3.0:1783952202.851887:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952202.851911:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465597696:0@lo:400:kworker.0 00000100:00100000:3.0:1783952202.851935:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952202.851958:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1783952202.851965:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465596544:0@lo:400:kworker.0 00000100:00100000:3.0:1783952202.851997:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952202.852031:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465597056:0@lo:400:kworker.0 00000100:00100000:3.0:1783952202.852055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952202.852074:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465597568:0@lo:400:kworker.0 00000100:00100000:3.0:1783952202.852095:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952202.852115:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465598080:0@lo:400:kworker.0 00000100:00100000:3.0:1783952202.852145:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952202.852393:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465597184 00000100:00100000:1.0:1783952202.852400:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465597184 00000100:00100000:1.0:1783952202.852445:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465597696 00000100:00100000:1.0:1783952202.852457:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465597696 00000100:00100000:1.0:1783952202.852483:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:1.0:1783952202.852491:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465597184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952202.852545:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465597184:12345-0@lo:400:kworker.0 Request processed in 55us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952202.852553:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00100000:1.0:1783952202.852571:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1783952202.852577:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465597696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952202.852627:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465597696:12345-0@lo:400:kworker.0 Request processed in 51us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952202.852633:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1783952202.852677:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465596544 00000100:00100000:1.0:1783952202.852682:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465596544 00000100:00100000:1.0:1783952202.852709:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783952202.852715:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465596544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952202.852746:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465596544:12345-0@lo:400:kworker.0 Request processed in 30us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952202.852752:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783952202.852886:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952202.852897:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465598208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783952202.852930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952202.852957:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465598208 00000100:00100000:2.0:1783952202.852960:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465598208 00000100:00100000:2.0:1783952202.852984:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:2.0:1783952202.852991:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465598208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783952202.853012:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:2.0:1783952202.853050:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465598208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952202.853056:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:2.0:1783952202.853102:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465598208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952202.853423:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465597184:0@lo:400:kworker.0 00000100:00100000:3.0:1783952202.853435:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465597696:0@lo:400:kworker.0 00000100:00100000:3.0:1783952202.853453:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465596544:0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.864494:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465596672 00000100:00100000:0.0:1783952202.864517:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465596672 00000100:00100000:0.0:1783952202.864638:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465597056 00000100:00100000:0.0:1783952202.864642:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465597056 00000100:00100000:0.0:1783952202.864668:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465597568 00000100:00100000:0.0:1783952202.864671:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465597568 00000100:00100000:0.0:1783952202.864686:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465598080 00000100:00100000:0.0:1783952202.864688:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465598080 00000100:00100000:0.0:1783952202.865857:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1783952202.865872:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465596672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.866181:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465596672:12345-0@lo:400:kworker.0 Request processed in 305us (14340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952202.866190:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1783952202.866576:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1783952202.866612:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465597056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.866657:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465597056:12345-0@lo:400:kworker.0 Request processed in 73us (14600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952202.866664:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1783952202.866679:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1783952202.866686:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465597568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.867189:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465597568:12345-0@lo:400:kworker.0 Request processed in 501us (15090us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952202.867205:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1783952202.867225:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1783952202.867232:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465598080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.867265:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465598080:12345-0@lo:400:kworker.0 Request processed in 34us (15118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952202.867359:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00080000:0.0:1783952202.867393:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952202.867398:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952202.867490:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465597056:0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.867506:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465597568:0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.867532:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465598080:0@lo:400:kworker.0 00000100:00100000:0.0:1783952202.867548:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465596672:0@lo:400:kworker.0 00000100:00100000:1.0:1783952203.252842:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952203.252906:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952203.252951:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952203.252982:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952203.253010:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952203.253042:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447783424 00000100:00100000:1.0:1783952203.253054:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447783424 00000100:00100000:1.0:1783952203.253121:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:1.0:1783952203.253133:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447783424:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952203.253293:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447783424:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 161us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952203.253302:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 75 00000100:00100000:3.0:1783952203.253657:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447783808 00000100:00100000:3.0:1783952203.253662:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447783808 00000100:00100000:3.0:1783952203.253710:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447783936 00000100:00100000:3.0:1783952203.253713:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447783936 00000100:00100000:3.0:1783952203.253737:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2872 00000100:00100000:3.0:1783952203.253745:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2400:x1870605447783808:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952203.253786:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2400:x1870605447783808:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 42us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952203.253801:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2872 00000100:00100000:3.0:1783952203.253818:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2873 00000100:00100000:3.0:1783952203.253825:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2400:x1870605447783936:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952203.253852:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2400:x1870605447783936:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952203.253858:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2873 00000100:00100000:0.0:1783952203.254819:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447783552 00000100:00100000:0.0:1783952203.254828:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447783552 00000100:00100000:0.0:1783952203.254891:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447783680 00000100:00100000:0.0:1783952203.254895:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447783680 00000100:00100000:0.0:1783952203.254928:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1410 00000100:00100000:0.0:1783952203.254938:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447783552:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952203.255009:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447783552:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 73us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952203.255016:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1410 00000100:00100000:0.0:1783952203.255032:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1411 00000100:00100000:0.0:1783952203.255039:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447783680:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952203.255068:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447783680:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 29us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952203.255075:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1411 00010000:00010000:2.0:1783952203.296981:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952203.363703:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783952203.363736:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465598336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952203.363833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952203.363912:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465598336 00000100:00100000:2.0:1783952203.363921:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465598336 00000100:00100000:2.0:1783952203.363989:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243 00000100:00100000:2.0:1783952203.363999:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465598336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783952203.364035:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952203.364085:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870605465598336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952203.364092:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243 00000100:00100000:2.0:1783952203.364179:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465598336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952203.365265:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952203.365288:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04aa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465598464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952203.365350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952203.365397:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465598464 00000100:00100000:3.0:1783952203.365403:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465598464 00000100:00100000:3.0:1783952203.365444:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:3.0:1783952203.365452:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465598464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783952203.365490:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445187584 avail 1298948096 00000100:00100000:3.0:1783952203.365534:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465598464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952203.365541:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:3.0:1783952203.365821:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04aa48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465598464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952203.369793:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465598592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952203.369912:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952203.370921:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465598592 00000100:00100000:1.0:1783952203.370934:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465598592 00000100:00100000:1.0:1783952203.371003:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244 00000100:00100000:1.0:1783952203.371014:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465598592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952203.371050:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952203.371123:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465598592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952203.371131:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244 00000100:00100000:1.0:1783952203.371224:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465598592:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1783952203.884925:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000001:00080000:1.0:1783952203.884950:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968957 is committed 00000001:00100000:1.0:1783952203.895281:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d33551be-a709-4ba2-a74c-f4d7b53c6817 00000001:00080000:1.0:1783952203.895304:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968959 is committed 00010000:00010000:1.0:1783952204.320815:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952204.385181:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783952204.385217:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465598720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952204.385409:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952204.385571:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783952204.385583:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465598848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952204.386225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952204.394116:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465598720 00000100:00100000:1.0:1783952204.394137:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465598720 00000100:00100000:1.0:1783952204.394274:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465598848 00000100:00100000:1.0:1783952204.394278:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465598848 00000100:00100000:3.0:1783952204.394347:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245 00000100:00100000:3.0:1783952204.394380:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465598720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783952204.394427:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952204.394533:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465598720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 158us (9124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952204.394542:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245 00000100:00100000:3.0:1783952204.394629:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465598720:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783952204.405597:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952204.405616:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952204.405843:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246 00000100:00100000:1.0:1783952204.405865:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465598848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952204.405914:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952204.406035:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465598848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 181us (19812us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952204.406065:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246 00000100:00100000:1.0:1783952204.406141:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465598848:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783952205.345791:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952206.369200:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952207.392895:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952207.969476:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465598976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952207.969550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952207.969874:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465599232:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.969923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952207.970000:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465599744:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.970027:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952207.970042:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465600256:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.970064:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952207.970239:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465598976 00000100:00100000:2.0:1783952207.970247:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465598976 00000100:00100000:2.0:1783952207.970292:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465599744 00000100:00100000:2.0:1783952207.970296:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465599744 00000100:00100000:2.0:1783952207.970315:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:2.0:1783952207.970322:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465598976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783952207.970360:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:2.0:1783952207.970404:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465598976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952207.970417:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00100000:2.0:1783952207.970433:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:2.0:1783952207.970439:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465599744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952207.970467:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465599744:12345-0@lo:400:kworker.0 Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952207.970472:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00100000:2.0:1783952207.970487:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465599232 00000100:00100000:2.0:1783952207.970490:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465599232 00000100:00100000:2.0:1783952207.970518:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:2.0:1783952207.970523:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465599232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952207.970547:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465599232:12345-0@lo:400:kworker.0 Request processed in 24us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952207.970552:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00080000:2.0:1783952207.970567:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952207.970608:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465600256 00000100:00100000:2.0:1783952207.970611:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465600256 00000100:00100000:0.0:1783952207.970794:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465599232:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.970803:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465599744:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.970820:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783952207.970827:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465599104:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.970854:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952207.970877:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465599616:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.970897:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952207.970915:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465600128:0@lo:400:kworker.0 00000100:00100000:3.0:1783952207.971043:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465599360:0@lo:400:kworker.0 00000100:00100000:3.0:1783952207.971102:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465599616 00000100:00100000:3.0:1783952207.971106:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465599616 00000100:00100000:3.0:1783952207.971145:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1783952207.971152:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465599616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952207.971186:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465599616:12345-0@lo:400:kworker.0 Request processed in 35us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952207.971192:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00080000:3.0:1783952207.971218:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952207.971377:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952207.971428:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:2.0:1783952207.971438:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465600256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952207.971469:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465600256:12345-0@lo:400:kworker.0 Request processed in 34us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952207.971474:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00100000:1.0:1783952207.971565:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465599104 00000100:00100000:1.0:1783952207.971570:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465599104 00000100:00100000:1.0:1783952207.971620:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783952207.971690:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465599104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952207.971726:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465599104:12345-0@lo:400:kworker.0 Request processed in 100us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952207.971732:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783952207.971762:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465599488:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.972371:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952207.972428:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968957 gen 2 00000100:00100000:0.0:1783952207.972444:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465600256:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.972459:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465599104:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.972470:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465599616:0@lo:400:kworker.0 00000100:00100000:3.0:1783952207.973455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952207.973499:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465599872:0@lo:400:kworker.0 00000100:00100000:3.0:1783952207.973539:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952207.973565:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465600384:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.973835:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465599872 00000100:00100000:0.0:1783952207.973842:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465599872 00000100:00100000:0.0:1783952207.973894:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:0.0:1783952207.973902:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465599872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.974009:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465599872:12345-0@lo:400:kworker.0 Request processed in 108us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952207.974028:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00080000:0.0:1783952207.974065:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783952207.974248:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465600128 00000100:00100000:2.0:1783952207.974253:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465600128 00000100:00100000:2.0:1783952207.974281:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465599360 00000100:00100000:2.0:1783952207.974284:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465599360 00000100:00100000:2.0:1783952207.974309:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1783952207.974315:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465600128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952207.974365:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465600128:12345-0@lo:400:kworker.0 Request processed in 50us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952207.974371:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1783952207.974383:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1783952207.974388:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465599360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952207.974416:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465599360:12345-0@lo:400:kworker.0 Request processed in 28us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952207.974421:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1783952207.975258:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952207.975319:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465599360:0@lo:400:kworker.0 00000100:00100000:3.0:1783952207.975333:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465599872:0@lo:400:kworker.0 00000100:00100000:3.0:1783952207.975398:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465600128:0@lo:400:kworker.0 00000100:00080000:1.0:1783952207.975553:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952207.975602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952207.975717:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465600000:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.975756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952207.975785:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465600512:0@lo:400:kworker.0 00000100:00100000:0.0:1783952207.975810:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952207.975847:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465598976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952207.975874:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465599488 00000100:00100000:0.0:1783952207.975878:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465599488 00000100:00100000:0.0:1783952207.975915:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465600512 00000100:00100000:0.0:1783952207.975918:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465600512 00000100:00100000:1.0:1783952207.976742:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465600384 00000100:00100000:1.0:1783952207.976748:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465600384 00000100:00100000:1.0:1783952207.976786:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465600000 00000100:00100000:1.0:1783952207.976790:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465600000 00000100:00100000:1.0:1783952207.976815:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:1.0:1783952207.976824:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465600384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952207.976884:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465600384:12345-0@lo:400:kworker.0 Request processed in 61us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952207.976891:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:1.0:1783952207.976906:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:1.0:1783952207.976912:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465600000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952207.976973:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465600000:12345-0@lo:400:kworker.0 Request processed in 61us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952207.976979:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00080000:1.0:1783952207.977013:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952207.977017:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783952207.977040:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1783952207.977048:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465599488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952207.977731:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465599488:12345-0@lo:400:kworker.0 Request processed in 32us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952207.977742:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1783952207.977764:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1783952207.977773:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465600512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952207.977807:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465600512:12345-0@lo:400:kworker.0 Request processed in 37us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952207.977812:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1783952207.977861:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465599488:0@lo:400:kworker.0 00000100:00100000:1.0:1783952207.977874:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465600000:0@lo:400:kworker.0 00000100:00100000:1.0:1783952207.977884:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465600512:0@lo:400:kworker.0 00000100:00100000:3.0:1783952207.980801:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968959 gen 2 00000100:00100000:3.0:1783952207.980827:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465600384:0@lo:400:kworker.0 00000100:00100000:1.0:1783952208.374884:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952208.375068:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952208.375113:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952208.375168:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952208.375196:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952208.375230:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447784576 00000100:00100000:1.0:1783952208.375239:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447784576 00000100:00100000:1.0:1783952208.375298:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447784448 00000100:00100000:1.0:1783952208.375301:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447784448 00000100:00100000:1.0:1783952208.375322:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2878 00000100:00100000:1.0:1783952208.375331:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447784576:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952208.375394:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447784576:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 65us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952208.375402:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2878 00000100:00100000:1.0:1783952208.375418:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2879 00000100:00100000:1.0:1783952208.375424:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447784448:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952208.375449:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447784448:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952208.375455:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2879 00000100:00100000:1.0:1783952208.375477:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447784320 00000100:00100000:1.0:1783952208.375482:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447784320 00000100:00100000:1.0:1783952208.375509:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447784192 00000100:00100000:1.0:1783952208.375512:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447784192 00000100:00100000:1.0:1783952208.375533:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1418 00000100:00100000:1.0:1783952208.375540:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447784320:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952208.375566:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2400:x1870605447784320:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952208.375572:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1418 00000100:00100000:1.0:1783952208.375582:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1419 00000100:00080000:2.0:1783952208.375809:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783952208.375814:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952208.375816:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952208.375830:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952208.376394:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447784192:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952208.376447:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447784192:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 858us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952208.376465:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1419 00000100:00100000:0.0:1783952208.377046:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447784064 00000100:00100000:0.0:1783952208.377054:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447784064 00000100:00100000:0.0:1783952208.377105:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 77 00000100:00100000:0.0:1783952208.377113:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447784064:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952208.377169:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447784064:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 57us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952208.377176:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 77 00010000:00010000:1.0:1783952208.418063:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952208.481575:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465600640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952208.481672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952208.482250:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783952208.482262:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465600768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952208.482297:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952208.482469:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465600640 00000100:00100000:2.0:1783952208.482477:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465600640 00000100:00100000:2.0:1783952208.482522:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247 00000100:00100000:2.0:1783952208.482531:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465600640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783952208.482564:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952208.482633:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465600640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952208.482641:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247 00000100:00100000:1.0:1783952208.482708:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465600768 00000100:00100000:1.0:1783952208.482713:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465600768 00000100:00100000:1.0:1783952208.482751:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:1.0:1783952208.482759:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465600768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783952208.482784:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445187584 avail 1298948096 00000100:00100000:1.0:1783952208.482833:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465600768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952208.482839:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00100000:3.0:1783952208.483328:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465600768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952208.483346:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465600640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952208.484409:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465600896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952208.484466:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952208.485371:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465600896 00000100:00100000:3.0:1783952208.485379:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465600896 00000100:00100000:3.0:1783952208.485434:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248 00000100:00100000:3.0:1783952208.485444:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465600896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783952208.485476:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952208.485545:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465600896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952208.485552:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248 00000100:00100000:0.0:1783952208.485766:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465600896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783952209.442045:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952209.507016:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465601024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783952209.507085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952209.507207:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465601024 00000100:00100000:2.0:1783952209.507215:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465601024 00000100:00100000:2.0:1783952209.507273:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249 00000100:00100000:2.0:1783952209.507282:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465601024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952209.507305:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952209.507353:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465601024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952209.507370:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249 00000100:00100000:2.0:1783952209.507416:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465601024:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783952209.507516:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783952209.509583:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783952209.509627:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465601152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952209.509690:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952209.509784:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465601152 00000100:00100000:1.0:1783952209.509791:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465601152 00000100:00100000:1.0:1783952209.509845:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250 00000100:00100000:1.0:1783952209.509852:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465601152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952209.509876:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952209.509922:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465601152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952209.509929:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250 00000100:00100000:1.0:1783952209.509972:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465601152:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783952209.510030:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783952210.465734:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783952211.222077:0:94988:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:1.0:1783952211.489504:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952212.514145:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952213.090125:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465601664:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090197:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090234:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465602176:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090261:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090279:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465602688:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090299:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090337:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1783952213.090343:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465601280:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090368:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090393:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465601792:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090413:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090428:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465602304:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090447:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090461:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465602816:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090480:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090502:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465601408:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090522:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090534:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465601920:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090553:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090568:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b046acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465602432:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090619:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090638:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783952213.090643:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465601536:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090663:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090676:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465602048:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090691:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090705:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b046acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465602560:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952213.090751:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465601664 00000100:00100000:3.0:1783952213.090758:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465601664 00000100:00100000:3.0:1783952213.090800:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465601792 00000100:00100000:3.0:1783952213.090809:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465601792 00000100:00100000:3.0:1783952213.090828:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465602304 00000100:00100000:3.0:1783952213.090830:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465602304 00000100:00100000:3.0:1783952213.090839:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465602816 00000100:00100000:3.0:1783952213.090840:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465602816 00000100:00100000:3.0:1783952213.090849:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465601408 00000100:00100000:3.0:1783952213.090850:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465601408 00000100:00100000:3.0:1783952213.090862:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465601536 00000100:00100000:3.0:1783952213.090864:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465601536 00000100:00100000:3.0:1783952213.090879:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1783952213.090887:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465601664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090936:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465601664:12345-0@lo:400:kworker.0 Request processed in 50us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.090943:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1783952213.090961:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1783952213.090967:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465601792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.090993:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465601792:12345-0@lo:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.090998:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1783952213.091010:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1783952213.091016:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465602304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091043:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465602304:12345-0@lo:400:kworker.0 Request processed in 27us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091048:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1783952213.091059:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1783952213.091065:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465602816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091104:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465602816:12345-0@lo:400:kworker.0 Request processed in 38us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091116:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1783952213.091128:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1783952213.091133:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465601408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091167:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465601408:12345-0@lo:400:kworker.0 Request processed in 34us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091173:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1783952213.091184:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1783952213.091190:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465601536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091215:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465601536:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091221:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1783952213.091240:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465602176 00000100:00100000:3.0:1783952213.091243:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465602176 00000100:00100000:3.0:1783952213.091267:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465602688 00000100:00100000:3.0:1783952213.091270:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465602688 00000100:00100000:3.0:1783952213.091286:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465602048 00000100:00100000:3.0:1783952213.091289:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465602048 00000100:00100000:3.0:1783952213.091302:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465602560 00000100:00100000:3.0:1783952213.091304:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465602560 00000100:00100000:3.0:1783952213.091317:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:3.0:1783952213.091323:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465602176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091351:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465602176:12345-0@lo:400:kworker.0 Request processed in 28us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091356:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:3.0:1783952213.091365:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:3.0:1783952213.091370:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465602688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091405:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465602688:12345-0@lo:400:kworker.0 Request processed in 35us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091410:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:3.0:1783952213.091421:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:3.0:1783952213.091427:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465602048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091449:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465602048:12345-0@lo:400:kworker.0 Request processed in 24us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091454:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:3.0:1783952213.091463:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1783952213.091468:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465602560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091490:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465602560:12345-0@lo:400:kworker.0 Request processed in 22us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091495:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1783952213.091516:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465601280 00000100:00100000:3.0:1783952213.091519:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465601280 00000100:00100000:3.0:1783952213.091540:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783952213.091547:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465601280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091575:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465601280:12345-0@lo:400:kworker.0 Request processed in 28us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091580:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783952213.091633:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465601920 00000100:00100000:3.0:1783952213.091636:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465601920 00000100:00100000:3.0:1783952213.091656:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465602432 00000100:00100000:3.0:1783952213.091658:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465602432 00000100:00100000:3.0:1783952213.091670:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:3.0:1783952213.091675:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465601920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091715:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465601920:12345-0@lo:400:kworker.0 Request processed in 40us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091721:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00100000:3.0:1783952213.091734:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:3.0:1783952213.091739:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1762f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465602432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091763:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1762f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465602432:12345-0@lo:400:kworker.0 Request processed in 24us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.091768:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00080000:3.0:1783952213.091796:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952213.091800:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952213.091803:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952213.091805:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952213.091845:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465601536:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091855:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465602048:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091863:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b046acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465602560:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091872:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465601408:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091880:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465601920:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091888:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b046acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465602432:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091922:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465601280:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091930:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465601792:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091939:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465602304:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091948:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465602816:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091965:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465601664:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091974:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465602176:0@lo:400:kworker.0 00000100:00100000:3.0:1783952213.091982:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465602688:0@lo:400:kworker.0 00000100:00100000:2.0:1783952213.093180:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783952213.093197:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465602944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783952213.093250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952213.093308:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465602944 00000100:00100000:2.0:1783952213.093314:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465602944 00000100:00100000:2.0:1783952213.093347:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:2.0:1783952213.093354:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465602944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783952213.093383:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:2.0:1783952213.093424:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465602944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952213.093431:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00100000:2.0:1783952213.093470:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465602944:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1783952213.219779:0:95036:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1783952213.501012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952213.501061:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952213.501120:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952213.501141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952213.501190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952213.501223:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447784704 00000100:00100000:2.0:1783952213.501233:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447784704 00000100:00100000:2.0:1783952213.501281:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:2.0:1783952213.501291:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447784704:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952213.501361:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447784704:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 72us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952213.501376:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 79 00000100:00100000:2.0:1783952213.501411:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447784960 00000100:00100000:2.0:1783952213.501415:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447784960 00000100:00100000:2.0:1783952213.501452:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447784832 00000100:00100000:2.0:1783952213.501454:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447784832 00000100:00100000:2.0:1783952213.501475:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1426 00000100:00100000:2.0:1783952213.501482:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2401:x1870605447784960:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952213.501513:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2401:x1870605447784960:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952213.501518:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1426 00000100:00100000:2.0:1783952213.501529:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1427 00000100:00100000:2.0:1783952213.501535:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2401:x1870605447784832:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952213.501557:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2401:x1870605447784832:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 23us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952213.501563:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1427 00000100:00100000:2.0:1783952213.501583:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447785216 00000100:00100000:2.0:1783952213.501604:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447785216 00000100:00100000:2.0:1783952213.501630:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447785088 00000100:00100000:2.0:1783952213.501633:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447785088 00000100:00100000:2.0:1783952213.501652:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2884 00000100:00100000:2.0:1783952213.501657:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447785216:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952213.501683:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447785216:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952213.501689:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2884 00000100:00100000:2.0:1783952213.501700:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2885 00000100:00100000:2.0:1783952213.501712:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447785088:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952213.501737:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447785088:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952213.501743:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2885 00000100:00080000:2.0:1783952213.502359:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952213.502365:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952213.502369:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783952213.502371:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783952213.541445:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952213.602289:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16e9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465603072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952213.602371:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952213.602515:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952213.602527:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465603200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952213.602556:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952213.603110:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465603328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952213.603145:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952213.603260:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465603200 00000100:00100000:1.0:1783952213.603268:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465603200 00000100:00100000:1.0:1783952213.603323:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465603328 00000100:00100000:1.0:1783952213.603326:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465603328 00000100:00100000:1.0:1783952213.603341:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251 00000100:00100000:1.0:1783952213.603348:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465603200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952213.603378:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952213.615462:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465603072 00000100:00100000:3.0:1783952213.615479:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465603072 00000100:00100000:3.0:1783952213.615544:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:3.0:1783952213.615554:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465603072:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952213.617446:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252 00000100:00100000:2.0:1783952213.617464:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465603328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783952213.617497:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952213.617571:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465603328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (14425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952213.617657:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252 00000004:00000024:3.0:1783952213.618727:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445187584 avail 1298948096 00000100:00100000:3.0:1783952213.618806:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465603072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3251us (16433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952213.618814:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00100000:3.0:1783952213.618880:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16e9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465603072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783952213.620382:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465603200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17028us (17819us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952213.620392:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251 00000100:00100000:0.0:1783952213.621942:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465603200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952213.622150:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465603328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783952214.561194:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952214.625209:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952214.625235:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465603456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952214.625304:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952214.625393:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465603456 00000100:00100000:0.0:1783952214.625400:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465603456 00000100:00100000:0.0:1783952214.625457:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253 00000100:00100000:0.0:1783952214.625466:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465603456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952214.625489:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952214.625535:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465603456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952214.625542:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253 00000100:00100000:1.0:1783952214.625713:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465603584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952214.625739:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952214.625886:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465603584 00000100:00100000:2.0:1783952214.625890:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465603584 00000100:00100000:2.0:1783952214.625919:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2254 00000100:00100000:2.0:1783952214.625925:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465603584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783952214.625945:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952214.625974:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465603584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952214.625979:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2254 00000100:00100000:1.0:1783952214.626199:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465603584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952214.626211:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465603456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952215.265998:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952215.266280:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447785344 00000100:00100000:0.0:1783952215.266290:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447785344 00000100:00100000:0.0:1783952215.266359:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1442 00000100:00100000:0.0:1783952215.266368:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:72868:x1870605447785344:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:0.0:1783952215.266405:0:66237:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445187584 avail 1298948096 00000100:00100000:0.0:1783952215.266478:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:72868:x1870605447785344:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 111us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952215.266500:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1442 00000100:00080000:2.0:1783952215.267192:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952215.274242:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952215.275208:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447785472 00000100:00100000:3.0:1783952215.275226:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447785472 00000100:00080000:2.0:1783952215.275285:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952215.275311:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1443 00000100:00100000:3.0:1783952215.275323:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:72868:x1870605447785472:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:3.0:1783952215.275364:0:67035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:3.0:1783952215.275434:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:72868:x1870605447785472:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 113us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952215.275442:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1443 00000100:00100000:2.0:1783952215.280673:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952215.280828:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447785600 00000100:00100000:1.0:1783952215.280838:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447785600 00000100:00100000:1.0:1783952215.280913:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2255 00000100:00100000:1.0:1783952215.280924:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04697e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:72868:x1870605447785600:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:1.0:1783952215.280967:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952215.281046:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04697e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:72868:x1870605447785600:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 124us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952215.281053:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2255 00000100:00080000:2.0:1783952215.281252:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952215.283731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952215.284147:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447785728 00000100:00100000:0.0:1783952215.284157:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447785728 00000100:00100000:0.0:1783952215.284229:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2256 00000100:00100000:0.0:1783952215.284239:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:72868:x1870605447785728:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:0.0:1783952215.284278:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952215.284352:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:72868:x1870605447785728:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 115us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952215.284359:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2256 00000100:00080000:2.0:1783952215.284432:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952215.324409:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952215.324612:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447785856 00000100:00100000:2.0:1783952215.324622:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447785856 00000100:00100000:2.0:1783952215.324688:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1444 00000100:00100000:2.0:1783952215.324697:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:71764:x1870605447785856:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1783952215.324718:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952215.324739:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031a00/0x22c73c7857bb636e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a51b expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.324814:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.324829:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.324842:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.324854:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb637c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.324860:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb637c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.324865:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb637c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325038:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031e00/0x22c73c7857bb6383 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325047:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031e00/0x22c73c7857bb6383 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325054:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031e00/0x22c73c7857bb6383 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952215.325095:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783952215.325099:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783952215.325131:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031e00/0x22c73c7857bb6383 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325144:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325150:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325297:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325305:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325311:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952215.325315:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325323:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325340:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:2.0:1783952215.325343:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952215.325348:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325354:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb6375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325368:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb637c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325374:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb637c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325380:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb637c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325385:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952215.325388:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb637c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325393:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb637c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325400:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff97b1584d4300) 00010000:00010000:2.0:1783952215.325402:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952215.325405:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb637c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325411:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb637c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325452:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031a00/0x22c73c7857bb636e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a51b expref: 9 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325465:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031e00/0x22c73c7857bb6383 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a51b expref: 8 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.325473:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b1584d4800) 00010000:00010000:2.0:1783952215.325475:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783952215.325478:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031e00, rc 0) 00000100:00100000:2.0:1783952215.325542:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71764:x1870605447785856:12345-192.168.202.48@tcp:101:bash.0 Request processed in 846us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952215.325549:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1444 00000100:00100000:1.0:1783952215.336785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952215.336886:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447785984 00000100:00100000:0.0:1783952215.336896:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447785984 00000100:00100000:0.0:1783952215.336957:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1445 00000100:00100000:0.0:1783952215.336968:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:71764:x1870605447785984:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1783952215.336988:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952215.337020:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb638a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a522 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337097:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337112:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337124:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337138:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb6398 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337160:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb6398 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337167:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb6398 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952215.337303:0:66237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66237:1870605465603712:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783952215.337358:0:66237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952215.337396:0:66237:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1429ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952215.337539:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465603712 00000100:00100000:2.0:1783952215.337544:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465603712 00000100:00100000:2.0:1783952215.337584:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:2.0:1783952215.337622:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66237:x1870605465603712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783952215.337683:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66237:x1870605465603712:12345-0@lo:1000:mdt00_001.0 Request processed in 62us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952215.337689:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:0.0:1783952215.337891:0:66237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66237:1870605465603712:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1783952215.337927:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc600/0x22c73c7857bb639f lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337937:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc600/0x22c73c7857bb639f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337945:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc600/0x22c73c7857bb639f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952215.337968:0:66237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc600/0x22c73c7857bb639f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337979:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337985:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.337991:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338634:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338644:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbdc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952215.338648:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338657:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338670:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b1584d4800) 00010000:00010000:0.0:1783952215.338673:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952215.338677:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338684:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6391 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338697:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb6398 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338703:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb6398 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338709:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb6398 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338715:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbde00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952215.338718:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb6398 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338735:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb6398 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338743:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff97b176ee0300) 00010000:00010000:0.0:1783952215.338745:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952215.338747:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb6398 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338753:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbde00/0x22c73c7857bb6398 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338790:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb638a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a522 expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338803:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc600/0x22c73c7857bb639f lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a522 expref: 9 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.338811:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b176ee0100) 00010000:00010000:0.0:1783952215.338813:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783952215.338815:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc600, rc 0) 00000100:00100000:0.0:1783952215.338872:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:71764:x1870605447785984:12345-192.168.202.48@tcp:101:bash.0 Request processed in 1906us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952215.338879:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1445 00000100:00100000:3.0:1783952215.348709:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952215.348797:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447786112 00000100:00100000:0.0:1783952215.348808:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447786112 00000100:00100000:0.0:1783952215.348863:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1446 00000100:00100000:0.0:1783952215.348871:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:71764:x1870605447786112:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1783952215.348903:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952215.348923:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc000/0x22c73c7857bb63a6 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a529 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.348987:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb63ad lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.348999:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb63ad lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.349009:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb63ad lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952215.349077:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1783952215.349081:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783952215.349125:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc000/0x22c73c7857bb63a6 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a529 expref: 11 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.349138:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb63ad lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a529 expref: 10 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.349144:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44700) 00010000:00010000:0.0:1783952215.349147:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1783952215.349149:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbde00, rc 0) 00000100:00100000:0.0:1783952215.349209:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71764:x1870605447786112:12345-192.168.202.48@tcp:101:bash.0 Request processed in 339us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952215.349216:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1446 00000100:00100000:3.0:1783952215.354793:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952215.354858:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952215.354969:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447786368 00000100:00100000:0.0:1783952215.354977:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447786368 00000100:00100000:0.0:1783952215.355042:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1447 00000100:00100000:0.0:1783952215.355053:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71764:x1870605447786368:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1783952215.355084:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952215.355102:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc000/0x22c73c7857bb63b4 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a530 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355158:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355172:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355183:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355198:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63c2 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355205:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63c2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355210:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63c2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355274:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc200/0x22c73c7857bb63c9 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355279:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc200/0x22c73c7857bb63c9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355283:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc200/0x22c73c7857bb63c9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952215.355325:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783952215.355328:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783952215.355343:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc200/0x22c73c7857bb63c9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355352:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc200/0x22c73c7857bb63c9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355358:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355363:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355367:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355371:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355375:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbdc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952215.355378:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355383:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355391:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44700) 00010000:00010000:0.0:1783952215.355393:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952215.355396:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355406:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb63bb lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355416:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63c2 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355419:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63c2 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355423:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63c2 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355425:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbda00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952215.355427:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63c2 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355430:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63c2 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355434:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff97b176ee0300) 00010000:00010000:0.0:1783952215.355435:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952215.355437:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63c2 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355440:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63c2 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355471:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc000/0x22c73c7857bb63b4 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a530 expref: 12 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355490:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc200/0x22c73c7857bb63c9 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a530 expref: 11 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.355495:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff97b164ef8800) 00010000:00010000:0.0:1783952215.355496:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952215.355498:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc200, rc 0) 00000100:00100000:0.0:1783952215.355548:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:71764:x1870605447786368:12345-192.168.202.48@tcp:101:bash.0 Request processed in 498us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952215.355552:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1447 00000100:00100000:2.0:1783952215.355865:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447786240 00000100:00100000:2.0:1783952215.355870:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447786240 00000100:00100000:2.0:1783952215.355909:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 734 00000100:00100000:2.0:1783952215.355916:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15628e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447786240:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783952215.355925:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952215.355945:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb63ad lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a529 expref: 11 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.355962:0:26211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff97b146f44700) 00010000:00010000:2.0:1783952215.355964:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952215.355993:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15628e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2399:x1870605447786240:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 78us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952215.355999:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 734 00000100:00100000:3.0:1783952215.364846:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952215.364902:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447786496 00000100:00100000:1.0:1783952215.364922:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447786496 00000100:00100000:1.0:1783952215.365303:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4966 00000100:00100000:1.0:1783952215.365312:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b046acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447786496:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:1.0:1783952215.365328:0:8494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952215.365344:0:8494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb63d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a537 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952215.365364:0:8494:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x222:0x0] initial LVB size: 0, mtime: 0x6a54f324, atime: 0x6a54f324, ctime: 0x6a54f324, blocks: 0x0 00010000:00010000:1.0:1783952215.365381:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=3930s v=(0 0) 00010000:00010000:1.0:1783952215.365384:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x222:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952215.365390:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb63d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a537 expref: 6 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952215.365404:0:8494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a1cb29f/0x22c73c7857bb63d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a537 expref: 6 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952215.365412:0:8494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70000, rc 0) 00000100:00100000:1.0:1783952215.365511:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b046acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2400:x1870605447786496:12345-192.168.202.48@tcp:101:bash.0 Request processed in 152us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952215.365516:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4966 00000100:00100000:1.0:1783952215.368641:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952215.369415:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447786624 00000100:00100000:2.0:1783952215.369423:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447786624 00000100:00100000:2.0:1783952215.369568:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1448 00000100:00100000:2.0:1783952215.369576:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:71764:x1870605447786624:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1783952215.369623:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952215.369641:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031a00/0x22c73c7857bb63d7 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a53e expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.369692:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.369703:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.369711:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.369720:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb63e5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.369724:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb63e5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.369742:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb63e5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952215.369850:0:66236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66236:1870605465603840:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783952215.369897:0:66236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952215.369925:0:66236:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1472d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1783952215.370036:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465603840 00000100:00100000:3.0:1783952215.370042:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465603840 00000100:00100000:3.0:1783952215.370107:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:3.0:1783952215.370116:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66236:x1870605465603840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783952215.370212:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66236:x1870605465603840:12345-0@lo:1000:mdt00_000.0 Request processed in 97us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952215.370219:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00100000:2.0:1783952215.370372:0:66236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66236:1870605465603840:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783952215.370418:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030600/0x22c73c7857bb63ec lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370428:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030600/0x22c73c7857bb63ec lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370438:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030600/0x22c73c7857bb63ec lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952215.370459:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030600/0x22c73c7857bb63ec lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370472:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370478:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370485:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370492:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370510:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952215.370515:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370524:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370536:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff97b1584d4800) 00010000:00010000:2.0:1783952215.370539:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952215.370543:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370551:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb63de lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370565:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb63e5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370571:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb63e5 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370577:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb63e5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370582:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952215.370634:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb63e5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370642:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb63e5 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370661:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff97b1584d4300) 00010000:00010000:2.0:1783952215.370663:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952215.370666:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb63e5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370672:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031000/0x22c73c7857bb63e5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370707:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031a00/0x22c73c7857bb63d7 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a53e expref: 11 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370721:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030600/0x22c73c7857bb63ec lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a53e expref: 10 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.370729:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b1584d4100) 00010000:00010000:2.0:1783952215.370731:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783952215.370733:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030600, rc 0) 00000100:00100000:2.0:1783952215.370914:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71764:x1870605447786624:12345-192.168.202.48@tcp:101:bash.0 Request processed in 1337us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952215.370921:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1448 00000100:00100000:3.0:1783952215.373323:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952215.374537:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447786752 00000100:00100000:0.0:1783952215.374546:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447786752 00000100:00100000:0.0:1783952215.374627:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1449 00000100:00100000:0.0:1783952215.374637:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b046acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:71764:x1870605447786752:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1783952215.374655:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952215.374673:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc000/0x22c73c7857bb63f3 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a545 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.374720:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63fa lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.374732:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63fa lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.374741:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63fa lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952215.374778:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783952215.374794:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783952215.374837:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbc000/0x22c73c7857bb63f3 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a545 expref: 12 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.374854:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63fa lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a545 expref: 11 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.374860:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b16048b700) 00010000:00010000:0.0:1783952215.374863:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1783952215.374865:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbda00, rc 0) 00000100:00100000:0.0:1783952215.374914:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b046acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:71764:x1870605447786752:12345-192.168.202.48@tcp:101:bash.0 Request processed in 279us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952215.374921:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1449 00000100:00100000:2.0:1783952215.385271:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952215.385313:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952215.385407:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447786880 00000100:00100000:3.0:1783952215.385415:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447787008 00000100:00100000:0.0:1783952215.385418:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447786880 00000100:00100000:3.0:1783952215.385422:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447787008 00000100:00100000:3.0:1783952215.385516:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 735 00000100:00100000:3.0:1783952215.385528:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:2400:x1870605447787008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783952215.385546:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783952215.385571:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1450 00010000:00010000:3.0:1783952215.385575:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbda00/0x22c73c7857bb63fa lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a545 expref: 12 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952215.385605:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:71764:x1870605447786880:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:0.0:1783952215.385625:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952215.385626:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b16048b700) 00010000:00010000:3.0:1783952215.385632:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952215.385641:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6401 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a54c expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952215.385697:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:2400:x1870605447787008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 172us (382us total) trans 0 rc 0/0 00010000:00010000:0.0:1783952215.385703:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952215.385706:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 735 00010000:00010000:0.0:1783952215.385722:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385732:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385765:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbd600/0x22c73c7857bb640f lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385773:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbd600/0x22c73c7857bb640f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385780:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbd600/0x22c73c7857bb640f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385856:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb6416 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385864:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb6416 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385870:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb6416 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952215.385909:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x5:0x0]: returning size 0 00000004:00200000:0.0:1783952215.385913:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783952215.385931:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb6416 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385961:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb6416 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385971:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385977:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.385993:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386000:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386006:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbce00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952215.386022:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386030:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386040:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff97b16048b700) 00010000:00010000:0.0:1783952215.386043:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952215.386046:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386053:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbce00/0x22c73c7857bb6408 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386074:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbd600/0x22c73c7857bb640f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386080:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbd600/0x22c73c7857bb640f lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386087:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbd600/0x22c73c7857bb640f lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386092:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952215.386101:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbd600/0x22c73c7857bb640f lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386109:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbd600/0x22c73c7857bb640f lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386116:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff97b176ee0300) 00010000:00010000:0.0:1783952215.386119:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952215.386121:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbd600/0x22c73c7857bb640f lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386126:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbd600/0x22c73c7857bb640f lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386155:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbdc00/0x22c73c7857bb6401 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a54c expref: 12 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386168:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff97b050cbde00/0x22c73c7857bb6416 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a54c expref: 11 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952215.386175:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff97b1767edb00) 00010000:00010000:0.0:1783952215.386178:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952215.386181:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbde00, rc 0) 00000100:00100000:0.0:1783952215.386209:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:71764:x1870605447786880:12345-192.168.202.48@tcp:101:bash.0 Request processed in 630us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952215.386216:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1450 00000100:00100000:1.0:1783952215.394580:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952215.394814:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447787136 00000100:00100000:2.0:1783952215.394826:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447787136 00000100:00100000:2.0:1783952215.394882:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4967 00000100:00100000:2.0:1783952215.394893:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2400:x1870605447787136:12345-192.168.202.48@tcp:101:bash.0 00010000:00010000:2.0:1783952215.394913:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952215.394946:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb641d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a553 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952215.394973:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x223:0x0] initial LVB size: 0, mtime: 0x6a54f324, atime: 0x6a54f324, ctime: 0x6a54f324, blocks: 0x0 00010000:00010000:2.0:1783952215.394994:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x223:0x0].0x0 since=3930s v=(0 0) 00010000:00010000:2.0:1783952215.394999:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x223:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952215.395009:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb641d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a553 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.395027:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da1a206/0x22c73c7857bb641d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a553 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952215.395040:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031a00, rc 0) 00000100:00100000:2.0:1783952215.395112:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447787136:12345-192.168.202.48@tcp:101:bash.0 Request processed in 220us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952215.395119:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4967 00010000:00010000:1.0:1783952215.585298:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952216.609272:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952217.632917:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952218.209095:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465603968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952218.209173:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952218.209439:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465604224:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.209474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952218.209509:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465604736:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.209533:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952218.209550:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465605248:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.209577:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952218.209618:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783952218.209624:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465604352:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.209646:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952218.209660:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465604864:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.209679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952218.209696:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465605376:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.209714:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952218.209742:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465604224 00000100:00100000:0.0:1783952218.209749:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465604224 00000100:00100000:0.0:1783952218.209798:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465604352 00000100:00100000:0.0:1783952218.209801:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465604352 00000100:00100000:0.0:1783952218.209821:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:0.0:1783952218.209829:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465604224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.209880:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465604224:12345-0@lo:400:kworker.0 Request processed in 52us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.209886:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:0.0:1783952218.209900:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1783952218.209906:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465604352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.209931:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465604352:12345-0@lo:400:kworker.0 Request processed in 25us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.209936:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1783952218.209954:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465603968 00000100:00100000:0.0:1783952218.209964:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465603968 00000100:00100000:0.0:1783952218.209986:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465604736 00000100:00100000:0.0:1783952218.209989:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465604736 00000100:00100000:0.0:1783952218.210014:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:0.0:1783952218.210020:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465603968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783952218.210054:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:0.0:1783952218.210086:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465603968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.210092:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:0.0:1783952218.210107:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:0.0:1783952218.210112:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465604736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.210135:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465604736:12345-0@lo:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.210140:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:0.0:1783952218.210157:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465605248 00000100:00100000:0.0:1783952218.210159:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465605248 00000100:00100000:0.0:1783952218.210177:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465604864 00000100:00100000:0.0:1783952218.210179:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465604864 00000100:00100000:0.0:1783952218.210189:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465605376 00000100:00100000:0.0:1783952218.210191:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465605376 00000100:00100000:0.0:1783952218.210202:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:0.0:1783952218.210206:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465605248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.210230:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465605248:12345-0@lo:400:kworker.0 Request processed in 24us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.210235:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:0.0:1783952218.210244:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:0.0:1783952218.210248:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465604864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.210266:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465604864:12345-0@lo:400:kworker.0 Request processed in 18us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.210276:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00100000:0.0:1783952218.210284:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:0.0:1783952218.210288:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465605376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.210308:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465605376:12345-0@lo:400:kworker.0 Request processed in 20us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.210313:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00080000:0.0:1783952218.210328:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783952218.210331:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952218.210333:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952218.210335:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952218.210362:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465604352:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.210371:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465604864:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.210377:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465605376:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.210385:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465604224:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.210391:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465604736:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.210397:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465605248:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210499:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465604096:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210536:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952218.210577:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465604608:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210627:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952218.210643:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465605120:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210664:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952218.210678:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783952218.210683:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465604480:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210699:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952218.210711:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465604992:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210729:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952218.210742:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465605504:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210763:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952218.210783:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465604608 00000100:00100000:1.0:1783952218.210785:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465604608 00000100:00100000:1.0:1783952218.210806:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465605120 00000100:00100000:1.0:1783952218.210807:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465605120 00000100:00100000:1.0:1783952218.210813:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465604480 00000100:00100000:1.0:1783952218.210815:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465604480 00000100:00100000:1.0:1783952218.210821:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465605504 00000100:00100000:1.0:1783952218.210822:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465605504 00000100:00100000:1.0:1783952218.210829:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1783952218.210833:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465604608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210854:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465604608:12345-0@lo:400:kworker.0 Request processed in 21us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952218.210858:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1783952218.210866:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1783952218.210869:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465605120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210882:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465605120:12345-0@lo:400:kworker.0 Request processed in 13us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952218.210890:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1783952218.210897:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1783952218.210900:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465604480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210917:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465604480:12345-0@lo:400:kworker.0 Request processed in 16us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952218.210920:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1783952218.210925:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1783952218.210928:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465605504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210941:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465605504:12345-0@lo:400:kworker.0 Request processed in 12us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952218.210944:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00080000:1.0:1783952218.210954:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783952218.210956:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952218.210967:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465604480:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210972:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465605504:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210977:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465604608:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.210983:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465605120:0@lo:400:kworker.0 00000100:00100000:3.0:1783952218.211110:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465604992 00000100:00100000:3.0:1783952218.211113:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465604992 00000100:00100000:3.0:1783952218.211153:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:3.0:1783952218.211158:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465604992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952218.211187:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465604992:12345-0@lo:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952218.211190:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:3.0:1783952218.211221:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465603968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952218.211234:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465604992:0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.211308:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465604096 00000100:00100000:0.0:1783952218.211311:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465604096 00000100:00080000:1.0:1783952218.211366:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952218.211404:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783952218.211410:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465604096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952218.211444:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465604096:12345-0@lo:400:kworker.0 Request processed in 34us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.211449:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783952218.211513:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465604096:0@lo:400:kworker.0 00000100:00100000:1.0:1783952218.607321:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952218.607369:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952218.607467:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447787264 00000100:00100000:2.0:1783952218.607477:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447787264 00000100:00100000:2.0:1783952218.607539:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:2.0:1783952218.607549:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447787264:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952218.607652:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447787264:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 104us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952218.607661:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 81 00000100:00100000:3.0:1783952218.607825:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447787392 00000100:00100000:3.0:1783952218.607829:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447787392 00000100:00100000:3.0:1783952218.607888:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1434 00000100:00100000:3.0:1783952218.607897:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2398:x1870605447787392:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952218.607929:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2398:x1870605447787392:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 35us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952218.607935:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1434 00000100:00080000:1.0:1783952218.608099:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952218.615850:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952218.615900:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952218.616065:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447787648 00000100:00100000:1.0:1783952218.616076:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447787648 00000100:00100000:1.0:1783952218.616162:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2890 00000100:00100000:1.0:1783952218.616180:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447787648:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952218.616254:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447787648:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 77us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952218.616262:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2890 00000100:00080000:2.0:1783952218.616489:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952218.616637:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952218.620813:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447787776 00000100:00100000:2.0:1783952218.620828:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447787776 00000100:00100000:2.0:1783952218.620952:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2891 00000100:00100000:2.0:1783952218.620962:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447787776:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952218.621083:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447787776:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 122us (4445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952218.621090:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2891 00000100:00080000:1.0:1783952218.622118:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952218.623800:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447787520 00000100:00100000:0.0:1783952218.623814:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447787520 00000100:00080000:1.0:1783952218.623870:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952218.623904:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1435 00000100:00100000:0.0:1783952218.623915:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447787520:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952218.624002:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447787520:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 88us (8100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.624010:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1435 00010000:00010000:0.0:1783952218.657257:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952218.721072:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952218.721098:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14debad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465605632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952218.721169:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952218.721225:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465605632 00000100:00100000:0.0:1783952218.721233:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465605632 00000100:00100000:0.0:1783952218.721293:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257 00000100:00100000:0.0:1783952218.721303:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465605632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783952218.721331:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952218.721376:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465605632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.721384:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257 00000100:00100000:0.0:1783952218.721431:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14debad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465605632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952218.721584:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952218.721613:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465605760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952218.721643:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952218.721670:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465605760 00000100:00100000:1.0:1783952218.721674:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465605760 00000100:00100000:1.0:1783952218.721697:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258 00000100:00100000:1.0:1783952218.721702:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465605760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783952218.721718:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952218.721750:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465605760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952218.721755:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258 00000100:00100000:1.0:1783952218.721784:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465605760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952218.724917:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465605888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783952218.724991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952218.725115:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465605888 00000100:00100000:0.0:1783952218.725123:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465605888 00000100:00100000:0.0:1783952218.725176:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:0.0:1783952218.725185:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465605888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783952218.725221:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445187584 avail 1298948096 00000100:00100000:0.0:1783952218.725269:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465605888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952218.725286:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:0.0:1783952218.725330:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465605888:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783952219.687814:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952219.744859:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14debad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465606016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952219.744931:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952219.744986:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465606016 00000100:00100000:1.0:1783952219.744993:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465606016 00000100:00100000:1.0:1783952219.745046:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259 00000100:00100000:1.0:1783952219.745055:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465606016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952219.745086:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952219.745127:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465606016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952219.745134:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259 00000100:00100000:1.0:1783952219.745177:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14debad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465606016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952219.746274:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465606144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952219.746319:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952219.749850:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465606144 00000100:00100000:0.0:1783952219.749866:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465606144 00000100:00100000:0.0:1783952219.749938:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:0.0:1783952219.749948:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465606144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952219.749977:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952219.750065:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465606144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952219.750073:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00000100:00100000:1.0:1783952219.750169:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465606144:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783952220.704941:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952221.749200:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952222.752805:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952223.328954:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465606272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952223.329039:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952223.329620:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465606272 00000100:00100000:2.0:1783952223.329629:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465606272 00000100:00100000:2.0:1783952223.329697:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:2.0:1783952223.329707:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465606272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783952223.329746:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:2.0:1783952223.329802:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465606272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952223.329809:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00100000:3.0:1783952223.330064:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465606528:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.330107:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952223.330124:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465607040:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.330145:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952223.330156:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465607552:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.330194:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952223.330212:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783952223.330216:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465606656:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.330664:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952223.330782:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465606528 00000100:00100000:2.0:1783952223.330788:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465606528 00000100:00100000:2.0:1783952223.330830:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465606656 00000100:00100000:2.0:1783952223.330834:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465606656 00000100:00100000:2.0:1783952223.330854:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1783952223.330862:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465606528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952223.330915:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465606528:12345-0@lo:400:kworker.0 Request processed in 54us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952223.330922:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1783952223.330936:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1783952223.330942:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465606656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.331034:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465607168:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.331061:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952223.331080:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465607680:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.331190:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465607040 00000100:00100000:0.0:1783952223.331194:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465607040 00000100:00100000:0.0:1783952223.331226:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:0.0:1783952223.331390:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465607040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.331428:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465607040:12345-0@lo:400:kworker.0 Request processed in 196us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952223.331434:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:3.0:1783952223.331945:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952223.332006:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465606528:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.332019:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465607040:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.332063:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465607552 00000100:00100000:3.0:1783952223.332067:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465607552 00000100:00100000:0.0:1783952223.332461:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465606784:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.332599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952223.332619:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465607296:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.332642:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952223.332659:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465607808:0@lo:400:kworker.0 00000100:00100000:2.0:1783952223.332790:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465606656:12345-0@lo:400:kworker.0 Request processed in 1846us (2124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952223.332808:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1783952223.332831:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465606784 00000100:00100000:2.0:1783952223.332835:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465606784 00000100:00100000:2.0:1783952223.332875:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1783952223.332884:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465606784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952223.332920:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465606784:12345-0@lo:400:kworker.0 Request processed in 39us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952223.332926:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1783952223.332961:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465607168 00000100:00100000:2.0:1783952223.332965:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465607168 00000100:00100000:2.0:1783952223.333000:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465607680 00000100:00100000:2.0:1783952223.333003:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465607680 00000100:00100000:2.0:1783952223.333020:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465607296 00000100:00100000:2.0:1783952223.333023:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465607296 00000100:00100000:2.0:1783952223.333042:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:2.0:1783952223.333048:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465607168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952223.333079:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465607168:12345-0@lo:400:kworker.0 Request processed in 31us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952223.333098:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00000100:00100000:2.0:1783952223.333110:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:2.0:1783952223.333115:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465607680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952223.333144:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465607680:12345-0@lo:400:kworker.0 Request processed in 29us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952223.334941:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952223.335026:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465606272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952223.335062:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465606784:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.335073:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783952223.335082:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465606400:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.335111:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952223.335135:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465606912:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.335152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952223.335168:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465607424:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.335188:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952223.335213:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465607808 00000100:00100000:0.0:1783952223.335218:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465607808 00000100:00100000:0.0:1783952223.335247:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465606912 00000100:00100000:0.0:1783952223.335250:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465606912 00000100:00100000:0.0:1783952223.335262:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465607424 00000100:00100000:0.0:1783952223.335264:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465607424 00000100:00100000:0.0:1783952223.335274:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1783952223.335280:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465607808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.335322:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465607808:12345-0@lo:400:kworker.0 Request processed in 42us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952223.335328:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:3.0:1783952223.335449:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:3.0:1783952223.335458:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465607296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.335508:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465607296:12345-0@lo:400:kworker.0 Request processed in 53us (2865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952223.335514:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:3.0:1783952223.335527:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1783952223.335533:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465607552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.335559:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465607552:12345-0@lo:400:kworker.0 Request processed in 27us (5364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952223.335565:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:2.0:1783952223.336439:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00080000:2.0:1783952223.336612:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952223.336617:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952223.336620:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952223.336635:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952223.336653:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1783952223.336663:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465606912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.336860:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:3.0:1783952223.336870:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465607424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.336924:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465607424:12345-0@lo:400:kworker.0 Request processed in 56us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952223.336931:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1783952223.337182:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465606912:12345-0@lo:400:kworker.0 Request processed in 522us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952223.337189:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1783952223.337336:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465606400 00000100:00100000:0.0:1783952223.337343:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465606400 00000100:00100000:0.0:1783952223.337375:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783952223.337382:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465606400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.337414:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465606400:12345-0@lo:400:kworker.0 Request processed in 33us (2302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952223.337426:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783952223.338211:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465606656:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.338225:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465607168:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.338309:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465607680:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.338323:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465607552:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.339023:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465606400:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.339037:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465606912:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.339049:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465607424:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.339060:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465607296:0@lo:400:kworker.0 00000100:00100000:0.0:1783952223.339071:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465607808:0@lo:400:kworker.0 00000100:00100000:3.0:1783952223.727530:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952223.727567:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952223.727621:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952223.727641:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952223.727659:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952223.727694:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447788160 00000100:00100000:3.0:1783952223.727703:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447788160 00000100:00100000:3.0:1783952223.727760:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447788032 00000100:00100000:3.0:1783952223.727763:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447788032 00000100:00100000:3.0:1783952223.727788:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1442 00000100:00100000:3.0:1783952223.727798:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447788160:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952223.727863:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447788160:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 66us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952223.727870:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1442 00000100:00100000:3.0:1783952223.727886:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1443 00000100:00100000:3.0:1783952223.727891:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2399:x1870605447788032:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952223.727911:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2399:x1870605447788032:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 20us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952223.727930:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1443 00000100:00100000:2.0:1783952223.728036:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447787904 00000100:00100000:2.0:1783952223.728041:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447787904 00000100:00100000:2.0:1783952223.728073:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:2.0:1783952223.728088:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2399:x1870605447787904:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952223.728113:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2399:x1870605447787904:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 35us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952223.728119:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 83 00000100:00100000:3.0:1783952223.728224:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447788416 00000100:00100000:3.0:1783952223.728228:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447788416 00000100:00100000:3.0:1783952223.728256:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447788288 00000100:00100000:3.0:1783952223.728259:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447788288 00000100:00100000:3.0:1783952223.728277:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2896 00000100:00100000:3.0:1783952223.728282:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447788416:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952223.728306:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447788416:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 24us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952223.728312:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2896 00000100:00100000:3.0:1783952223.728321:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2897 00000100:00100000:3.0:1783952223.728326:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447788288:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952223.728341:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447788288:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 16us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952223.728346:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2897 00000100:00080000:3.0:1783952223.728361:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952223.728365:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952223.728367:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783952223.728369:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783952223.779066:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952223.842228:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952223.842252:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465607936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952223.842325:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952223.842824:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465607936 00000100:00100000:1.0:1783952223.842832:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465607936 00000100:00100000:1.0:1783952223.842881:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261 00000100:00100000:1.0:1783952223.842892:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465607936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952223.842923:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952223.843062:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465607936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952223.843069:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261 00000100:00100000:1.0:1783952223.843175:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465608064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783952223.843207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952223.843231:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783952223.843237:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465608192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952223.843260:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952223.843288:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465608192 00000100:00100000:1.0:1783952223.843291:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465608192 00000100:00100000:1.0:1783952223.843314:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262 00000100:00100000:1.0:1783952223.843330:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465608192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783952223.843347:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952223.843381:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465608192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952223.843387:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262 00000100:00100000:1.0:1783952223.843427:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465607936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952223.843455:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465608064 00000100:00100000:1.0:1783952223.843458:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465608064 00000100:00100000:1.0:1783952223.843485:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:1.0:1783952223.843491:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465608064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783952223.843516:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445187584 avail 1298948096 00000100:00100000:1.0:1783952223.843547:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465608064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952223.843553:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00100000:1.0:1783952223.843608:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465608192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952223.843621:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465608064:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783952224.802336:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952224.865333:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952224.865360:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465608320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952224.865429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952224.865474:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465608320 00000100:00100000:1.0:1783952224.865481:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465608320 00000100:00100000:1.0:1783952224.865525:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263 00000100:00100000:1.0:1783952224.865533:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465608320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952224.865554:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952224.865635:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465608320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952224.865643:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263 00000100:00100000:1.0:1783952224.866308:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465608320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952224.867246:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465608448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952224.867301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952224.874092:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465608448 00000100:00100000:0.0:1783952224.874106:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465608448 00000100:00100000:0.0:1783952224.874164:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264 00000100:00100000:0.0:1783952224.874173:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465608448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952224.874199:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952224.874284:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465608448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (6983us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.874291:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264 00000100:00100000:1.0:1783952224.874696:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465608448:0@lo:13:osp-pre-1-1.0 00000020:00000080:0.0:1783952224.964422:0:95329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc6f3941b0 20000000:00000080:0.0:1783952224.964949:0:95329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff97b14de0d000 uarg=0000000000000000 00000040:00100000:0.0:1783952224.965578:0:95329:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 49 20000000:01000000:0.0:1783952224.965584:0:95329:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1783952224.965930:0:95329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1783952224.966925:0:95330:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 55 marker 45 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:2.0:1783952224.967221:0:95330:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 57 marker 45 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1783952224.967234:0:95330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:0.0:1783952224.967506:0:95329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:0.0:1783952224.967522:0:95329:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783952224.967554:0:95329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:0.0:1783952224.967572:0:95329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:0.0:1783952224.967848:0:95329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1783952224.968886:0:95331:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 46 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1783952224.968932:0:95331:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 46 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1783952224.968946:0:95331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:2.0:1783952224.969263:0:95329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:2.0:1783952224.969277:0:95329:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1783952224.969292:0:95329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:2.0:1783952224.969307:0:95329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:2.0:1783952224.969319:0:95329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1783952224.970301:0:95332:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 47 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:2.0:1783952224.970343:0:95332:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 47 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1783952224.970354:0:95332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:1.0:1783952224.972486:0:95329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:1.0:1783952224.972509:0:95329:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1783952224.972527:0:95329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:1.0:1783952224.972544:0:95329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:1.0:1783952224.972558:0:95329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783952224.972577:0:95329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.972872:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb5f62 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.972881:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b1762af600/0x22c73c7857bb6049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6042 expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.972888:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb6081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb607a expref: 23 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973166:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb609d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6096 expref: 23 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973177:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb60c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60c0 expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973203:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb60d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60ce expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973210:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b04db70800/0x22c73c7857bb60f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60ea expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973217:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b175a14600/0x22c73c7857bb60ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60f8 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973224:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb6129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6122 expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973233:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb6137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ff expref: 9 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973240:0:95329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb6145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a50d expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973247:0:95329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973460:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb6145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a50d expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973479:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb6145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a50d expref: 9 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.973495:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465608576:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783952224.973822:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb6137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ff expref: 9 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973839:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb6137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ff expref: 9 pid: 94411 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.973848:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465608704:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783952224.973883:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb6129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb6122 expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.973903:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb6129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb6122 expref: 23 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.973912:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465608832:0@lo:104: 00000100:00100000:1.0:1783952224.973952:0:95329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952224.974027:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b175a14600/0x22c73c7857bb60ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb60f8 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.974035:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b175a14600/0x22c73c7857bb60ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb60f8 expref: 23 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.974044:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465608960:0@lo:104: 00000100:00100000:1.0:1783952224.974065:0:95329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952224.982733:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b04db70800/0x22c73c7857bb60f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb60ea expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.982753:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b04db70800/0x22c73c7857bb60f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb60ea expref: 23 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.982768:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609088:0@lo:104: 00000100:00100000:1.0:1783952224.982826:0:95329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952224.983744:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952224.983808:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952224.984437:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447788544 00000100:00100000:3.0:1783952224.984447:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447788544 00010000:00010000:3.0:1783952224.984484:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb6145 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a50d expref: 10 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952224.984515:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447788672 00000100:00100000:3.0:1783952224.984528:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447788672 00010000:00010000:3.0:1783952224.984542:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb6137 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ff expref: 11 pid: 94411 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952224.984564:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2582 00000100:00100000:3.0:1783952224.984573:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e617e28a-7c0f-459e-8765-f628898cec50+11:2401:x1870605447788544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783952224.984601:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952224.984607:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb6145 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a50d expref: 11 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.984620:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb6145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a50d expref: 11 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.984641:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952224.984699:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e617e28a-7c0f-459e-8765-f628898cec50+11:2401:x1870605447788544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 127us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952224.984707:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2582 00000100:00100000:3.0:1783952224.984726:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2583 00000100:00100000:3.0:1783952224.984733:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447788672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783952224.984740:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952224.984745:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb6137 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ff expref: 10 pid: 94411 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.984752:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb6137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ff expref: 10 pid: 94411 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.984762:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952224.984780:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447788672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952224.984793:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2583 00000100:00100000:0.0:1783952224.986425:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465608832 00000100:00100000:0.0:1783952224.986437:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465608832 00000100:00100000:0.0:1783952224.986487:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465608960 00000100:00100000:0.0:1783952224.986491:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465608960 00000100:00100000:0.0:1783952224.986506:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1783952224.986529:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:95329:x1870605465608832:12345-0@lo:104: 00010000:00010000:0.0:1783952224.986545:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.986635:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783952224.986641:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:95329:x1870605465608832:12345-0@lo:104: Request processed in 130us (12690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.986647:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1783952224.986662:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00010000:00010000:3.0:1783952224.986788:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952224.986795:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.986804:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70600 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952224.986808:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.986817:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952224.986825:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952224.986831:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952224.986865:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.986872:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952224.986891:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.986899:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb6122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6129 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.986913:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952224.986915:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952224.986917:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952224.986938:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465609216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952224.986999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952224.987050:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465609216 00000100:00100000:3.0:1783952224.987054:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465609216 00010000:00010000:1.0:1783952224.987410:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb60d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb60ce expref: 24 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.987423:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb60d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb60ce expref: 24 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.987434:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609344:0@lo:104: 00000100:00100000:1.0:1783952224.987461:0:95329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952224.987481:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb60c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb60c0 expref: 24 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.987489:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb60c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb60c0 expref: 24 pid: 94411 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.987496:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144916d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609472:0@lo:104: 00000100:00100000:1.0:1783952224.987517:0:95329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952224.987535:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb609d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb6096 expref: 24 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.987543:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb609d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb6096 expref: 24 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.987551:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609600:0@lo:104: 00000100:00100000:1.0:1783952224.987573:0:95329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952224.987603:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb6081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb607a expref: 24 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.987612:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb6081 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb607a expref: 24 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.987620:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609728:0@lo:104: 00010000:00010000:1.0:1783952224.987656:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b1762af600/0x22c73c7857bb6049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb6042 expref: 24 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.987665:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b1762af600/0x22c73c7857bb6049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb6042 expref: 24 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.987687:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609856:0@lo:104: 00010000:00010000:1.0:1783952224.987710:0:95329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb5f62 expref: 24 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.987717:0:95329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb5f62 expref: 24 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.987725:0:95329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609984:0@lo:104: 00000100:00100000:1.0:1783952224.987744:0:95329:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04676c240 going to sleep for 11 seconds 00010000:00010000:1.0:1783952224.987767:0:95329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b047b2d600/0x22c73c7857bb6145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a50d expref: 9 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.987778:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465608576:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783952224.987789:0:95329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762ae800/0x22c73c7857bb6137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4ff expref: 8 pid: 94411 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952224.987799:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465608704:192.168.202.48@tcp:104: 00000100:00100000:1.0:1783952224.987808:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465608832:0@lo:104: 00000100:00100000:0.0:1783952224.987930:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95329:x1870605465608960:12345-0@lo:104: 00010000:00010000:0.0:1783952224.987941:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.988003:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783952224.988009:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95329:x1870605465608960:12345-0@lo:104: Request processed in 86us (13943us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.988016:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1783952224.988050:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783952224.988066:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952224.988088:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952224.988096:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952224.988103:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465609088 00000100:00100000:0.0:1783952224.988107:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465609088 00000100:00100000:0.0:1783952224.988127:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465609344 00000100:00100000:0.0:1783952224.988129:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465609344 00000100:00100000:0.0:1783952224.988137:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465609472 00000100:00100000:0.0:1783952224.988139:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465609472 00000100:00100000:0.0:1783952224.988146:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465609600 00000100:00100000:0.0:1783952224.988148:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465609600 00000100:00100000:0.0:1783952224.988169:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465609728 00000100:00100000:0.0:1783952224.988172:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465609728 00000100:00100000:0.0:1783952224.988179:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465609856 00000100:00100000:0.0:1783952224.988181:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465609856 00000100:00100000:0.0:1783952224.988189:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465609984 00000100:00100000:0.0:1783952224.988191:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465609984 00000100:00100000:0.0:1783952224.988202:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1783952224.988207:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:95329:x1870605465609088:12345-0@lo:104: 00010000:00010000:0.0:1783952224.988215:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.988248:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783952224.988252:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+9:95329:x1870605465609088:12345-0@lo:104: Request processed in 45us (5427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.988257:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1783952224.988269:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1783952224.988275:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:95329:x1870605465609344:12345-0@lo:104: 00010000:00010000:0.0:1783952224.988282:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.988330:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783952224.988336:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+8:95329:x1870605465609344:12345-0@lo:104: Request processed in 61us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.988342:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1783952224.988354:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1783952224.988360:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:95329:x1870605465609472:12345-0@lo:104: 00010000:00010000:0.0:1783952224.988367:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.988399:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783952224.988404:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+7:95329:x1870605465609472:12345-0@lo:104: Request processed in 45us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.988410:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1783952224.988421:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1783952224.988426:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15154e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:95329:x1870605465609600:12345-0@lo:104: 00010000:00010000:0.0:1783952224.988434:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.988458:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783952224.988462:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15154e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:95329:x1870605465609600:12345-0@lo:104: Request processed in 37us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.988468:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1783952224.988500:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1783952224.988505:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:95329:x1870605465609728:12345-0@lo:104: 00010000:00010000:0.0:1783952224.988512:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.988545:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1783952224.988550:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:95329:x1870605465609728:12345-0@lo:104: Request processed in 46us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.988555:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1783952224.988568:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1783952224.988573:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:95329:x1870605465609856:12345-0@lo:104: 00010000:00010000:0.0:1783952224.988580:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.988630:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1783952224.988635:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:95329:x1870605465609856:12345-0@lo:104: Request processed in 63us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.988640:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1783952224.988650:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1783952224.988654:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95329:x1870605465609984:12345-0@lo:104: 00010000:00010000:0.0:1783952224.988661:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.988889:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1783952224.988895:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95329:x1870605465609984:12345-0@lo:104: Request processed in 240us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.988901:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:0.0:1783952224.989017:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1783952224.989023:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989041:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af800 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952224.989045:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989053:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952224.989060:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952224.989066:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952224.989102:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989109:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952224.989126:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989133:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762af800/0x22c73c7857bb60f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989145:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783952224.989148:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989154:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a14e00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952224.989157:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989174:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952224.989180:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952224.989184:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952224.989198:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989203:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952224.989221:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989228:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a14e00/0x22c73c7857bb60ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989237:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783952224.989240:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989245:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71a00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952224.989248:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989254:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952224.989259:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952224.989270:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952224.989284:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989290:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952224.989296:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989302:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db71a00/0x22c73c7857bb60ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989310:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783952224.989313:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989319:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2dc00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952224.989322:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989329:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952224.989336:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952224.989341:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952224.989349:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989354:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952224.989365:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989371:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b047b2dc00/0x22c73c7857bb60c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb60c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989380:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783952224.989388:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989394:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d000 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952224.989397:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989404:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952224.989409:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952224.989414:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952224.989426:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989432:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952224.989436:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989442:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b047b2d000/0x22c73c7857bb6096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb609d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989450:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783952224.989458:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989464:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a15e00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952224.989467:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989473:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952224.989479:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952224.989484:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952224.989497:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989503:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952224.989508:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989513:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a15e00/0x22c73c7857bb607a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6081 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989522:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952224.989525:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989530:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afa00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952224.989533:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989551:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952224.989557:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952224.989562:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952224.989576:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989581:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952224.989606:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989613:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b1762afa00/0x22c73c7857bb6042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6049 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989622:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952224.989624:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989630:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2c800 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952224.989633:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989639:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952224.989645:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952224.989656:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952224.989685:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989692:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952224.989697:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989703:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b047b2c800/0x22c73c7857bb5f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb5f69 expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.989716:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952224.989717:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952224.989719:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952224.989735:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465610368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952224.989772:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952224.989796:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465610880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952224.989813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952224.989833:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783952224.989838:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465610240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952224.989857:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952224.989871:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465610752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952224.989889:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952224.989910:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465610368 00000100:00100000:0.0:1783952224.989915:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465610368 00000100:00100000:1.0:1783952224.990026:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465608960:0@lo:104: 00000100:00100000:1.0:1783952224.990037:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609088:0@lo:104: 00000100:00100000:1.0:1783952224.990045:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609344:0@lo:104: 00000100:00100000:1.0:1783952224.990063:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144916d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609472:0@lo:104: 00000100:00100000:1.0:1783952224.990071:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609600:0@lo:104: 00000100:00100000:1.0:1783952224.990077:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609728:0@lo:104: 00000100:00100000:1.0:1783952224.990084:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609856:0@lo:104: 00000100:00100000:1.0:1783952224.990091:0:95329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95329:1870605465609984:0@lo:104: 00010000:00010000:1.0:1783952224.990130:0:95329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.990203:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb6129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6122 expref: 25 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952224.990228:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465610112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952224.990256:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952224.990269:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465610624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952224.990284:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952224.990294:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783952224.990298:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465610496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952224.990313:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952224.990321:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465611008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952224.990335:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952224.990357:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465610880 00000100:00100000:3.0:1783952224.990361:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465610880 00010000:00010000:0.0:1783952224.990564:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb60d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb60ce expref: 26 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952224.990615:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465610240 00000100:00100000:0.0:1783952224.990619:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465610240 00010000:00010000:0.0:1783952224.990634:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b04db70800/0x22c73c7857bb60f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb60ea expref: 27 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952224.990645:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465610752 00000100:00100000:0.0:1783952224.990648:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465610752 00010000:00010000:0.0:1783952224.990658:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb6081 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb607a expref: 28 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952224.990680:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465610112 00000100:00100000:0.0:1783952224.990683:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465610112 00010000:00010000:0.0:1783952224.990693:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b175a14600/0x22c73c7857bb60ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb60f8 expref: 29 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952224.990702:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465610624 00000100:00100000:0.0:1783952224.990704:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465610624 00010000:00010000:0.0:1783952224.990713:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb609d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6096 expref: 30 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952224.990722:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465610496 00000100:00100000:0.0:1783952224.990724:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465610496 00010000:00010000:0.0:1783952224.990733:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb60c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb60c0 expref: 31 pid: 94411 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952224.990743:0:7927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465611008 00000100:00100000:0.0:1783952224.990745:0:7927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465611008 00010000:00010000:0.0:1783952224.990754:0:7927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5f62 expref: 32 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952224.990767:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:0.0:1783952224.990780:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+32:3642:x1870605465609216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952224.990794:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952224.990800:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb6129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6122 expref: 32 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.990811:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb6129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb6122 expref: 32 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.990824:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762aee00/0x22c73c7857bb6129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb6122 expref: 32 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.990838:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952224.990866:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+31:3642:x1870605465609216:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (3867us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.990873:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:0.0:1783952224.990889:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:0.0:1783952224.990895:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+30:3645:x1870605465610368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952224.990902:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952224.990907:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb60d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb60ce expref: 30 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.990915:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb60d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb60ce expref: 30 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.990925:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b047b2d200/0x22c73c7857bb60d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb60ce expref: 30 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.990933:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952224.990965:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+29:3645:x1870605465610368:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.990987:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:0.0:1783952224.991003:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:0.0:1783952224.991009:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ef42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+28:3645:x1870605465610240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952224.991018:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952224.991023:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b04db70800/0x22c73c7857bb60f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb60ea expref: 28 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991030:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b04db70800/0x22c73c7857bb60f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb60ea expref: 28 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991038:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db70800/0x22c73c7857bb60f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb60ea expref: 28 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991046:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952224.991174:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ef42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+27:3645:x1870605465610240:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.991180:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:0.0:1783952224.991195:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:0.0:1783952224.991201:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+26:3645:x1870605465610752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952224.991209:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952224.991213:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb6081 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb607a expref: 26 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991221:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb6081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb607a expref: 26 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991231:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71e00/0x22c73c7857bb6081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb607a expref: 26 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991249:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952224.991272:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3645:x1870605465610752:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.991278:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:0.0:1783952224.991290:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1783952224.991295:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465610112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952224.991304:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952224.991309:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b175a14600/0x22c73c7857bb60ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb60f8 expref: 24 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991317:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b175a14600/0x22c73c7857bb60ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb60f8 expref: 24 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991326:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b175a14600/0x22c73c7857bb60ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb60f8 expref: 24 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991334:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952224.991361:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3643:x1870605465610112:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.991367:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1783952224.991379:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1783952224.991384:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3643:x1870605465610624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952224.991391:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952224.991396:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb609d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6096 expref: 22 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991404:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb609d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb6096 expref: 22 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991419:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb609d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb6096 expref: 22 pid: 94415 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991427:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952224.991447:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3643:x1870605465610624:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.991453:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1783952224.991465:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1783952224.991471:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3643:x1870605465610496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952224.991477:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952224.991482:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb60c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb60c0 expref: 20 pid: 94411 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991489:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb60c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb60c0 expref: 20 pid: 94411 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991498:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762ae200/0x22c73c7857bb60c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb60c0 expref: 20 pid: 94411 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991506:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952224.991526:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3643:x1870605465610496:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.991532:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1783952224.991544:0:7927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:0.0:1783952224.991550:0:7927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:3643:x1870605465611008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952224.991557:0:7927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952224.991561:0:7927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb5f62 expref: 18 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991576:0:7927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb5f62 expref: 18 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991607:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b175a15c00/0x22c73c7857bb5f69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb5f62 expref: 18 pid: 94410 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.991617:0:7927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952224.991639:0:7927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:3643:x1870605465611008:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952224.991645:0:7927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:1.0:1783952224.991779:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465610240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952224.991789:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465610752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952224.991797:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465610368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952224.991900:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952224.991906:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952224.991985:0:22092:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b1762af600/0x22c73c7857bb6049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6042 expref: 16 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952224.992061:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1783952224.992140:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:3645:x1870605465610880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952224.992150:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952224.992156:0:22092:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b1762af600/0x22c73c7857bb6049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6042 expref: 16 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.992165:0:22092:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b1762af600/0x22c73c7857bb6049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb6042 expref: 16 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.992182:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762af600/0x22c73c7857bb6049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb6042 expref: 16 pid: 94412 timeout: 4039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.992195:0:22092:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.992203:0:22092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.992219:0:22092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.992227:0:22092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.992234:0:22092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.992242:0:22092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.992249:0:22092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71400 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952224.992254:0:22092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.992262:0:22092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.992411:0:95329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952224.992419:0:95329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952224.993288:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952224.993407:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465609216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952224.993469:0:22092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.993493:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db71400/0x22c73c7857bb6424 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952224.993508:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952224.993568:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:3645:x1870605465610880:12345-0@lo:103:ldlm_bl.0 Request processed in 1500us (3752us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952224.993577:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:1.0:1783952224.993768:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465610880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952224.993868:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465610496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952224.993878:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465611008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952224.993886:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465610112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952224.993894:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465610624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952225.825222:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783952226.400734:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783952226.400742:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b04661c800 from 58 10000000:01000000:3.0:1783952226.400747:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783952226.400798:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.400809:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.400821:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952226.400850:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465611136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.400933:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.401006:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ed84840 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.401184:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465611136 00000100:00100000:0.0:1783952226.401192:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465611136 00000100:00100000:0.0:1783952226.401248:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783952226.401257:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465611136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952226.401271:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952226.401284:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb6432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb642b expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.401304:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb6432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb642b expref: 16 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.401315:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb6432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb642b expref: 16 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.401324:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd600, rc 0) 00000100:00100000:0.0:1783952226.401372:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465611136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.401389:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783952226.401402:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465611136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952226.401415:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.401423:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952226.401482:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465611264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.401510:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.401534:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ed84840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.401607:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465611264 00000100:00100000:2.0:1783952226.401612:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465611264 00000100:00100000:2.0:1783952226.401649:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783952226.401656:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465611264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952226.401781:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465611264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.401789:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783952226.401906:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465611264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.401945:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465611392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.401992:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952226.402020:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1464d9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952226.402155:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465611392 00000100:00100000:1.0:1783952226.402160:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465611392 00000100:00100000:1.0:1783952226.402192:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783952226.402199:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465611392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.402289:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465611392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952226.402306:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783952226.402813:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465611392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952226.403289:0:95333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95333:1870605465611520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952226.403331:0:95333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952226.403364:0:95333:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046864a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.403413:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465611520 00000100:00100000:0.0:1783952226.403418:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465611520 00000100:00100000:0.0:1783952226.403455:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783952226.403462:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:95333:x1870605465611520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952226.403558:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:95333:x1870605465611520:12345-0@lo:502:llog_process_th.0 Request processed in 96us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.403566:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783952226.403712:0:95333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95333:1870605465611520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952226.403750:0:95333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95333:1870605465611648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952226.403781:0:95333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952226.403805:0:95333:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046864a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783952226.403848:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465611648 00000100:00100000:3.0:1783952226.403853:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465611648 00000100:00100000:3.0:1783952226.403883:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783952226.403891:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:95333:x1870605465611648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952226.403998:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:95333:x1870605465611648:12345-0@lo:502:llog_process_th.0 Request processed in 107us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952226.404005:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783952226.404219:0:95333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95333:1870605465611648:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783952226.404239:0:95333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1783952226.404421:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1783952226.404441:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783952226.404450:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.404461:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952226.404471:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783952226.404473:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:3.0:1783952226.404483:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783952226.404507:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.404515:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.404524:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952226.404538:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465611776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.404567:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.404614:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ed84840 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.404700:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465611776 00000100:00100000:0.0:1783952226.404704:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465611776 00000100:00100000:0.0:1783952226.404735:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783952226.404742:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465611776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952226.404752:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952226.404764:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb6440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6439 expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.404784:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb6440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6439 expref: 17 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.404802:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb6440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6439 expref: 17 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.404811:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbdc00, rc 0) 00000100:00100000:0.0:1783952226.404852:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465611776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.404859:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783952226.404932:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465611776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952226.404947:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.404964:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952226.405014:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465611904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.405039:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952226.405141:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465611904 00000100:00100000:2.0:1783952226.405146:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465611904 00000100:00100000:2.0:1783952226.405181:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783952226.405189:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465611904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.405322:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04676c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.412234:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465611904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7036us (7183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.412249:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783952226.412372:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465611904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.412431:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465612032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.412486:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.412525:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04676c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.412580:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465612032 00000100:00100000:0.0:1783952226.412630:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465612032 00000100:00100000:0.0:1783952226.412674:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783952226.412683:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465612032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.412790:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465612032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.412797:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783952226.413048:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465612032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.442361:0:95334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95334:1870605465612160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952226.442460:0:95334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.442499:0:95334:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ed84840 going to sleep for 11 seconds 00000100:00100000:1.0:1783952226.442672:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465612160 00000100:00100000:1.0:1783952226.442681:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465612160 00000100:00100000:1.0:1783952226.442732:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783952226.442742:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:95334:x1870605465612160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952226.442880:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:95334:x1870605465612160:12345-0@lo:502:llog_process_th.0 Request processed in 139us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952226.442888:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783952226.443072:0:95334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95334:1870605465612160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952226.443100:0:95334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952226.443110:0:95334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952226.443112:0:95334:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1783952226.443117:0:95334:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1783952226.443133:0:95334:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000020:01000004:3.0:1783952226.444035:0:95335:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b04661c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783952226.444041:0:95335:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b04661c800 4 00000100:00100000:1.0:1783952226.444711:0:95334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95334:1870605465612288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952226.444784:0:95334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.444822:0:95334:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04676c780 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.444881:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465612288 00000100:00100000:0.0:1783952226.444888:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465612288 00000100:00100000:0.0:1783952226.444939:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783952226.444948:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:95334:x1870605465612288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952226.445196:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:95334:x1870605465612288:12345-0@lo:502:llog_process_th.0 Request processed in 249us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.445203:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783952226.445515:0:95334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95334:1870605465612288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952226.445543:0:95334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952226.445548:0:95334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952226.445550:0:95334:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1783952226.445554:0:95334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:1.0:1783952226.446301:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:1.0:1783952226.446325:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783952226.446334:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.446346:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952226.446355:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783952226.446358:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b151231000 from 58 10000000:01000000:1.0:1783952226.446361:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783952226.446393:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.446401:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.446410:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952226.446429:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465612416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.446470:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.446507:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.446571:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465612416 00000100:00100000:0.0:1783952226.446577:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465612416 00000100:00100000:0.0:1783952226.446640:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783952226.446647:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465612416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952226.446659:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952226.446681:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb644e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6447 expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.446702:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb644e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6447 expref: 18 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.446714:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb644e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6447 expref: 18 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.446723:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbda00, rc 0) 00000100:00100000:0.0:1783952226.446762:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465612416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.446768:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783952226.446858:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465612416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952226.446872:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.446880:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952226.446941:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465612544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.446977:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.447004:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.447165:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465612544 00000100:00100000:0.0:1783952226.447169:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465612544 00000100:00100000:0.0:1783952226.447200:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783952226.447208:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465612544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.447306:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465612544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.447312:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783952226.450630:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465612544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.450708:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465612672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.450808:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.450843:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.451028:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465612672 00000100:00100000:0.0:1783952226.451035:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465612672 00000100:00100000:0.0:1783952226.451101:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783952226.451110:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465612672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.451230:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465612672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.451237:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783952226.451443:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465612672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.461875:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95336:1870605465612800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952226.462173:0:95336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.462225:0:95336:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952226.462281:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465612800 00000100:00100000:3.0:1783952226.462289:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465612800 00000100:00100000:3.0:1783952226.462339:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783952226.462348:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:95336:x1870605465612800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952226.462485:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:95336:x1870605465612800:12345-0@lo:502:llog_process_th.0 Request processed in 137us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952226.462493:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783952226.462627:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95336:1870605465612800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952226.462682:0:95336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95336:1870605465612928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952226.462717:0:95336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952226.462748:0:95336:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf600 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.462860:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465612928 00000100:00100000:2.0:1783952226.462871:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465612928 00000100:00100000:2.0:1783952226.462919:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783952226.462927:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:95336:x1870605465612928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952226.463016:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:95336:x1870605465612928:12345-0@lo:502:llog_process_th.0 Request processed in 91us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.463024:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783952226.463280:0:95336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95336:1870605465612928:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783952226.463301:0:95336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1783952226.463542:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1783952226.463564:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783952226.463575:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.463610:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952226.463620:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783952226.463623:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:2.0:1783952226.463626:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783952226.463652:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.463661:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.463671:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952226.463685:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952226.463718:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952226.463810:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046864d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.472234:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465613056 00000100:00100000:2.0:1783952226.472248:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465613056 00000100:00100000:2.0:1783952226.472319:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783952226.472330:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465613056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952226.472350:0:94411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952226.472369:0:94411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140031000/0x22c73c7857bb645c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6455 expref: -99 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.472398:0:94411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140031000/0x22c73c7857bb645c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6455 expref: 19 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.472409:0:94411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140031000/0x22c73c7857bb645c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6455 expref: 19 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.472418:0:94411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031000, rc 0) 00000100:00100000:2.0:1783952226.472510:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465613056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (8792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.472518:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783952226.472642:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952226.472672:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.472693:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952226.472891:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.472938:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.472983:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.473147:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465613184 00000100:00100000:2.0:1783952226.473152:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465613184 00000100:00100000:2.0:1783952226.473188:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783952226.473196:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465613184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952226.473310:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465613184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.473317:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783952226.473387:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.473415:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.473453:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952226.473474:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465613312 00000100:00100000:1.0:1783952226.473479:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.473479:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465613312 00000100:00100000:0.0:1783952226.473501:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783952226.473508:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465613312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.473610:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465613312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.473617:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783952226.473671:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.474449:0:95337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95337:1870605465613440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952226.474499:0:95337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.474532:0:95337:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873de40 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.474579:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465613440 00000100:00100000:2.0:1783952226.474584:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465613440 00000100:00100000:2.0:1783952226.474665:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783952226.474673:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:95337:x1870605465613440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952226.474784:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:95337:x1870605465613440:12345-0@lo:502:llog_process_th.0 Request processed in 112us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.474791:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783952226.474982:0:95337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95337:1870605465613440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783952226.475006:0:95337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783952226.475017:0:95337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952226.475019:0:95337:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1783952226.475025:0:95337:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1783952226.475041:0:95337:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:0.0:1783952226.475073:0:95337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95337:1870605465613568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952226.475109:0:95337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952226.475136:0:95337:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.475245:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465613568 00000100:00100000:2.0:1783952226.475249:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465613568 00000100:00100000:2.0:1783952226.475278:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783952226.475284:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:95337:x1870605465613568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952226.475348:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:95337:x1870605465613568:12345-0@lo:502:llog_process_th.0 Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.475355:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783952226.475774:0:95337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95337:1870605465613568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783952226.475794:0:95337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783952226.475799:0:95337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783952226.475800:0:95337:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1783952226.475804:0:95337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:1.0:1783952226.476005:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:1.0:1783952226.476026:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783952226.476035:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.476046:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952226.476055:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783952226.476067:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b046482800 from 58 10000000:01000000:1.0:1783952226.476070:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783952226.476094:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.476102:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.476120:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952226.476135:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.476167:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.476197:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.476304:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465613696 00000100:00100000:2.0:1783952226.476310:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465613696 00000100:00100000:2.0:1783952226.476353:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783952226.476360:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465613696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952226.476371:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952226.476384:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140030e00/0x22c73c7857bb646a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6463 expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.476404:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140030e00/0x22c73c7857bb646a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6463 expref: 20 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.476416:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140030e00/0x22c73c7857bb646a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6463 expref: 20 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.476424:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030e00, rc 0) 00000100:00100000:2.0:1783952226.476464:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465613696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.476481:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783952226.478078:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952226.478114:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.478126:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952226.478200:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.478247:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952226.478266:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.478377:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465613824 00000100:00100000:2.0:1783952226.478383:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465613824 00000100:00100000:2.0:1783952226.478426:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783952226.478434:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465613824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952226.478553:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465613824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.478560:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783952226.482249:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.482317:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.482395:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952226.482440:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.482541:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465613952 00000100:00100000:2.0:1783952226.482548:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465613952 00000100:00100000:2.0:1783952226.482630:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783952226.482640:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f3b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465613952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952226.482930:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f3b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465613952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 292us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.482938:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783952226.483173:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465613952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.484350:0:95338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95338:1870605465614080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952226.484408:0:95338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952226.484446:0:95338:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee42d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783952226.484498:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465614080 00000100:00100000:1.0:1783952226.484504:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465614080 00000100:00100000:1.0:1783952226.484544:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783952226.484552:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:95338:x1870605465614080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952226.484705:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:95338:x1870605465614080:12345-0@lo:502:llog_process_th.0 Request processed in 153us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952226.484713:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783952226.485015:0:95338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95338:1870605465614080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952226.485149:0:95338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95338:1870605465614208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952226.485185:0:95338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952226.485214:0:95338:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.485258:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465614208 00000100:00100000:2.0:1783952226.485263:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465614208 00000100:00100000:2.0:1783952226.485297:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783952226.485304:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:95338:x1870605465614208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952226.485383:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:95338:x1870605465614208:12345-0@lo:502:llog_process_th.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.485390:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783952226.485932:0:95338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95338:1870605465614208:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783952226.485965:0:95338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1783952226.487646:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1783952226.487690:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783952226.487701:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.487714:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952226.487724:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783952226.487726:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1783952226.487729:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783952226.487775:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.487783:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.487806:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952226.487827:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.487879:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.487923:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.488102:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465614336 00000100:00100000:2.0:1783952226.488109:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465614336 00000100:00100000:2.0:1783952226.488149:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783952226.488157:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465614336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952226.488176:0:94411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952226.488188:0:94411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140031600/0x22c73c7857bb6478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6471 expref: -99 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.488210:0:94411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140031600/0x22c73c7857bb6478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6471 expref: 21 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.488220:0:94411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140031600/0x22c73c7857bb6478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6471 expref: 21 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.488229:0:94411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031600, rc 0) 00000100:00100000:2.0:1783952226.488276:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465614336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.488283:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783952226.488575:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952226.488620:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.488629:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952226.488693:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.488718:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.488729:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.488972:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465614464 00000100:00100000:2.0:1783952226.488977:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465614464 00000100:00100000:2.0:1783952226.489009:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783952226.489016:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465614464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952226.489139:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465614464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.489146:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783952226.489320:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.489347:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.489386:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.489412:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.490690:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465614592 00000100:00100000:2.0:1783952226.490699:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465614592 00000100:00100000:2.0:1783952226.490854:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783952226.490863:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465614592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952226.490999:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465614592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.491016:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783952226.491172:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952226.493417:0:95339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1783952226.494151:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1783952226.494174:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783952226.494185:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.494204:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952226.494214:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783952226.494216:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174849000 from 58 10000000:01000000:1.0:1783952226.494219:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783952226.494253:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.494262:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.494273:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952226.494299:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.494359:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.494435:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952226.502186:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465614720 00000100:00100000:2.0:1783952226.502200:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465614720 00000100:00100000:2.0:1783952226.502760:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783952226.502773:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465614720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952226.502790:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952226.502809:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140030400/0x22c73c7857bb6486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb647f expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.502838:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140030400/0x22c73c7857bb6486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb647f expref: 22 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.502849:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140030400/0x22c73c7857bb6486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb647f expref: 22 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.502858:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030400, rc 0) 00000100:00100000:2.0:1783952226.502942:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465614720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (8582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.502948:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783952226.503053:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952226.503085:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952226.503094:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952226.503164:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.503196:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.509539:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6540 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.511882:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465614848 00000100:00100000:0.0:1783952226.511897:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465614848 00000100:00100000:1.0:1783952226.513230:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783952226.513243:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465614848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.513434:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465614848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (10236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952226.513442:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783952226.513619:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.513686:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.513754:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.513787:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952226.513802:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465614976 00000100:00100000:3.0:1783952226.513807:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465614976 00000100:00100000:3.0:1783952226.513835:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783952226.513841:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465614976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.513919:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465614976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952226.513926:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783952226.513977:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465614976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.516243:0:95340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95340:1870605465615104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952226.516320:0:95340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952226.516363:0:95340:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.516426:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465615104 00000100:00100000:0.0:1783952226.516433:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465615104 00000100:00100000:0.0:1783952226.516479:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783952226.516487:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:95340:x1870605465615104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952226.516628:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:95340:x1870605465615104:12345-0@lo:502:llog_process_th.0 Request processed in 141us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.516637:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783952226.516865:0:95340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95340:1870605465615104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952226.516916:0:95340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95340:1870605465615232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952226.516952:0:95340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.516987:0:95340:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d000 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.517040:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465615232 00000100:00100000:0.0:1783952226.517044:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465615232 00000100:00100000:0.0:1783952226.517210:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783952226.517218:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:95340:x1870605465615232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952226.517285:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:95340:x1870605465615232:12345-0@lo:502:llog_process_th.0 Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.517293:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783952226.520257:0:95340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95340:1870605465615232:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783952226.520307:0:95340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1783952226.520396:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1783952226.520415:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783952226.520426:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.520456:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952226.520467:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783952226.520469:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1783952226.520472:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783952226.520505:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.520513:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.520522:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952226.520543:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465615360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.520619:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.521130:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465615360 00000100:00100000:3.0:1783952226.521139:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465615360 00000100:00100000:3.0:1783952226.521184:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783952226.521192:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465615360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952226.521205:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952226.521217:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb6494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb648d expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.521242:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb6494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb648d expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.521266:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb6494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb648d expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.521274:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86be00, rc 0) 00000100:00100000:3.0:1783952226.521308:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465615360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952226.521315:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783952226.521347:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952226.521360:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465615360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952226.521373:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.521382:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952226.521433:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465615488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.521457:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.521475:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465615488 00000100:00100000:3.0:1783952226.521478:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465615488 00000100:00100000:3.0:1783952226.521494:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783952226.521499:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465615488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.521618:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465615488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952226.521626:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783952226.521645:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952226.521837:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465615488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.521871:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465615616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.521909:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.521936:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465615616 00000100:00100000:3.0:1783952226.521939:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465615616 00000100:00100000:3.0:1783952226.521966:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783952226.521972:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465615616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.522043:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465615616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952226.522049:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783952226.522087:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04873d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952226.522100:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465615616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783952226.535971:0:95341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783952226.536425:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783952226.536450:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783952226.536462:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.536474:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952226.536484:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783952226.536486:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97b167c90000 from 1 10000000:01000000:3.0:1783952226.536489:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783952226.536528:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.536537:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952226.536567:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952226.537198:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465615744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952226.537268:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952226.537354:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b04676c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783952226.542805:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465615744 00000100:00100000:0.0:1783952226.542822:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465615744 00000100:00100000:0.0:1783952226.542897:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783952226.542907:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465615744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952226.542924:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952226.542944:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb64a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb649b expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.542982:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb64a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb649b expref: 24 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.542993:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb64a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb649b expref: 24 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.543016:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbce00, rc 0) 00000100:00100000:0.0:1783952226.543115:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465615744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (5846us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.543121:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783952226.543297:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465615744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952226.543318:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.543327:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952226.543400:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465615872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952226.543440:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952226.543478:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b142e13480 going to sleep for 11 seconds 00000100:00100000:1.0:1783952226.543643:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465615872 00000100:00100000:1.0:1783952226.543649:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465615872 00000100:00100000:1.0:1783952226.543689:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783952226.543697:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465615872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952226.543783:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465615872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (343us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783952226.543792:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783952226.544004:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465615872:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783952226.544035:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783952226.544042:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.544050:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.849681:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952226.860332:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952226.860431:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447788800 00000100:00100000:0.0:1783952226.860442:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447788800 00000100:00100000:0.0:1783952226.860499:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 122 00000100:00100000:0.0:1783952226.860509:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175079450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447788800:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952226.860536:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952226.860554:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb64a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a55a expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.860583:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb64a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a55a expref: 9 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.860622:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb64a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a55a expref: 9 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952226.860632:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc000, rc 0) 00000100:00100000:0.0:1783952226.860704:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175079450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447788800:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 196us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.860710:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 122 00000100:00100000:3.0:1783952226.863864:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952226.864020:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447788928 00000100:00100000:2.0:1783952226.864030:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447788928 00000100:00100000:2.0:1783952226.864097:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 123 00000100:00100000:2.0:1783952226.864107:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175079850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447788928:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952226.864268:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175079850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447788928:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 162us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.864276:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 123 00000100:00100000:3.0:1783952226.873005:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952226.873162:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447789056 00000100:00100000:0.0:1783952226.873173:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447789056 00000100:00100000:0.0:1783952226.873229:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 124 00000100:00100000:0.0:1783952226.873239:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17507b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447789056:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.873384:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17507b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447789056:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 145us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.873392:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 124 00000100:00100000:1.0:1783952226.879106:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952226.879716:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447789184 00000100:00100000:2.0:1783952226.879728:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447789184 00000100:00100000:2.0:1783952226.879788:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 125 00000100:00100000:2.0:1783952226.879798:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b143746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:73352:x1870605447789184:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783952226.879949:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b143746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:73352:x1870605447789184:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 151us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.879967:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 125 00000100:00100000:3.0:1783952226.883706:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952226.883797:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447789312 00000100:00100000:0.0:1783952226.883807:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447789312 00000100:00100000:0.0:1783952226.883863:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 126 00000100:00100000:0.0:1783952226.883872:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:73352:x1870605447789312:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783952226.884031:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+9:73352:x1870605447789312:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 159us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952226.884040:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 126 00000100:00100000:3.0:1783952226.888712:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952226.889161:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447789440 00000100:00100000:2.0:1783952226.889186:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447789440 00000100:00100000:2.0:1783952226.889247:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 127 00000100:00100000:2.0:1783952226.889257:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447789440:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952226.889275:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952226.889294:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140030200/0x22c73c7857bb64b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a561 expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.889335:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140030200/0x22c73c7857bb64b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a561 expref: 10 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.889346:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140030200/0x22c73c7857bb64b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a561 expref: 10 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952226.889355:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030200, rc 0) 00000100:00100000:2.0:1783952226.889413:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447789440:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 158us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952226.889421:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 127 00000100:00100000:2.0:1783952226.896084:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952226.896247:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447789568 00000100:00100000:0.0:1783952226.896257:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447789568 00000100:00100000:0.0:1783952226.896315:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 128 00000100:00100000:0.0:1783952226.896325:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447789568:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952226.896487:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447789568:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 163us (411us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783952226.896496:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 128 00010000:00010000:0.0:1783952227.883246:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952228.448830:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465616128:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.448908:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.448948:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465616640:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.448973:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.448992:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465617152:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.449032:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783952228.449038:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465616256:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449057:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.449072:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465616768:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449094:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.449108:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465617280:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449126:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.449157:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465616128 00000100:00100000:3.0:1783952228.449172:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465616128 00000100:00100000:3.0:1783952228.449221:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465616256 00000100:00100000:3.0:1783952228.449224:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465616256 00000100:00100000:3.0:1783952228.449245:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:3.0:1783952228.449254:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465616128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449303:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465616128:12345-0@lo:400:kworker.0 Request processed in 50us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.449310:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:3.0:1783952228.449325:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:3.0:1783952228.449331:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465616256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449372:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465616256:12345-0@lo:400:kworker.0 Request processed in 41us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.449378:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:3.0:1783952228.449396:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465616640 00000100:00100000:3.0:1783952228.449400:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465616640 00000100:00100000:3.0:1783952228.449424:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465617152 00000100:00100000:3.0:1783952228.449426:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465617152 00000100:00100000:3.0:1783952228.449445:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:3.0:1783952228.449451:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465616640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449484:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465616640:12345-0@lo:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.449490:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00100000:3.0:1783952228.449501:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:3.0:1783952228.449506:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465617152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449533:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465617152:12345-0@lo:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.449538:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00100000:3.0:1783952228.449569:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465616768 00000100:00100000:3.0:1783952228.449573:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465616768 00000100:00100000:3.0:1783952228.449624:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465617280 00000100:00100000:3.0:1783952228.449627:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465617280 00000100:00100000:3.0:1783952228.449648:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898 00000100:00100000:3.0:1783952228.449654:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465616768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449686:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465616768:12345-0@lo:400:kworker.0 Request processed in 33us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.449692:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898 00000100:00100000:3.0:1783952228.449702:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:3.0:1783952228.449707:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465617280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449729:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465617280:12345-0@lo:400:kworker.0 Request processed in 22us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.449735:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00080000:3.0:1783952228.449752:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783952228.449756:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952228.449758:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952228.449803:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465616256:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449812:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465616768:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449820:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465617280:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449828:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465616128:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449835:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465616640:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.449843:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465617152:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450145:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465616384:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450181:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952228.450212:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465616896:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450233:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952228.450249:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465617408:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450268:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952228.450288:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1783952228.450294:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465616000:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450330:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952228.450367:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465616512:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450388:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952228.450401:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465617024:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450420:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952228.450432:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047ac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465617536:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450449:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952228.450473:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465616896 00000100:00100000:1.0:1783952228.450477:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465616896 00000100:00100000:1.0:1783952228.450503:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465617408 00000100:00100000:1.0:1783952228.450506:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465617408 00000100:00100000:1.0:1783952228.450522:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:1.0:1783952228.450528:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465616896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450566:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465616896:12345-0@lo:400:kworker.0 Request processed in 38us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952228.450572:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:1.0:1783952228.450584:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:1.0:1783952228.450619:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465617408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450645:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465617408:12345-0@lo:400:kworker.0 Request processed in 28us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952228.450651:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000100:00100000:1.0:1783952228.450671:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465616000 00000100:00100000:1.0:1783952228.450674:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465616000 00000100:00100000:1.0:1783952228.450713:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783952228.450719:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465616000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450747:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465616000:12345-0@lo:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952228.450759:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783952228.450798:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465616000:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450808:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465616896:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.450818:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465617408:0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.451123:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465616384 00000100:00100000:3.0:1783952228.451128:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465616384 00000100:00100000:3.0:1783952228.451168:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465616512 00000100:00100000:3.0:1783952228.451172:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465616512 00000100:00100000:3.0:1783952228.451192:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465617024 00000100:00100000:3.0:1783952228.451194:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465617024 00000100:00100000:3.0:1783952228.451206:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465617536 00000100:00100000:3.0:1783952228.451208:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465617536 00000100:00100000:3.0:1783952228.451220:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1783952228.451225:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465616384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.451262:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465616384:12345-0@lo:400:kworker.0 Request processed in 37us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.451267:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1783952228.451279:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1783952228.451284:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465616512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952228.451311:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465616512:12345-0@lo:400:kworker.0 Request processed in 27us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.451317:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1783952228.451327:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1783952228.451332:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465617024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952228.451412:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:0.0:1783952228.451420:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465617536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952228.451450:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465617536:12345-0@lo:400:kworker.0 Request processed in 32us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952228.451454:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1783952228.451512:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465617024:12345-0@lo:400:kworker.0 Request processed in 179us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.451518:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00080000:3.0:1783952228.451548:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952228.451552:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783952228.451554:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952228.451655:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465616512:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.451664:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465617024:0@lo:400:kworker.0 00000100:00100000:1.0:1783952228.451672:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047ac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465617536:0@lo:400:kworker.0 00000100:00100000:0.0:1783952228.451761:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783952228.451772:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465617664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952228.452420:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465616384:0@lo:400:kworker.0 00000100:00100000:0.0:1783952228.461174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952228.461285:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465617664 00000100:00100000:1.0:1783952228.461294:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465617664 00000100:00100000:1.0:1783952228.461365:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:1.0:1783952228.461375:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465617664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783952228.461413:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:1.0:1783952228.461470:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465617664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952228.461477:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:00100000:2.0:1783952228.461565:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465617664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952228.849298:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952228.849334:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952228.849362:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952228.849390:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952228.849432:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952228.849459:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447789824 00000100:00100000:3.0:1783952228.849468:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447789824 00000100:00100000:3.0:1783952228.849524:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447789952 00000100:00100000:3.0:1783952228.849527:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447789952 00000100:00100000:3.0:1783952228.849551:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1450 00000100:00100000:3.0:1783952228.849560:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2400:x1870605447789824:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952228.849655:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2400:x1870605447789824:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 96us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.849663:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1450 00000100:00100000:3.0:1783952228.849681:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1451 00000100:00100000:3.0:1783952228.849688:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2400:x1870605447789952:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952228.849998:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447790080 00000100:00100000:2.0:1783952228.850003:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447790080 00000100:00100000:2.0:1783952228.850034:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447790208 00000100:00100000:2.0:1783952228.850038:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447790208 00000100:00100000:2.0:1783952228.850059:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2902 00000100:00100000:2.0:1783952228.850066:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447790080:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952228.850095:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2400:x1870605447790080:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952228.850113:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2902 00000100:00100000:2.0:1783952228.850127:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2903 00000100:00100000:2.0:1783952228.850133:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447790208:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952228.850158:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447790208:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952228.850165:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2903 00000100:00080000:2.0:1783952228.851353:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952228.851359:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952228.851362:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952228.851364:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952228.853105:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2400:x1870605447789952:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.853120:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1451 00000100:00100000:0.0:1783952228.853847:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447789696 00000100:00100000:0.0:1783952228.853857:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447789696 00000100:00100000:0.0:1783952228.853905:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 130 00000100:00100000:0.0:1783952228.853914:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447789696:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952228.854007:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447789696:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 94us (4643us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952228.854015:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 130 00010000:00010000:0.0:1783952228.906166:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783952228.949897:0:95439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe8ff6b160 20000000:00000080:0.0:1783952228.949914:0:95439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff97b0459d6000 uarg=0000000000000000 00000040:00100000:0.0:1783952228.952253:0:95439:0:(llog.c:1072:llog_reverse_process()) index 60 : idx 49 20000000:01000000:0.0:1783952228.952263:0:95439:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1783952228.952280:0:95439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:2.0:1783952228.954406:0:95440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 42 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:2.0:1783952228.954447:0:95440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 54 marker 42 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:2.0:1783952228.954456:0:95440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:1.0:1783952228.954667:0:95439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:1.0:1783952228.954682:0:95439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1783952228.954697:0:95439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:1.0:1783952228.954728:0:95439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:1.0:1783952228.954745:0:95439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 00000100:00100000:1.0:1783952228.960772:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783952228.960916:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465617792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952228.960981:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465618048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952228.961012:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952228.961012:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952228.961043:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465617920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952228.961064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952228.961126:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465617792 00000100:00100000:2.0:1783952228.961135:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465617792 00000100:00100000:2.0:1783952228.961194:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:2.0:1783952228.961204:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465617792:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952228.961210:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465618048 00000100:00100000:0.0:1783952228.961213:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465618048 00000004:00000024:2.0:1783952228.961239:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445187584 avail 1298948096 00000100:00100000:0.0:1783952228.961240:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465617920 00000100:00100000:0.0:1783952228.961242:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465617920 00000100:00100000:0.0:1783952228.961254:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265 00000100:00100000:0.0:1783952228.961260:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465618048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783952228.961281:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783952228.961285:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465617792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952228.961292:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:0.0:1783952228.961313:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465618048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952228.961316:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266 00000100:00100000:0.0:1783952228.961319:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265 00000100:00100000:2.0:1783952228.961322:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465617920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783952228.961337:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952228.961360:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465618048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952228.961377:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465617920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952228.961389:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266 00000100:00100000:2.0:1783952228.961416:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465617792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952228.961426:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465617920:0@lo:13:osp-pre-1-0.0 20000000:01000000:2.0:1783952228.963453:0:95441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 43 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:2.0:1783952228.963506:0:95441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 43 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:2.0:1783952228.963515:0:95441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:1.0:1783952228.964264:0:95439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:1.0:1783952228.964276:0:95439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1783952228.964285:0:95439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:1.0:1783952228.964295:0:95439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:1.0:1783952228.964303:0:95439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1783952228.964928:0:95442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 44 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:0.0:1783952228.964977:0:95442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 44 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:0.0:1783952228.964994:0:95442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:1.0:1783952228.965834:0:95439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:1.0:1783952228.965849:0:95439:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1783952228.965866:0:95439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:1.0:1783952228.965884:0:95439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:1.0:1783952228.966097:0:95439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783952228.966116:0:95439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966136:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb6432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb642b expref: 23 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966143:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb6440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6439 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966148:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb644e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6447 expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966154:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b140031000/0x22c73c7857bb645c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6455 expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966159:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b140030e00/0x22c73c7857bb646a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6463 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966183:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b140031600/0x22c73c7857bb6478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6471 expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966190:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b140030400/0x22c73c7857bb6486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb647f expref: 23 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966197:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb6494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb648d expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966205:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb64a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb649b expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966215:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb64a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a55a expref: 9 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966223:0:95439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b140030200/0x22c73c7857bb64b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a561 expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966232:0:95439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966272:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b140030200/0x22c73c7857bb64b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a561 expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966286:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b140030200/0x22c73c7857bb64b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a561 expref: 9 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.966302:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618176:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783952228.966401:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb64a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a55a expref: 9 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966417:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb64a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a55a expref: 9 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.966426:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618304:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783952228.966459:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb64a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb649b expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966468:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb64a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb649b expref: 23 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.966478:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ac6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618432:0@lo:104: 00000100:00100000:1.0:1783952228.966518:0:95439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952228.966556:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb6494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb648d expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966564:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb6494 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb648d expref: 23 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.966573:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144916d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618560:0@lo:104: 00000100:00100000:1.0:1783952228.966631:0:95439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952228.966744:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465618432 00000100:00100000:0.0:1783952228.966751:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465618432 00000100:00100000:0.0:1783952228.966842:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465618560 00000100:00100000:0.0:1783952228.966847:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465618560 00010000:00010000:1.0:1783952228.966912:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b140030400/0x22c73c7857bb6486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb647f expref: 23 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.966920:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b140030400/0x22c73c7857bb6486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb647f expref: 23 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.966928:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618688:0@lo:104: 00000100:00100000:1.0:1783952228.966966:0:95439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952228.967362:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b140031600/0x22c73c7857bb6478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb6471 expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.967371:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b140031600/0x22c73c7857bb6478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb6471 expref: 23 pid: 94411 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.967378:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b603b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618816:0@lo:104: 00000100:00100000:1.0:1783952228.967404:0:95439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.967430:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465618688 00000100:00100000:3.0:1783952228.967435:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465618688 00000100:00100000:3.0:1783952228.967458:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1783952228.967466:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:95439:x1870605465618432:12345-0@lo:104: 00010000:00010000:3.0:1783952228.967480:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.967532:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783952228.967538:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:95439:x1870605465618432:12345-0@lo:104: Request processed in 73us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.967546:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1783952228.967564:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1783952228.967577:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:95439:x1870605465618560:12345-0@lo:104: 00010000:00010000:3.0:1783952228.967585:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.967769:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783952228.967775:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:95439:x1870605465618560:12345-0@lo:104: Request processed in 199us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.967782:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1783952228.967795:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1783952228.967801:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95439:x1870605465618688:12345-0@lo:104: 00010000:00010000:3.0:1783952228.967808:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.967839:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783952228.967844:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95439:x1870605465618688:12345-0@lo:104: Request processed in 44us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.967850:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:3.0:1783952228.967868:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783952228.967874:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.967882:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ae00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952228.968071:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968083:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952228.968091:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952228.968104:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952228.968134:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968141:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952228.968160:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968167:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb649b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb64a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968181:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783952228.968185:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968191:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952228.968194:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968202:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952228.968208:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952228.968214:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952228.968226:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968232:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952228.968253:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968261:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86b400/0x22c73c7857bb648d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968270:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952228.968273:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968279:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70600 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952228.968282:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968289:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952228.968296:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952228.968301:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952228.968316:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968322:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952228.968328:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968335:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70600/0x22c73c7857bb647f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6486 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968345:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952228.968352:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952228.968354:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952228.968360:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952228.968365:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952228.968378:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465618944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952228.968409:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.968444:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465619200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952228.968468:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.968485:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952228.968491:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465619072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952228.968510:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.968534:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465618944 00000100:00100000:3.0:1783952228.968538:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465618944 00010000:00010000:3.0:1783952228.968559:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb64a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb649b expref: 24 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952228.968581:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465619200 00000100:00100000:3.0:1783952228.968583:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465619200 00010000:00010000:3.0:1783952228.968616:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b140030400/0x22c73c7857bb6486 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb647f expref: 25 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952228.968804:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465619072 00000100:00100000:3.0:1783952228.968807:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465619072 00010000:00010000:3.0:1783952228.968821:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb6494 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb648d expref: 26 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952228.968837:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1783952228.968843:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+26:3643:x1870605465618944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952228.968855:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952228.968869:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb64a2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb649b expref: 26 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968878:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb64a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb649b expref: 26 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.968909:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952228.969093:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+26:3643:x1870605465618944:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.969102:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1783952228.969122:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1783952228.969129:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15628f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3645:x1870605465619200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952228.969138:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952228.969143:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b140030400/0x22c73c7857bb6486 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb647f expref: 25 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.969153:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b140030400/0x22c73c7857bb6486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb647f expref: 25 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.969164:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952228.969194:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15628f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3645:x1870605465619200:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.969200:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1783952228.969236:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:3.0:1783952228.969243:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465619072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952228.969250:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952228.969255:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb6494 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb648d expref: 24 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.969277:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb6494 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb648d expref: 24 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.969287:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952228.969312:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465619072:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.969319:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:3.0:1783952228.969374:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465618944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952228.969398:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465619072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783952228.969406:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465619200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952228.973175:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b140030e00/0x22c73c7857bb646a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb6463 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.973193:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b140030e00/0x22c73c7857bb646a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb6463 expref: 23 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.973208:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465619328:0@lo:104: 00010000:00010000:1.0:1783952228.973259:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b140031000/0x22c73c7857bb645c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb6455 expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.973268:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b140031000/0x22c73c7857bb645c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb6455 expref: 23 pid: 94411 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.973276:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465619456:0@lo:104: 00010000:00010000:1.0:1783952228.973303:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb644e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb6447 expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.973312:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb644e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb6447 expref: 23 pid: 94412 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.973321:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465619584:0@lo:104: 00010000:00010000:1.0:1783952228.973342:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb6440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb6439 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.973363:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb6440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb6439 expref: 23 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.973372:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465619712:0@lo:104: 00010000:00010000:1.0:1783952228.973397:0:95439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb6432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb642b expref: 23 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.973406:0:95439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb6432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb642b expref: 23 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.973414:0:95439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465619840:0@lo:104: 00000100:00100000:1.0:1783952228.973432:0:95439:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1746b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1783952228.973458:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618176:192.168.202.48@tcp:104: 00000100:00100000:1.0:1783952228.973468:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b164e3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618304:192.168.202.48@tcp:104: 00010000:00010000:1.0:1783952228.973478:0:95439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb64a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb649b expref: 23 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.973491:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ac6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618432:0@lo:104: 00010000:00010000:1.0:1783952228.973502:0:95439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b14d86be00/0x22c73c7857bb6494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb648d expref: 22 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.973512:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144916d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618560:0@lo:104: 00010000:00010000:1.0:1783952228.973522:0:95439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140030400/0x22c73c7857bb6486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb647f expref: 21 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.973530:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618688:0@lo:104: 00000100:00100000:3.0:1783952228.973839:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465618816 00000100:00100000:3.0:1783952228.973846:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465618816 00000100:00100000:3.0:1783952228.974110:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1783952228.974120:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165b66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95439:x1870605465618816:12345-0@lo:104: 00010000:00010000:3.0:1783952228.974135:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952228.974206:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783952228.974213:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165b66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95439:x1870605465618816:12345-0@lo:104: Request processed in 95us (6808us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952228.974220:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1783952228.974266:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952228.974311:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b603b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465618816:0@lo:104: 00000100:00100000:3.0:1783952228.974385:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952228.974405:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465619328 00000100:00100000:0.0:1783952228.974410:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465619328 00000100:00100000:0.0:1783952228.974431:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1783952228.974437:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95439:x1870605465619328:12345-0@lo:104: 00010000:00010000:0.0:1783952228.974446:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952228.974528:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783952228.974534:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95439:x1870605465619328:12345-0@lo:104: Request processed in 98us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952228.974541:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783952228.974628:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465619328:0@lo:104: 00000100:00100000:0.0:1783952228.977295:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952228.977385:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952228.977463:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447790336 00000100:00100000:1.0:1783952228.977472:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447790336 00010000:00010000:1.0:1783952228.977509:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b140030200/0x22c73c7857bb64b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a561 expref: 10 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.977545:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447790464 00000100:00100000:1.0:1783952228.977548:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447790464 00010000:00010000:1.0:1783952228.977560:0:26211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb64a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a55a expref: 11 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952228.977580:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2596 00000100:00100000:1.0:1783952228.977612:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e617e28a-7c0f-459e-8765-f628898cec50+11:2400:x1870605447790336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783952228.977637:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952228.977651:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b140030200/0x22c73c7857bb64b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a561 expref: 11 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.977663:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b140030200/0x22c73c7857bb64b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a561 expref: 11 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.977683:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140030200/0x22c73c7857bb64b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a561 expref: 11 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.977701:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952228.977751:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447790336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 162us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952228.977758:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2596 00000100:00100000:1.0:1783952228.977793:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2597 00000100:00100000:1.0:1783952228.977800:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e617e28a-7c0f-459e-8765-f628898cec50+9:2400:x1870605447790464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783952228.977810:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952228.977815:0:26211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb64a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a55a expref: 9 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.977824:0:26211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb64a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a55a expref: 9 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.977835:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbc000/0x22c73c7857bb64a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a55a expref: 9 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952228.977843:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952228.977864:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e617e28a-7c0f-459e-8765-f628898cec50+8:2400:x1870605447790464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 64us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952228.977870:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2597 00000100:00100000:3.0:1783952228.978954:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952228.989230:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:2.0:1783952228.989269:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465619456 00000100:00100000:2.0:1783952228.989279:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465619456 00000100:00100000:3.0:1783952228.993294:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.993311:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952228.993353:0:10395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465619584 00000100:00100000:3.0:1783952228.993361:0:10395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465619584 00000100:00100000:0.0:1783952228.999764:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465619712 00000100:00100000:0.0:1783952228.999782:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465619712 00000100:00100000:2.0:1783952229.004377:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465619840 00000100:00100000:2.0:1783952229.004394:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465619840 00000100:00100000:3.0:1783952229.006450:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1783952229.006471:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:95439:x1870605465619456:12345-0@lo:104: 00010000:00010000:3.0:1783952229.006491:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952229.007941:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783952229.007958:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:95439:x1870605465619584:12345-0@lo:104: 00010000:00010000:0.0:1783952229.007974:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952229.008840:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783952229.008850:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+6:95439:x1870605465619456:12345-0@lo:104: Request processed in 2388us (34464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952229.008859:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1783952229.008887:0:10395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1783952229.008906:0:10395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:95439:x1870605465619712:12345-0@lo:104: 00010000:00010000:3.0:1783952229.008922:0:10395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.011295:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783952229.011311:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+5:95439:x1870605465619584:12345-0@lo:104: Request processed in 3356us (32358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952229.011337:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:0.0:1783952229.011386:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783952229.011394:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.011404:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952229.011409:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.011419:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952229.011427:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952229.011432:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952229.011473:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.011480:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952229.011499:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.011507:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db71400/0x22c73c7857bb6471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.011522:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783952229.011526:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.011543:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952229.011547:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.011554:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952229.011561:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952229.011566:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952229.011583:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.011606:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952229.011614:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.011633:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70400/0x22c73c7857bb6463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb646a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012570:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952229.012578:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012611:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030800 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952229.012616:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012640:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952229.012659:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952229.012665:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952229.012686:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012693:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952229.012717:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012725:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b140030800/0x22c73c7857bb6455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb645c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012738:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952229.012742:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012748:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70c00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952229.012751:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012759:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952229.012766:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952229.012778:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952229.012793:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012800:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952229.012806:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012814:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db70c00/0x22c73c7857bb6447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb644e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.012823:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952229.012825:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952229.012827:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952229.012861:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465619968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952229.012958:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952229.013018:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952229.013024:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465620096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952229.013050:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952229.013078:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465620352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952229.013099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952229.013115:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783952229.013120:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465620224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952229.013142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952229.013164:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465619968 00000100:00100000:0.0:1783952229.013170:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465619968 00010000:00010000:0.0:1783952229.013198:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b140031600/0x22c73c7857bb6478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6471 expref: 21 pid: 94411 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952229.013225:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465620096 00000100:00100000:0.0:1783952229.013228:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465620096 00010000:00010000:0.0:1783952229.013239:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b140030e00/0x22c73c7857bb646a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6463 expref: 22 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952229.013249:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465620352 00000100:00100000:0.0:1783952229.013252:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465620352 00010000:00010000:0.0:1783952229.013260:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb644e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6447 expref: 23 pid: 94412 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952229.013269:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465620224 00000100:00100000:0.0:1783952229.013271:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465620224 00010000:00010000:0.0:1783952229.013280:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b140031000/0x22c73c7857bb645c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6455 expref: 24 pid: 94411 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952229.013291:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:0.0:1783952229.013297:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465619968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952229.013310:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952229.013315:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b140031600/0x22c73c7857bb6478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6471 expref: 24 pid: 94411 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013326:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b140031600/0x22c73c7857bb6478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb6471 expref: 24 pid: 94411 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013341:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140031600/0x22c73c7857bb6478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb6471 expref: 24 pid: 94411 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013354:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952229.013386:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3642:x1870605465619968:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952229.013399:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:0.0:1783952229.013414:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:0.0:1783952229.013421:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3642:x1870605465620096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952229.013429:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952229.013433:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b140030e00/0x22c73c7857bb646a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6463 expref: 22 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013441:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b140030e00/0x22c73c7857bb646a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb6463 expref: 22 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013451:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140030e00/0x22c73c7857bb646a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb6463 expref: 22 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013460:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952229.013462:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1783952229.013472:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:95439:x1870605465619840:12345-0@lo:104: 00000100:00100000:0.0:1783952229.013479:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3642:x1870605465620096:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (430us total) trans 0 rc 0/0 00010000:00010000:2.0:1783952229.013483:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952229.013485:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:0.0:1783952229.013495:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1783952229.013500:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3645:x1870605465620352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952229.013506:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952229.013510:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb644e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6447 expref: 20 pid: 94412 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013518:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb644e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb6447 expref: 20 pid: 94412 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.013521:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783952229.013525:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:95439:x1870605465619840:12345-0@lo:104: Request processed in 58us (20215us total) trans 0 rc 0/0 00010000:00010000:0.0:1783952229.013526:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952229.013531:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1783952229.013547:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:3645:x1870605465620352:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952229.013557:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1783952229.013569:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1783952229.013574:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ef40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3645:x1870605465620224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952229.013581:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952229.013602:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b140031000/0x22c73c7857bb645c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6455 expref: 19 pid: 94411 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013611:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b140031000/0x22c73c7857bb645c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb6455 expref: 19 pid: 94411 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013620:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952229.013642:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ef40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3645:x1870605465620224:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952229.013648:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1783952229.013699:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465620096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952229.013708:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465619968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952229.013731:0:15262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952229.013736:0:15262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013742:0:15262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b200 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952229.013746:0:15262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013754:0:15262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952229.013771:0:15262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952229.013777:0:15262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783952229.013803:0:15262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013810:0:15262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783952229.013823:0:15262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013829:0:15262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86b200/0x22c73c7857bb642b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6432 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.013839:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952229.013841:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952229.013843:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952229.013859:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465620224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952229.013865:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465620352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952229.013882:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465620480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952229.013904:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952229.013943:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465620480 00000100:00100000:0.0:1783952229.013947:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465620480 00010000:00010000:0.0:1783952229.013963:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb6432 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb642b expref: 19 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952229.013979:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:0.0:1783952229.013985:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3642:x1870605465620480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952229.013998:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952229.014002:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb6432 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb642b expref: 19 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.014010:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb6432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb642b expref: 19 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952229.014019:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952229.014044:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3642:x1870605465620480:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952229.014050:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:0.0:1783952229.014073:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465620480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783952229.014459:0:10395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783952229.014466:0:10395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:95439:x1870605465619712:12345-0@lo:104: Request processed in 5572us (21178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952229.014473:0:10395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:3.0:1783952229.014493:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952229.014499:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952229.014506:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a200 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:3.0:1783952229.014510:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952229.014518:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783952229.014532:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952229.014537:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783952229.014559:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952229.014566:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783952229.014576:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952229.014584:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86a200/0x22c73c7857bb6439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6440 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952229.014617:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952229.014619:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952229.014621:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952229.014627:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952229.014767:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952229.016761:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952229.019225:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465620608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952229.019311:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952229.019870:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465620608 00000100:00100000:2.0:1783952229.019880:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465620608 00010000:00010000:2.0:1783952229.019919:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb6440 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6439 expref: 19 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952229.019962:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1783952229.019985:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:3643:x1870605465620608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783952229.020000:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952229.020006:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb6440 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6439 expref: 19 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.020018:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb6440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb6439 expref: 19 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952229.020224:0:95439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140031000/0x22c73c7857bb645c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb6455 expref: 19 pid: 94411 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952229.020238:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465619456:0@lo:104: 00010000:00010000:1.0:1783952229.020257:0:95439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb644e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb6447 expref: 18 pid: 94412 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952229.020266:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465619584:0@lo:104: 00000100:00100000:1.0:1783952229.020275:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465619712:0@lo:104: 00010000:00010000:1.0:1783952229.020284:0:95439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbd600/0x22c73c7857bb6432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb642b expref: 17 pid: 94415 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952229.020304:0:95439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95439:1870605465619840:0@lo:104: 00010000:00010000:2.0:1783952229.020658:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbdc00/0x22c73c7857bb6440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb6439 expref: 16 pid: 94410 timeout: 4043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952229.028366:0:95439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.032759:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.032787:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.034121:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.034135:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.034143:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.034151:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.034157:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70800 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:2.0:1783952229.034162:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.034183:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.034214:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952229.034232:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783952229.034323:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:3643:x1870605465620608:12345-0@lo:103:ldlm_bl.0 Request processed in 14335us (15009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952229.034333:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:3.0:1783952229.034489:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465620608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952229.034556:0:95439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952229.034566:0:95439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952229.034572:0:95439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952229.920741:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952229.984996:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465620736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783952229.985066:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952229.985112:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952229.985119:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465620864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952229.985141:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952229.990041:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465620736 00000100:00100000:0.0:1783952229.990058:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465620736 00000100:00100000:1.0:1783952229.990421:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465620864 00000100:00100000:1.0:1783952229.990427:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465620864 00000100:00100000:0.0:1783952229.992064:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267 00000100:00100000:0.0:1783952229.992083:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465620736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783952229.992114:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783952229.992213:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465620736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (7147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952229.992222:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267 00000100:00100000:3.0:1783952229.992564:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465620736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952229.996750:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268 00000100:00100000:1.0:1783952229.997311:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465620864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952229.997341:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952229.997430:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465620864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 668us (12286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952229.997439:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268 00000100:00100000:3.0:1783952229.998132:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465620864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952230.256983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952230.257865:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447790592 00000100:00100000:1.0:1783952230.257879:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447790592 00000100:00100000:1.0:1783952230.258043:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 131 00000100:00100000:1.0:1783952230.258057:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+8:70975:x1870605447790592:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952230.258080:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952230.258107:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a568 expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.258167:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a568 expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.258180:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a568 expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.258193:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70800, rc 0) 00000100:00100000:1.0:1783952230.258278:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447790592:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 224us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.258287:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 131 00000100:00100000:3.0:1783952230.260970:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952230.261515:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447790720 00000100:00100000:0.0:1783952230.261529:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447790720 00000100:00100000:0.0:1783952230.261631:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 132 00000100:00100000:0.0:1783952230.261645:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447790720:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.261885:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447790720:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 243us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952230.261894:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 132 00000100:00100000:3.0:1783952230.264097:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952230.264220:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447790848 00000100:00100000:0.0:1783952230.264230:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447790848 00000100:00100000:0.0:1783952230.264280:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 133 00000100:00100000:0.0:1783952230.264291:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447790848:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.264467:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447790848:12345-192.168.202.48@tcp:503:ll_cfg_requeue.0 Request processed in 178us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952230.264475:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 133 00000100:00100000:0.0:1783952230.268697:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952230.269274:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447790976 00000100:00100000:1.0:1783952230.269289:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447790976 00000100:00100000:1.0:1783952230.269377:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 134 00000100:00100000:1.0:1783952230.269389:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:73372:x1870605447790976:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783952230.269632:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:73372:x1870605447790976:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 201us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.269641:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 134 00000100:00100000:1.0:1783952230.275303:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952230.282876:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447791104 00000100:00100000:0.0:1783952230.282899:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447791104 00000100:00100000:0.0:1783952230.283010:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 135 00000100:00100000:0.0:1783952230.283033:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:73372:x1870605447791104:12345-192.168.202.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783952230.283253:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:73372:x1870605447791104:12345-192.168.202.48@tcp:502:llog_process_th.0 Request processed in 232us (7965us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952230.283263:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 135 00000100:00100000:3.0:1783952230.291000:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952230.291648:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447791232 00000100:00100000:1.0:1783952230.291666:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447791232 00000100:00100000:1.0:1783952230.291737:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 136 00000100:00100000:1.0:1783952230.291748:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447791232:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952230.291769:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952230.291792:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb64c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a56f expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.291857:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb64c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a56f expref: 10 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.291869:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb64c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a56f expref: 10 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.291879:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70a00, rc 0) 00000100:00100000:1.0:1783952230.291965:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447791232:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 219us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.291972:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 136 00000100:00100000:1.0:1783952230.295980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952230.296092:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447791360 00000100:00100000:0.0:1783952230.296104:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447791360 00000100:00100000:0.0:1783952230.296173:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 137 00000100:00100000:0.0:1783952230.296185:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447791360:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.296386:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447791360:12345-192.168.202.48@tcp:501:ll_cfg_requeue.0 Request processed in 203us (418us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783952230.296423:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 137 10000000:01000000:3.0:1783952230.880772:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783952230.880783:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b04661c800 from 61 10000000:01000000:3.0:1783952230.880791:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783952230.880863:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86b800/0x22c73c7857bb64cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.881001:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86b800/0x22c73c7857bb64cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.881015:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86b800/0x22c73c7857bb64cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952230.881051:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465620992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952230.881484:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952230.881547:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048c7d900 going to sleep for 11 seconds 00000100:00100000:1.0:1783952230.881683:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465620992 00000100:00100000:1.0:1783952230.881693:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465620992 00000100:00100000:1.0:1783952230.881765:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783952230.881776:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+15:6514:x1870605465620992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952230.881793:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952230.881810:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70c00/0x22c73c7857bb64d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb64cc expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.881840:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70c00/0x22c73c7857bb64d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb64cc expref: 16 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.881851:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70c00/0x22c73c7857bb64d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64cc expref: 16 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.881860:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70c00, rc 0) 00000100:00100000:1.0:1783952230.881928:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465620992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.881952:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783952230.882266:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465620992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952230.882287:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86b800/0x22c73c7857bb64cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64d3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.882298:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86b800/0x22c73c7857bb64cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64d3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952230.883527:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465621120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952230.883628:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952230.883677:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048c7d900 going to sleep for 11 seconds 00000100:00100000:0.0:1783952230.883882:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465621120 00000100:00100000:0.0:1783952230.883890:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465621120 00000100:00100000:0.0:1783952230.883951:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783952230.883960:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465621120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.884149:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465621120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952230.884157:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783952230.884265:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465621120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.884313:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465621248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.884378:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952230.884401:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fb7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783952230.884618:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465621248 00000100:00100000:1.0:1783952230.884624:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465621248 00000100:00100000:1.0:1783952230.884663:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783952230.884672:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465621248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.884856:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465621248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.884864:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783952230.885540:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465621248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.887482:0:95443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95443:1870605465621376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952230.887621:0:95443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952230.887679:0:95443:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049a33240 going to sleep for 11 seconds 00000100:00100000:1.0:1783952230.888487:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465621376 00000100:00100000:1.0:1783952230.888498:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465621376 00000100:00100000:1.0:1783952230.888687:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783952230.888699:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:95443:x1870605465621376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952230.888900:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:95443:x1870605465621376:12345-0@lo:502:llog_process_th.0 Request processed in 203us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.888909:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783952230.889030:0:95443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95443:1870605465621376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952230.889120:0:95443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95443:1870605465621504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952230.889164:0:95443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952230.894117:0:95443:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee79f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.898060:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465621504 00000100:00100000:2.0:1783952230.898083:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465621504 00000100:00100000:2.0:1783952230.898270:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783952230.898284:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:95443:x1870605465621504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952230.898758:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:95443:x1870605465621504:12345-0@lo:502:llog_process_th.0 Request processed in 476us (9591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.898766:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783952230.901852:0:95443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95443:1870605465621504:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783952230.901932:0:95443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1783952230.902343:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1783952230.902386:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783952230.902401:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86b800/0x22c73c7857bb64cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64d3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.902439:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86b800/0x22c73c7857bb64cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64d3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952230.902453:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783952230.902456:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:2.0:1783952230.902459:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783952230.902509:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb64da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.902518:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb64da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.902529:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb64da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952230.902559:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e58380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465621632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.902676:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952230.902720:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fb7240 going to sleep for 11 seconds 00000100:00100000:0.0:1783952230.902932:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465621632 00000100:00100000:0.0:1783952230.902941:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465621632 00000100:00100000:0.0:1783952230.903010:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783952230.903020:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+16:6514:x1870605465621632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952230.903037:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952230.903061:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbd000/0x22c73c7857bb64e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb64da expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.903090:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbd000/0x22c73c7857bb64e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb64da expref: 17 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.903116:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbd000/0x22c73c7857bb64e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64da expref: 17 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.903126:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd000, rc 0) 00000100:00100000:0.0:1783952230.903239:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465621632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952230.903247:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783952230.907685:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e58380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465621632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952230.907732:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb64da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.907757:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb64da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952230.907888:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465621760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952230.908297:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952230.908353:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048c7d900 going to sleep for 11 seconds 00000100:00100000:1.0:1783952230.908506:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465621760 00000100:00100000:1.0:1783952230.908515:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465621760 00000100:00100000:1.0:1783952230.908580:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783952230.908616:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465621760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.908875:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465621760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.908884:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783952230.916718:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465621760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.916836:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465621888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.920260:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952230.921043:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fb7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783952230.924979:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465621888 00000100:00100000:0.0:1783952230.924999:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465621888 00000100:00100000:1.0:1783952230.925348:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783952230.925373:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465621888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.925655:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465621888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 295us (5407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.925672:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783952230.925949:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465621888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952230.926661:0:95444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95444:1870605465622016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952230.926809:0:95444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952230.926853:0:95444:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b151339d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.926947:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465622016 00000100:00100000:2.0:1783952230.926954:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465622016 00000100:00100000:2.0:1783952230.927001:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783952230.927010:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:95444:x1870605465622016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952230.927275:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:95444:x1870605465622016:12345-0@lo:502:llog_process_th.0 Request processed in 265us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.927289:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783952230.927540:0:95444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95444:1870605465622016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952230.927575:0:95444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952230.927614:0:95444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952230.927618:0:95444:0:(obd_config.c:1561:class_process_config()) marker 50 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:3.0:1783952230.927626:0:95444:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1783952230.942275:0:95444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95444:1870605465622144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952230.943214:0:95444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952230.943314:0:95444:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b176694540 going to sleep for 11 seconds 00000100:00100000:3.0:1783952230.947278:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465622144 00000100:00100000:3.0:1783952230.947299:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465622144 00000100:00100000:3.0:1783952230.947556:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783952230.947571:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:95444:x1870605465622144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952230.948398:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:95444:x1870605465622144:12345-0@lo:502:llog_process_th.0 Request processed in 826us (5182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952230.948422:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783952230.948554:0:95444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95444:1870605465622144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783952230.948637:0:95444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783952230.948648:0:95444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783952230.948651:0:95444:0:(obd_config.c:1561:class_process_config()) marker 50 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:2.0:1783952230.948657:0:95444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:0.0:1783952230.948938:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:0.0:1783952230.948967:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783952230.948981:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb64da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.948994:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb64da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952230.949007:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783952230.949011:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b151231000 from 61 10000000:01000000:0.0:1783952230.949014:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783952230.949057:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbc800/0x22c73c7857bb64e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.949065:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbc800/0x22c73c7857bb64e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.949089:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbc800/0x22c73c7857bb64e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952230.949130:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465622272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.949194:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952230.954207:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465622272 00000100:00100000:1.0:1783952230.954230:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465622272 00000100:00100000:1.0:1783952230.954326:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783952230.954339:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+17:6514:x1870605465622272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783952230.954364:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952230.954390:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b04db70400/0x22c73c7857bb64ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb64e8 expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.954432:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b04db70400/0x22c73c7857bb64ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb64e8 expref: 18 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.954445:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b04db70400/0x22c73c7857bb64ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64e8 expref: 18 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952230.954456:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db70400, rc 0) 00000100:00100000:1.0:1783952230.954561:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465622272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (5367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.954570:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783952230.955132:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee79300 going to sleep for 11 seconds 00000100:00100000:0.0:1783952230.955182:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465622272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952230.955206:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbc800/0x22c73c7857bb64e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.955220:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbc800/0x22c73c7857bb64e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952230.955329:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465622400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.955379:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952230.955405:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee79300 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.955498:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465622400 00000100:00100000:2.0:1783952230.955505:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465622400 00000100:00100000:2.0:1783952230.955540:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783952230.955549:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465622400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.955737:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465622400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.955745:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783952230.955839:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465622400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.956043:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465622528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.956104:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952230.956132:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee79300 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.956146:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465622528 00000100:00100000:2.0:1783952230.956150:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465622528 00000100:00100000:2.0:1783952230.956190:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783952230.956197:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465622528:12345-0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1783952230.956291:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952230.956294:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465622528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.956301:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783952230.956359:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465622528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783952230.957351:0:95445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95445:1870605465622656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952230.957426:0:95445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952230.957468:0:95445:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b151339480 going to sleep for 11 seconds 00000100:00100000:1.0:1783952230.957574:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465622656 00000100:00100000:1.0:1783952230.957583:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465622656 00000100:00100000:1.0:1783952230.957749:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783952230.957759:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:95445:x1870605465622656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952230.957928:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:95445:x1870605465622656:12345-0@lo:502:llog_process_th.0 Request processed in 170us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.957944:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783952230.958036:0:95445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95445:1870605465622656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952230.958092:0:95445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95445:1870605465622784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952230.958131:0:95445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952230.960001:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465622784 00000100:00100000:3.0:1783952230.960017:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465622784 00000100:00100000:2.0:1783952230.960032:0:95445:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b166fb7240 going to sleep for 11 seconds 00000100:00100000:3.0:1783952230.960091:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783952230.960113:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:95445:x1870605465622784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952230.960314:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:95445:x1870605465622784:12345-0@lo:502:llog_process_th.0 Request processed in 214us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952230.960322:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783952230.961651:0:95445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95445:1870605465622784:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783952230.961730:0:95445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1783952230.961860:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1783952230.961898:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783952230.961922:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbc800/0x22c73c7857bb64e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.961948:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbc800/0x22c73c7857bb64e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952230.961961:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783952230.961964:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:0.0:1783952230.961967:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783952230.962017:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbdc00/0x22c73c7857bb64f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.962026:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbdc00/0x22c73c7857bb64f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.962037:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbdc00/0x22c73c7857bb64f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952230.962064:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465622912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.962479:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952230.962614:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee79300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952230.962755:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465622912 00000100:00100000:3.0:1783952230.962764:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465622912 00000100:00100000:3.0:1783952230.962869:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783952230.962880:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+18:6514:x1870605465622912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952230.963020:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952230.963043:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86a200/0x22c73c7857bb64fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb64f6 expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.963077:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86a200/0x22c73c7857bb64fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb64f6 expref: 19 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.963091:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86a200/0x22c73c7857bb64fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64f6 expref: 19 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.963202:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a200, rc 0) 00000100:00100000:3.0:1783952230.963330:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465622912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 451us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952230.963339:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783952230.963500:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465622912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952230.963524:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbdc00/0x22c73c7857bb64f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.963536:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbdc00/0x22c73c7857bb64f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952230.963661:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465623040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.963698:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952230.963743:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee79300 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.964085:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465623040 00000100:00100000:2.0:1783952230.964093:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465623040 00000100:00100000:2.0:1783952230.964139:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783952230.964149:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465623040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.964313:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465623040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.964321:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783952230.964342:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465623040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.964493:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465623168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.964544:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952230.964645:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee79300 going to sleep for 11 seconds 00000100:00100000:1.0:1783952230.964728:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465623168 00000100:00100000:1.0:1783952230.964734:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465623168 00000100:00100000:1.0:1783952230.964809:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783952230.964819:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465623168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.964951:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465623168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.964958:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783952230.965038:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465623168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.965574:0:95446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95446:1870605465623296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952230.965651:0:95446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952230.965974:0:95446:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952230.966077:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465623296 00000100:00100000:3.0:1783952230.966084:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465623296 00000100:00100000:2.0:1783952230.966231:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783952230.966243:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:95446:x1870605465623296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952230.966550:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:95446:x1870605465623296:12345-0@lo:502:llog_process_th.0 Request processed in 310us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.966559:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783952230.966676:0:95446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047999f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95446:1870605465623296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952230.966714:0:95446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952230.966731:0:95446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952230.966734:0:95446:0:(obd_config.c:1561:class_process_config()) marker 51 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:3.0:1783952230.966742:0:95446:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1783952230.966983:0:95446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95446:1870605465623424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952230.967033:0:95446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952230.967184:0:95446:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1429ca300 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.967235:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465623424 00000100:00100000:2.0:1783952230.967241:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465623424 00000100:00100000:2.0:1783952230.967284:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783952230.967293:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:95446:x1870605465623424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952230.967404:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:95446:x1870605465623424:12345-0@lo:502:llog_process_th.0 Request processed in 111us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.967412:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783952230.967660:0:95446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95446:1870605465623424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783952230.967686:0:95446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952230.967692:0:95446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952230.967694:0:95446:0:(obd_config.c:1561:class_process_config()) marker 51 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:3.0:1783952230.967700:0:95446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:0.0:1783952230.967975:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:0.0:1783952230.967999:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783952230.968011:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbdc00/0x22c73c7857bb64f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.968025:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbdc00/0x22c73c7857bb64f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb64fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952230.968035:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783952230.968039:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b046482800 from 61 10000000:01000000:0.0:1783952230.968041:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783952230.968075:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd600/0x22c73c7857bb6504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.968083:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbd600/0x22c73c7857bb6504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.968093:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbd600/0x22c73c7857bb6504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952230.968126:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465623552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.968163:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952230.968200:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952230.968529:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465623552 00000100:00100000:3.0:1783952230.968536:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465623552 00000100:00100000:3.0:1783952230.968583:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783952230.968613:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+19:6514:x1870605465623552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952230.968627:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952230.968645:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb650b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6504 expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.968674:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb650b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6504 expref: 20 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.968700:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb650b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6504 expref: 20 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.968710:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86b400, rc 0) 00000100:00100000:3.0:1783952230.968753:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465623552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952230.968760:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783952230.969044:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465623552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952230.969062:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbd600/0x22c73c7857bb6504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb650b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.969074:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbd600/0x22c73c7857bb6504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb650b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952230.969154:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465623680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.969187:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952230.969221:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783952230.969275:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465623680 00000100:00100000:3.0:1783952230.969280:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465623680 00000100:00100000:1.0:1783952230.969392:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783952230.969405:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465623680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.969566:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465623680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952230.969574:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783952230.969812:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465623680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.969851:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465623808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783952230.969910:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952230.970294:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465623808 00000100:00100000:2.0:1783952230.970301:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465623808 00000100:00100000:2.0:1783952230.970330:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783952230.970338:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465623808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.970433:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465623808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.970447:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783952230.970656:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.970676:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465623808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.976583:0:95447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95447:1870605465623936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952230.976878:0:95447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952230.977040:0:95447:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1500f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783952230.977202:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465623936 00000100:00100000:0.0:1783952230.977212:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465623936 00000100:00100000:2.0:1783952230.977326:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783952230.977340:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:95447:x1870605465623936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952230.977534:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:95447:x1870605465623936:12345-0@lo:502:llog_process_th.0 Request processed in 197us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.977541:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783952230.977755:0:95447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95447:1870605465623936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952230.977826:0:95447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95447:1870605465624064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952230.977865:0:95447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952230.977904:0:95447:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048af1840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.978069:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465624064 00000100:00100000:2.0:1783952230.978074:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465624064 00000100:00100000:2.0:1783952230.978122:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783952230.978130:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:95447:x1870605465624064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783952230.978222:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:95447:x1870605465624064:12345-0@lo:502:llog_process_th.0 Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.978229:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783952230.978534:0:95447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95447:1870605465624064:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783952230.978560:0:95447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1783952230.978840:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1783952230.978877:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783952230.978901:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd600/0x22c73c7857bb6504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb650b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.978923:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbd600/0x22c73c7857bb6504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb650b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952230.978935:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783952230.978938:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783952230.978941:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783952230.978982:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb6512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.978991:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb6512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.979002:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb6512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952230.979036:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952230.979083:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952230.979111:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1429ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.980237:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465624192 00000100:00100000:2.0:1783952230.980251:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465624192 00000100:00100000:2.0:1783952230.980320:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783952230.980331:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+20:6514:x1870605465624192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952230.980350:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952230.980368:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140031400/0x22c73c7857bb6519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6512 expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.980402:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140031400/0x22c73c7857bb6519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6512 expref: 21 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.980433:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140031400/0x22c73c7857bb6519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6512 expref: 21 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.980443:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031400, rc 0) 00000100:00100000:2.0:1783952230.980519:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465624192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.980526:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783952230.980993:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952230.981016:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb6512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6519 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.981028:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb6512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6519 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952230.981140:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952230.981182:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952230.981227:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1429ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.981386:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465624320 00000100:00100000:2.0:1783952230.981393:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465624320 00000100:00100000:2.0:1783952230.981438:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783952230.981446:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465624320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.981658:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465624320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.981666:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783952230.981952:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.982010:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.982062:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952230.982091:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048af1840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.982222:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465624448 00000100:00100000:2.0:1783952230.982227:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465624448 00000100:00100000:2.0:1783952230.982252:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783952230.982258:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465624448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.982363:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465624448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.982370:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783952230.982496:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783952230.984024:0:95448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783952230.984320:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783952230.984350:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783952230.984364:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb6512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6519 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.984379:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb6512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6519 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783952230.984391:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783952230.984394:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b174849000 from 61 10000000:01000000:3.0:1783952230.984397:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783952230.984442:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.984470:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952230.984485:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952230.984517:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783952230.984873:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952230.985078:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465624576 00000100:00100000:2.0:1783952230.985088:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465624576 00000100:00100000:2.0:1783952230.985229:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783952230.985240:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:6514:x1870605465624576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952230.985270:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952230.985288:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b140030000/0x22c73c7857bb6527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6520 expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.985319:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b140030000/0x22c73c7857bb6527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6520 expref: 22 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.985332:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b140030000/0x22c73c7857bb6527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6520 expref: 22 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.985343:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030000, rc 0) 00000100:00100000:2.0:1783952230.985395:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465624576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.985403:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783952230.985455:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1429ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.985480:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952230.985497:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.985509:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952230.985632:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.985665:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952230.985682:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1449a0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783952230.985757:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465624704 00000100:00100000:3.0:1783952230.985762:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465624704 00000100:00100000:3.0:1783952230.985797:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783952230.985806:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465624704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952230.985973:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465624704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952230.985980:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783952230.986271:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.986313:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.986367:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952230.986390:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048af1000 going to sleep for 11 seconds 00000100:00100000:2.0:1783952230.986432:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465624832 00000100:00100000:2.0:1783952230.986437:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465624832 00000100:00100000:2.0:1783952230.986472:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783952230.986487:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465624832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.986625:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465624832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952230.986632:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783952230.987936:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465624832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783952230.989376:0:95449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95449:1870605465624960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952230.989480:0:95449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952230.989533:0:95449:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048af1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783952230.989641:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465624960 00000100:00100000:0.0:1783952230.989652:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465624960 00000100:00100000:0.0:1783952230.989714:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783952230.989727:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14e172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:95449:x1870605465624960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783952230.989925:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14e172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:95449:x1870605465624960:12345-0@lo:502:llog_process_th.0 Request processed in 201us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952230.989945:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783952230.990228:0:95449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95449:1870605465624960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952230.990285:0:95449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95449:1870605465625088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783952230.990327:0:95449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952230.990365:0:95449:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048af1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783952230.990408:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465625088 00000100:00100000:3.0:1783952230.990415:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465625088 00000100:00100000:3.0:1783952230.990455:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783952230.990464:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f3b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:95449:x1870605465625088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783952230.990549:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f3b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:95449:x1870605465625088:12345-0@lo:502:llog_process_th.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952230.990557:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783952230.990705:0:95449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04b600380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:95449:1870605465625088:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783952230.990724:0:95449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1783952230.991097:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1783952230.991134:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783952230.991148:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.991160:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952230.991171:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783952230.991174:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1783952230.991178:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783952230.991214:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.991223:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.991234:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952230.991252:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465625216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.991293:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952230.991329:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b160306b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783952230.991497:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465625216 00000100:00100000:0.0:1783952230.991504:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465625216 00000100:00100000:0.0:1783952230.991583:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783952230.991624:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465625216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783952230.991639:0:94411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952230.991655:0:94411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb6535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb652e expref: -99 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.991683:0:94411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb6535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb652e expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.991693:0:94411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb6535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb652e expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952230.991702:0:94411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbda00, rc 0) 00000100:00100000:0.0:1783952230.991754:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465625216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952230.991761:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783952230.991840:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465625216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952230.991870:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952230.991880:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952230.991961:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465625344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952230.991992:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952231.003095:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b160306b40 going to sleep for 10 seconds 00000100:00100000:3.0:1783952231.007950:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465625344 00000100:00100000:3.0:1783952231.007972:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465625344 00000100:00100000:3.0:1783952231.008097:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783952231.008121:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465625344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952231.008381:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465625344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (16387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952231.008391:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783952231.008658:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465625344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952231.008732:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465625472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952231.008801:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952231.008840:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b160306b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952231.009070:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465625472 00000100:00100000:3.0:1783952231.009075:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465625472 00000100:00100000:3.0:1783952231.009848:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783952231.009863:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465625472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783952231.010886:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465625472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783952231.012701:0:95451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000100:00100000:3.0:1783952231.013474:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465625472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3609us (4665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952231.013490:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000020:01000000:2.0:1783952231.014081:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1783952231.014873:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783952231.014960:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952231.014979:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952231.014992:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783952231.014996:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97b167c90000 from 1 10000000:01000000:2.0:1783952231.015000:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783952231.015058:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952231.015092:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952231.015178:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952231.015215:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465625600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783952231.015302:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952231.015360:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b160306b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952231.015981:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465625600 00000100:00100000:3.0:1783952231.015992:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465625600 00000100:00100000:3.0:1783952231.016058:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783952231.016071:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465625600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952231.016090:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952231.016430:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b14d86ac00/0x22c73c7857bb6543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb653c expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952231.016466:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b14d86ac00/0x22c73c7857bb6543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb653c expref: 24 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952231.016479:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b14d86ac00/0x22c73c7857bb6543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb653c expref: 24 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952231.016490:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ac00, rc 0) 00000100:00100000:3.0:1783952231.016556:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465625600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 487us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952231.016580:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783952231.016733:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465625600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952231.017197:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6543 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952231.017210:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6543 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952231.017309:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465625728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783952231.017350:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952231.017388:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b160306b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783952231.018004:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465625728 00000100:00100000:3.0:1783952231.018012:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465625728 00000100:00100000:3.0:1783952231.018065:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783952231.018074:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465625728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783952231.019077:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465625728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 998us (1719us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783952231.019089:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783952231.022273:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465625728:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783952231.022344:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783952231.022358:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6543 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952231.022371:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6543 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952231.973425:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952232.995688:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952233.569785:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465625856:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.569977:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.570100:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465626368:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.570405:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.570467:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465626880:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.570500:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.570519:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465627392:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.570540:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.570569:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783952233.570576:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465625984:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.570637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.570653:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465626496:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.570672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.570694:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465627008:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.570713:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.570761:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465626112:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.570806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952233.570824:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465626368 00000100:00100000:3.0:1783952233.570836:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465626624:0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.570838:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465626368 00000100:00100000:3.0:1783952233.570864:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.570888:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465627136:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.570927:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.570958:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783952233.570962:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465626880 00000100:00100000:2.0:1783952233.570968:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465626880 00000100:00100000:3.0:1783952233.570970:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465626240:0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.571006:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465627392 00000100:00100000:2.0:1783952233.571011:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465627392 00000100:00100000:3.0:1783952233.571019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952233.571036:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465625984 00000100:00100000:2.0:1783952233.571042:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465625984 00000100:00100000:3.0:1783952233.571046:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465626752:0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.571062:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465626112 00000100:00100000:2.0:1783952233.571067:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465626112 00000100:00100000:3.0:1783952233.571080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952233.571090:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465626240 00000100:00100000:2.0:1783952233.571095:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465626240 00000100:00100000:3.0:1783952233.571119:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465627264:0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.571128:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1783952233.571144:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465626368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.571237:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465626368:12345-0@lo:400:kworker.0 Request processed in 98us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.571246:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1783952233.571266:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1783952233.571273:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465626880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.571305:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465626880:12345-0@lo:400:kworker.0 Request processed in 32us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.571311:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1783952233.571323:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1783952233.571329:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465627392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.571358:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465627392:12345-0@lo:400:kworker.0 Request processed in 29us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.571364:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1783952233.571389:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1783952233.571395:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465625984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.571427:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465625984:12345-0@lo:400:kworker.0 Request processed in 31us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.571433:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1783952233.571444:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:2.0:1783952233.571450:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465626112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.571478:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465626112:12345-0@lo:400:kworker.0 Request processed in 28us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.571484:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:2.0:1783952233.571494:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:2.0:1783952233.571501:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465626240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.571529:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465626240:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.571537:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1783952233.571553:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.571625:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465626112:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.571655:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465626240:0@lo:400:kworker.0 00000100:00080000:2.0:1783952233.571663:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783952233.571670:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952233.571704:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465625856 00000100:00100000:3.0:1783952233.571712:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465625856 00000100:00100000:2.0:1783952233.571758:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465626624 00000100:00100000:2.0:1783952233.571766:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465626624 00000100:00100000:3.0:1783952233.571788:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783952233.571802:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465625856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.571813:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465627136 00000100:00100000:2.0:1783952233.571819:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465627136 00000100:00100000:2.0:1783952233.571844:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465626752 00000100:00100000:2.0:1783952233.571847:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465626752 00000100:00100000:3.0:1783952233.571871:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465625856:12345-0@lo:400:kworker.0 Request processed in 71us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952233.571880:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783952233.571884:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465627264 00000100:00100000:2.0:1783952233.571900:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465627264 00000100:00100000:2.0:1783952233.571930:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000100:00100000:2.0:1783952233.571941:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465626624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.571951:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:3.0:1783952233.571965:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465627136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.572107:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465627136:12345-0@lo:400:kworker.0 Request processed in 147us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952233.572122:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00100000:3.0:1783952233.572139:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:3.0:1783952233.572145:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465626752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.572242:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465626752:12345-0@lo:400:kworker.0 Request processed in 97us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952233.572249:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00100000:3.0:1783952233.572260:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:3.0:1783952233.572265:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465627264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.572290:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465627264:12345-0@lo:400:kworker.0 Request processed in 25us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952233.572295:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00100000:3.0:1783952233.572325:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465627520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952233.572347:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952233.572453:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465626496 00000100:00100000:3.0:1783952233.572458:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465626496 00000100:00100000:3.0:1783952233.572486:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465627008 00000100:00100000:3.0:1783952233.572489:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465627008 00000100:00100000:3.0:1783952233.572501:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465627520 00000100:00100000:3.0:1783952233.572503:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465627520 00000100:00100000:3.0:1783952233.572513:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:3.0:1783952233.572519:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465626496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.572550:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465626496:12345-0@lo:400:kworker.0 Request processed in 31us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952233.572556:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:3.0:1783952233.572567:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:3.0:1783952233.572572:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465627008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.572636:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465627008:12345-0@lo:400:kworker.0 Request processed in 62us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952233.572642:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:3.0:1783952233.572655:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:3.0:1783952233.572660:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465627520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952233.572684:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:3.0:1783952233.572718:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465627520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952233.572725:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00100000:3.0:1783952233.573233:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465627520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952233.573457:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465626752:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.573469:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465627264:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.573481:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465626624:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.573491:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465627136:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.573525:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465625984:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.573535:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465626496:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.573543:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465627008:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.573552:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465625856:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.573564:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465626368:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.573575:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465626880:0@lo:400:kworker.0 00000100:00100000:3.0:1783952233.573624:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465627392:0@lo:400:kworker.0 00000100:00100000:2.0:1783952233.574796:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465626624:12345-0@lo:400:kworker.0 Request processed in 2847us (3919us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.574830:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000100:00080000:2.0:1783952233.574904:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952233.574912:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952233.969510:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952233.969540:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952233.969562:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952233.969628:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952233.969651:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952233.969712:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447792000 00000100:00100000:1.0:1783952233.969722:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447792000 00000100:00100000:1.0:1783952233.969775:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447791872 00000100:00100000:1.0:1783952233.969779:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447791872 00000100:00100000:1.0:1783952233.969814:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2908 00000100:00100000:1.0:1783952233.969824:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447792000:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952233.969955:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447791488 00000100:00100000:2.0:1783952233.969960:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447791488 00000100:00100000:2.0:1783952233.969994:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 177 00000100:00100000:2.0:1783952233.970000:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447791488:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952233.970072:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447791488:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 71us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.970080:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 177 00000100:00100000:2.0:1783952233.970112:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447791744 00000100:00100000:2.0:1783952233.970116:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447791744 00000100:00100000:2.0:1783952233.970144:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447791616 00000100:00100000:2.0:1783952233.970147:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447791616 00000100:00100000:2.0:1783952233.970170:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1458 00000100:00100000:2.0:1783952233.970176:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2398:x1870605447791744:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952233.970206:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2398:x1870605447791744:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.970213:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1458 00000100:00100000:2.0:1783952233.970224:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1459 00000100:00100000:2.0:1783952233.970230:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2398:x1870605447791616:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952233.970256:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2398:x1870605447791616:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.970262:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1459 00000100:00080000:2.0:1783952233.970279:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783952233.970291:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952233.970293:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952233.970295:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952233.970327:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2909 00000100:00100000:2.0:1783952233.970348:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447791872:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952233.970377:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2398:x1870605447791872:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 43us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952233.970384:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2909 00000100:00100000:1.0:1783952233.970731:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447792000:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 907us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952233.970737:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2908 00010000:00010000:3.0:1783952234.017118:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783952234.050369:0:95548:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 10:17:13 (1783952233) 00000100:00100000:1.0:1783952234.082774:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952234.082800:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465627648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783952234.082875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952234.082995:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465627648 00000100:00100000:3.0:1783952234.083003:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465627648 00000100:00100000:3.0:1783952234.083091:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269 00000100:00100000:3.0:1783952234.083101:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465627648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783952234.083134:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952234.083203:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465627648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952234.083210:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269 00000100:00100000:0.0:1783952234.083351:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465627648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952234.084130:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952234.084143:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465627776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952234.084186:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952234.084222:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465627776 00000100:00100000:2.0:1783952234.084227:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465627776 00000100:00100000:2.0:1783952234.084261:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:2.0:1783952234.084268:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465627776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952234.084537:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445212160 avail 1298972672 00000100:00100000:2.0:1783952234.084679:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465627776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 316us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952234.084688:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:2.0:1783952234.084727:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465627776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952234.087087:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783952234.087109:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465627904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952234.087169:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952234.092287:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465627904 00000100:00100000:1.0:1783952234.092302:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465627904 00000100:00100000:1.0:1783952234.092356:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270 00000100:00100000:1.0:1783952234.092367:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465627904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952234.092404:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952234.092477:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465627904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (5307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952234.092485:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270 00000100:00100000:0.0:1783952234.099252:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465627904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952234.115559:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.118221:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447792256 00000100:00100000:2.0:1783952234.118241:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447792256 00000100:00100000:2.0:1783952234.118317:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1451 00000100:00100000:2.0:1783952234.118327:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:73552:x1870605447792256:12345-192.168.202.48@tcp:36:mkdir.0 00010000:00010000:2.0:1783952234.118391:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952234.118418:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6359 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a514 expref: 10 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.118445:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:2.0:1783952234.118451:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952234.118510:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.118525:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.118535:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.118549:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.118556:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.118562:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119295:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119306:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119314:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.119341:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a35b6b89 reply state 00000000c770b09d transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119363:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119368:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952234.119371:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.119373:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783952234.119378:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1783952234.119386:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119392:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119398:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119405:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119410:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952234.119414:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119422:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119430:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:2.0:1783952234.119432:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952234.119436:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119452:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb654a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.119463:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a35b6b89 reply state 00000000c770b09d transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119473:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.119479:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff97b176e45000) 00010000:00010000:2.0:1783952234.119482:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.119484:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783952234.119616:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:73552:x1870605447792256:12345-192.168.202.48@tcp:36:mkdir.0 Request processed in 1287us (4062us total) trans 124554051585 rc 0/0 00000100:00100000:2.0:1783952234.119625:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1451 00000100:00100000:2.0:1783952234.152413:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.155997:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447792384 00000100:00100000:3.0:1783952234.156015:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447792384 00000100:00100000:3.0:1783952234.156096:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1452 00000100:00100000:3.0:1783952234.156106:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:73553:x1870605447792384:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952234.156134:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.156157:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb655f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a576 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.156220:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6566 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.156235:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.156246:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952234.156311:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783952234.156315:0:67035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952234.156335:0:67035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.156360:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb655f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a576 expref: 13 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.156378:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a576 expref: 12 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.156386:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:3.0:1783952234.156388:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783952234.156391:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86ba00, rc 0) 00000100:00100000:3.0:1783952234.156457:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:73553:x1870605447792384:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 352us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952234.156464:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1452 00000100:00100000:3.0:1783952234.162546:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.162735:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447792640 00000100:00100000:0.0:1783952234.162768:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447792640 00000100:00100000:0.0:1783952234.162853:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1453 00000100:00100000:0.0:1783952234.162865:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:73553:x1870605447792640:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1783952234.162898:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952234.162902:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783952234.162932:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6566 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a576 expref: 12 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.162952:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:0.0:1783952234.162956:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952234.162970:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb656d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a57d expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163112:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163127:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163136:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163147:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb657b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163168:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb657b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163175:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb657b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163259:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb6582 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163267:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb6582 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163286:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb6582 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952234.163296:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1783952234.163310:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb6582 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163317:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb6582 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163322:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb6582 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163328:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.163333:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb6582 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163341:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb6582 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163349:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952234.163352:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.163356:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb6582 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163372:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb6582 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163386:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163392:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163398:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163414:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163420:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.163422:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163428:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163436:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:0.0:1783952234.163438:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.163441:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163446:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163455:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb657b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163466:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb657b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163471:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb657b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163476:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbce00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.163478:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb657b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163483:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb657b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163489:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff97b176e45000) 00010000:00010000:0.0:1783952234.163492:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.163494:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb657b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163500:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb657b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163522:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb656d lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a57d expref: 12 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163530:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:0.0:1783952234.163532:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.163535:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb656d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a57d expref: 12 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.163552:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd800, rc 0) 00000100:00100000:0.0:1783952234.163649:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:73553:x1870605447792640:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 786us (1122us total) trans 0 rc 301/301 00000100:00100000:0.0:1783952234.163658:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1453 00000100:00100000:2.0:1783952234.168011:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.168109:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447792768 00000100:00100000:3.0:1783952234.168121:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447792768 00000100:00100000:3.0:1783952234.168181:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1454 00000100:00100000:3.0:1783952234.168191:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:73553:x1870605447792768:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952234.168214:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.168236:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a584 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.168316:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6590 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.168340:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.168351:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952234.168396:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783952234.168400:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952234.168432:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.168457:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a584 expref: 13 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.168472:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a584 expref: 12 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.168481:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:3.0:1783952234.168484:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783952234.168488:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a600, rc 0) 00000100:00100000:3.0:1783952234.168660:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:73553:x1870605447792768:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 470us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952234.168667:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1454 00000100:00100000:0.0:1783952234.181142:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.181207:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447793024 00000100:00100000:3.0:1783952234.181220:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447793024 00000100:00100000:3.0:1783952234.181285:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1455 00000100:00100000:3.0:1783952234.181296:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:73553:x1870605447793024:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1783952234.181322:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.181361:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a58b expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.181441:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.181457:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.181471:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.181484:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb65a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.181492:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb65a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.181499:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb65a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952234.181718:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1783952234.182245:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182254:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182260:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182266:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182283:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952234.182288:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182295:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182308:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:3.0:1783952234.182312:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952234.182317:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182324:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb659e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182335:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb65a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182341:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb65a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182346:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb65a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182363:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86be00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952234.182367:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb65a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182372:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb65a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182391:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff97b176e45000) 00010000:00010000:3.0:1783952234.182393:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952234.182397:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb65a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182403:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb65a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182442:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6597 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a58b expref: 14 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182453:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:3.0:1783952234.182456:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783952234.182459:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a58b expref: 14 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.182468:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a000, rc 0) 00000100:00100000:3.0:1783952234.182573:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:73553:x1870605447793024:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1279us (1445us total) trans 124554051586 rc 301/301 00000100:00100000:3.0:1783952234.182581:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1455 00000100:00100000:2.0:1783952234.186615:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.186762:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447793280 00000100:00100000:3.0:1783952234.186780:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447793280 00000100:00100000:3.0:1783952234.187026:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1456 00000100:00100000:3.0:1783952234.187040:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:73553:x1870605447793280:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1783952234.187183:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.187221:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.187236:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.187451:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb8197bc reply state 00000000a988f4e1 transno 124554051587 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.187467:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.187476:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:3.0:1783952234.187479:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1783952234.187484:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783952234.187494:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000100:00100000:3.0:1783952234.187644:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:73553:x1870605447793280:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 606us (1068us total) trans 124554051587 rc 0/0 00000100:00100000:3.0:1783952234.187653:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1456 00000100:00100000:2.0:1783952234.195554:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.195962:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447793536 00000100:00100000:1.0:1783952234.195982:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447793536 00000100:00100000:1.0:1783952234.196070:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 245 00000100:00100000:1.0:1783952234.196085:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:73553:x1870605447793536:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1783952234.196447:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:73553:x1870605447793536:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 365us (902us total) trans 124554051588 rc 0/0 00000100:00100000:1.0:1783952234.196455:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 245 00000100:00100000:2.0:1783952234.249273:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.251390:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447793664 00000100:00100000:0.0:1783952234.251410:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447793664 00000100:00100000:0.0:1783952234.251505:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1457 00000100:00100000:0.0:1783952234.251519:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:73554:x1870605447793664:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952234.251553:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952234.251606:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb65ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a592 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.251697:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.251726:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.251740:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.251755:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb65c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.251763:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb65c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.251788:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb65c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.251923:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb65cf lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.251933:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb65cf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.251942:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb65cf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952234.251993:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1783952234.251997:0:66238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783952234.252046:0:66238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb65cf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252063:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252070:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252077:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252085:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252092:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbce00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.252098:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252113:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252128:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:0.0:1783952234.252131:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.252137:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252145:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb65c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252158:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb65c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252163:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb65c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252169:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb65c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252174:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.252177:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb65c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252182:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb65c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252189:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff97b176e45000) 00010000:00010000:0.0:1783952234.252192:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.252194:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb65c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252209:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb65c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252238:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb65ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a592 expref: 18 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252253:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc000/0x22c73c7857bb65cf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a592 expref: 17 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.252261:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952234.252263:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783952234.252266:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc000, rc 0) 00000100:00100000:0.0:1783952234.252363:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:73554:x1870605447793664:12345-192.168.202.48@tcp:101:touch.0 Request processed in 846us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952234.252372:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1457 00000100:00100000:2.0:1783952234.256692:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.262460:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447793920 00000100:00100000:3.0:1783952234.262483:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447793920 00000100:00100000:2.0:1783952234.262790:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1458 00000100:00100000:2.0:1783952234.262803:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:73554:x1870605447793920:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.262847:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.262890:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb65d6 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a599 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263070:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263093:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263108:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263127:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263134:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263141:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952234.263566:0:83761:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x724:0x0], count =94 00000004:00080000:2.0:1783952234.263575:0:83761:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x724:0x0]+94 in llog 00000004:00080000:2.0:1783952234.263637:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x782:0x0], index 0: 0 00010000:00010000:2.0:1783952234.263827:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb65eb lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263838:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb65eb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263847:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb65eb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263898:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263916:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263922:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263930:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263936:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952234.263942:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263952:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263968:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952234.263972:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952234.263978:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.263985:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb65dd lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.264004:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7691465 reply state 000000000a9d56be transno 124554051589 ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.264019:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.264025:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff97b176e45300) 00010000:00010000:2.0:1783952234.264034:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.264039:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783952234.264084:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb65d6 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a599 expref: 20 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.264103:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb65eb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a599 expref: 19 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.264111:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff97b176e45100) 00010000:00010000:2.0:1783952234.264113:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952234.264115:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1820cd200, rc 0) 00000100:00100000:2.0:1783952234.264218:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+20:73554:x1870605447793920:12345-192.168.202.48@tcp:101:touch.0 Request processed in 1417us (7539us total) trans 124554051589 rc 0/0 00000100:00100000:2.0:1783952234.264227:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1458 00000100:00100000:1.0:1783952234.276750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.276941:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447794176 00000100:00100000:3.0:1783952234.276955:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447794176 00000100:00100000:3.0:1783952234.277042:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1459 00000100:00100000:3.0:1783952234.277055:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+20:73554:x1870605447794176:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:3.0:1783952234.277141:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952234.277180:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb65eb lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a599 expref: 20 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.277227:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff97b176e45100) 00010000:00010000:3.0:1783952234.277242:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952234.277331:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.277348:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.277361:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.277520:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eae02b88 reply state 0000000010cbab1a transno 124554051590 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.277534:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.277540:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff97b158d55300) 00010000:00010000:3.0:1783952234.277543:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.277546:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952234.277712:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+21:73554:x1870605447794176:12345-192.168.202.48@tcp:36:touch.0 Request processed in 659us (977us total) trans 124554051590 rc 0/0 00000100:00100000:3.0:1783952234.277720:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1459 00000100:00100000:0.0:1783952234.303105:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.307458:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447794304 00000100:00100000:3.0:1783952234.307480:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447794304 00000100:00100000:3.0:1783952234.307560:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1460 00000100:00100000:3.0:1783952234.307574:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+21:73554:x1870605447794304:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.307646:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.307688:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb6600 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5a0 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.307767:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb6600 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5a0 expref: 22 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.307788:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86be00/0x22c73c7857bb6600 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5a0 expref: 22 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.307814:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff97b158d55300) 00010000:00010000:3.0:1783952234.307818:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783952234.307823:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86be00, rc 0) 00000100:00100000:3.0:1783952234.309376:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:73554:x1870605447794304:12345-192.168.202.48@tcp:101:touch.0 Request processed in 1792us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952234.309392:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1460 00000100:00100000:0.0:1783952234.329172:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.332214:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447794432 00000100:00100000:0.0:1783952234.332239:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447794432 00000100:00100000:0.0:1783952234.332356:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4968 00000100:00100000:0.0:1783952234.332369:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17738e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447794432:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:0.0:1783952234.334278:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17738e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2401:x1870605447794432:12345-192.168.202.48@tcp:2:touch.0 Request processed in 1900us (5110us total) trans 4294968958 rc 0/0 00000100:00100000:0.0:1783952234.334292:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4968 00000100:00100000:1.0:1783952234.348349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.348454:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447794688 00000100:00100000:2.0:1783952234.348467:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447794688 00000100:00100000:2.0:1783952234.348536:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 246 00000100:00100000:2.0:1783952234.348547:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177060850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:73554:x1870605447794688:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:2.0:1783952234.348983:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177060850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:73554:x1870605447794688:12345-192.168.202.48@tcp:35:touch.0 Request processed in 436us (646us total) trans 124554051591 rc 0/0 00000100:00100000:2.0:1783952234.348993:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 246 00000100:00100000:1.0:1783952234.364488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.365292:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447794944 00000100:00100000:3.0:1783952234.365309:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447794944 00000100:00100000:3.0:1783952234.365395:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1461 00000100:00100000:3.0:1783952234.365410:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:73554:x1870605447794944:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.365447:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.365476:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6607 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5a7 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.365896:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.365940:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.365956:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.365977:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.365998:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366006:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783952234.366519:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x783:0x0], index 0: 0 00010000:00010000:0.0:1783952234.366764:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb661c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366776:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb661c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366785:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb661c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366829:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366837:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366844:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366859:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366866:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbc400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.366871:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366881:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366907:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952234.366911:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.366918:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366927:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb660e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952234.366943:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005332e12b reply state 00000000e457c4c1 transno 124554051592 ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366956:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.366962:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff97b143007000) 00010000:00010000:0.0:1783952234.366965:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952234.366968:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783952234.367011:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6607 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5a7 expref: 26 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.367029:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb661c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5a7 expref: 25 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.367043:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff97b143007c00) 00010000:00010000:0.0:1783952234.367046:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952234.367048:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd400, rc 0) 00000100:00100000:0.0:1783952234.367161:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+26:73554:x1870605447794944:12345-192.168.202.48@tcp:101:touch.0 Request processed in 1755us (2690us total) trans 124554051592 rc 0/0 00000100:00100000:0.0:1783952234.367173:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1461 00000100:00100000:0.0:1783952234.371415:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.371508:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447795200 00000100:00100000:3.0:1783952234.371522:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447795200 00000100:00100000:3.0:1783952234.371637:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1462 00000100:00100000:3.0:1783952234.371649:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+26:73554:x1870605447795200:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:3.0:1783952234.371757:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952234.371795:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb661c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5a7 expref: 26 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.371820:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff97b143007c00) 00010000:00010000:3.0:1783952234.371834:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952234.371923:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.371939:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.371950:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.372396:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc2a1d4c reply state 0000000027a9fefc transno 124554051593 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.372412:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.372419:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff97b158d55700) 00010000:00010000:3.0:1783952234.372422:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.372425:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952234.372558:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:73554:x1870605447795200:12345-192.168.202.48@tcp:36:touch.0 Request processed in 909us (1158us total) trans 124554051593 rc 0/0 00000100:00100000:3.0:1783952234.372566:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1462 00000100:00100000:3.0:1783952234.375246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.375411:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447795328 00000100:00100000:0.0:1783952234.375424:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447795328 00000100:00100000:0.0:1783952234.375501:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1463 00000100:00100000:0.0:1783952234.375515:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:73554:x1870605447795328:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952234.375553:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952234.375621:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb6631 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5ae expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.375703:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb6631 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5ae expref: 28 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.375724:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbca00/0x22c73c7857bb6631 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5ae expref: 28 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.375748:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff97b158d55700) 00010000:00010000:0.0:1783952234.375752:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783952234.375757:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbca00, rc 0) 00000100:00100000:0.0:1783952234.375846:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+28:73554:x1870605447795328:12345-192.168.202.48@tcp:101:touch.0 Request processed in 334us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952234.375872:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1463 00000100:00100000:2.0:1783952234.379125:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.379268:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447795456 00000100:00100000:3.0:1783952234.379284:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447795456 00000100:00100000:3.0:1783952234.379387:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4969 00000100:00100000:3.0:1783952234.379399:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2400:x1870605447795456:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:3.0:1783952234.379767:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447795456:12345-192.168.202.48@tcp:2:touch.0 Request processed in 368us (659us total) trans 4294968959 rc 0/0 00000100:00100000:3.0:1783952234.379776:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4969 00000100:00100000:2.0:1783952234.383956:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.384075:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447795712 00000100:00100000:1.0:1783952234.384090:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447795712 00000100:00100000:1.0:1783952234.384169:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 247 00000100:00100000:1.0:1783952234.384183:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+28:73554:x1870605447795712:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:1.0:1783952234.384659:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:73554:x1870605447795712:12345-192.168.202.48@tcp:35:touch.0 Request processed in 478us (718us total) trans 124554051594 rc 0/0 00000100:00100000:1.0:1783952234.384669:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 247 00000100:00100000:0.0:1783952234.388581:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.388706:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447795968 00000100:00100000:2.0:1783952234.388719:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447795968 00000100:00100000:2.0:1783952234.388793:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1464 00000100:00100000:2.0:1783952234.388804:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:73554:x1870605447795968:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.388860:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.388901:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6638 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5b5 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389061:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389083:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389096:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389114:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389121:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389127:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952234.389572:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x784:0x0], index 0: 0 00010000:00010000:2.0:1783952234.389806:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb664d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389817:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb664d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389826:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb664d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389898:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389906:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389913:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389920:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389927:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cda00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952234.389932:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389940:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389956:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952234.389959:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952234.389966:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.389973:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb663f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.389990:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c04b166 reply state 00000000f28dae68 transno 124554051595 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.390003:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.390016:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff97b176e45900) 00010000:00010000:2.0:1783952234.390019:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.390022:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783952234.390063:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6638 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5b5 expref: 32 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.390080:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb664d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5b5 expref: 31 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.390088:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff97b176e45700) 00010000:00010000:2.0:1783952234.390090:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952234.390093:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031200, rc 0) 00000100:00100000:2.0:1783952234.390184:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+32:73554:x1870605447795968:12345-192.168.202.48@tcp:101:touch.0 Request processed in 1380us (1615us total) trans 124554051595 rc 0/0 00000100:00100000:2.0:1783952234.390193:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1464 00000100:00100000:3.0:1783952234.396226:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.396455:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447796224 00000100:00100000:2.0:1783952234.396468:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447796224 00000100:00100000:2.0:1783952234.396546:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1465 00000100:00100000:2.0:1783952234.396560:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+32:73554:x1870605447796224:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:2.0:1783952234.396662:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952234.396701:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb664d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5b5 expref: 32 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.396724:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff97b176e45700) 00010000:00010000:2.0:1783952234.396736:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952234.396804:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.396835:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.396849:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.397363:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079b05614 reply state 00000000d5cc8475 transno 124554051596 ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.397382:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.397390:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff97b176e45f00) 00010000:00010000:2.0:1783952234.397393:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.397396:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952234.397569:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:73554:x1870605447796224:12345-192.168.202.48@tcp:36:touch.0 Request processed in 1011us (1414us total) trans 124554051596 rc 0/0 00000100:00100000:2.0:1783952234.397578:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1465 00000100:00100000:0.0:1783952234.402110:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.402258:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447796352 00000100:00100000:3.0:1783952234.402271:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447796352 00000100:00100000:3.0:1783952234.402372:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1466 00000100:00100000:3.0:1783952234.402385:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:73554:x1870605447796352:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.402421:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.402447:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb6662 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5bc expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.402519:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb6662 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5bc expref: 34 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.402536:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b600/0x22c73c7857bb6662 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5bc expref: 34 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.402556:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff97b176e45f00) 00010000:00010000:3.0:1783952234.402560:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783952234.402563:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86b600, rc 0) 00000100:00100000:3.0:1783952234.402691:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:73554:x1870605447796352:12345-192.168.202.48@tcp:101:touch.0 Request processed in 309us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952234.402699:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1466 00000100:00100000:2.0:1783952234.406578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.406861:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447796480 00000100:00100000:0.0:1783952234.406876:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447796480 00000100:00100000:0.0:1783952234.407092:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4970 00000100:00100000:0.0:1783952234.407105:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447796480:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:0.0:1783952234.407411:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2400:x1870605447796480:12345-192.168.202.48@tcp:2:touch.0 Request processed in 308us (848us total) trans 4294968960 rc 0/0 00000100:00100000:0.0:1783952234.407420:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4970 00000100:00100000:2.0:1783952234.410377:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.410482:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447796736 00000100:00100000:0.0:1783952234.410495:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447796736 00000100:00100000:0.0:1783952234.410556:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 248 00000100:00100000:0.0:1783952234.410567:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:73554:x1870605447796736:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:0.0:1783952234.411553:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+35:73554:x1870605447796736:12345-192.168.202.48@tcp:35:touch.0 Request processed in 980us (1183us total) trans 124554051597 rc 0/0 00000100:00100000:0.0:1783952234.411566:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 248 00000100:00100000:1.0:1783952234.415849:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.416079:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447796992 00000100:00100000:2.0:1783952234.416094:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447796992 00000100:00100000:2.0:1783952234.416262:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1467 00000100:00100000:2.0:1783952234.416276:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+35:73554:x1870605447796992:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.416310:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.416339:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb6669 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5c3 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.416487:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.416531:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.416546:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.416568:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.416576:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.416628:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952234.417136:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x785:0x0], index 0: 0 00010000:00010000:2.0:1783952234.417315:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb667e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417328:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb667e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417337:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb667e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417384:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417391:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417398:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417416:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417422:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cd400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952234.417428:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417437:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417452:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952234.417456:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952234.417462:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417470:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6670 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.417487:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008d1abfb2 reply state 00000000ac544450 transno 124554051598 ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417501:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417507:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff97b176e45700) 00010000:00010000:2.0:1783952234.417510:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.417513:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783952234.417557:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb6669 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5c3 expref: 38 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417574:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb667e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5c3 expref: 37 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.417831:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff97b176e45400) 00010000:00010000:2.0:1783952234.417834:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952234.417837:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2200, rc 0) 00000100:00100000:2.0:1783952234.417937:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+38:73554:x1870605447796992:12345-192.168.202.48@tcp:101:touch.0 Request processed in 1663us (2102us total) trans 124554051598 rc 0/0 00000100:00100000:2.0:1783952234.417947:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1467 00000100:00100000:0.0:1783952234.421928:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.422387:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447797248 00000100:00100000:3.0:1783952234.422422:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447797248 00000100:00100000:3.0:1783952234.422507:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1468 00000100:00100000:3.0:1783952234.422520:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+38:73554:x1870605447797248:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:3.0:1783952234.422947:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952234.423048:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb667e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5c3 expref: 38 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.423075:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff97b176e45400) 00010000:00010000:3.0:1783952234.423091:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952234.423254:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.423272:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.423285:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.423824:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000047b50c29 reply state 000000004fe2295a transno 124554051599 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.423842:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.423849:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff97b158d55f00) 00010000:00010000:3.0:1783952234.423852:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.423855:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952234.424148:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+39:73554:x1870605447797248:12345-192.168.202.48@tcp:36:touch.0 Request processed in 1625us (2229us total) trans 124554051599 rc 0/0 00000100:00100000:2.0:1783952234.425951:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1468 00000100:00100000:0.0:1783952234.426480:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.426564:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447797376 00000100:00100000:3.0:1783952234.426575:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447797376 00000100:00100000:2.0:1783952234.426866:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1469 00000100:00100000:2.0:1783952234.426877:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+39:73554:x1870605447797376:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.426921:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.426950:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3800/0x22c73c7857bb6693 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5ca expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.427036:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3800/0x22c73c7857bb6693 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5ca expref: 40 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.427055:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3800/0x22c73c7857bb6693 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5ca expref: 40 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.427079:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff97b158d55f00) 00010000:00010000:2.0:1783952234.427083:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783952234.427086:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3800, rc 0) 00000100:00100000:2.0:1783952234.427162:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+40:73554:x1870605447797376:12345-192.168.202.48@tcp:101:touch.0 Request processed in 286us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952234.427187:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1469 00000100:00100000:1.0:1783952234.429918:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.430016:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447797504 00000100:00100000:3.0:1783952234.430030:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447797504 00000100:00100000:3.0:1783952234.430127:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4971 00000100:00100000:3.0:1783952234.430139:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2401:x1870605447797504:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:3.0:1783952234.431014:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2401:x1870605447797504:12345-192.168.202.48@tcp:2:touch.0 Request processed in 872us (1106us total) trans 4294968961 rc 0/0 00000100:00100000:3.0:1783952234.431025:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4971 00000100:00100000:0.0:1783952234.433824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.433950:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447797760 00000100:00100000:2.0:1783952234.433966:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447797760 00000100:00100000:2.0:1783952234.434140:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 249 00000100:00100000:2.0:1783952234.434153:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+40:73554:x1870605447797760:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:2.0:1783952234.434550:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+41:73554:x1870605447797760:12345-192.168.202.48@tcp:35:touch.0 Request processed in 398us (738us total) trans 124554051600 rc 0/0 00000100:00100000:2.0:1783952234.434560:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 249 00000100:00100000:0.0:1783952234.441291:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.441547:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447798016 00000100:00100000:3.0:1783952234.441561:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447798016 00000100:00100000:3.0:1783952234.441680:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1470 00000100:00100000:3.0:1783952234.441693:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+41:73554:x1870605447798016:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.441731:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.441760:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb669a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5d1 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.441951:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.441973:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442000:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442020:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442028:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442035:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783952234.442484:0:67035:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x786:0x0], index 0: 0 00010000:00010000:3.0:1783952234.442690:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb66af lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442702:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb66af lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442710:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb66af lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442755:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442763:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442770:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442777:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442784:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952234.442790:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442799:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442814:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:3.0:1783952234.442817:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952234.442831:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442839:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66a1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.442856:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b858d42 reply state 00000000511fc3cb transno 124554051601 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442869:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.442877:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff97b158d55400) 00010000:00010000:3.0:1783952234.442879:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.443195:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783952234.443242:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb669a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5d1 expref: 44 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.443260:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb66af lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5d1 expref: 43 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.443269:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff97b158d55b00) 00010000:00010000:3.0:1783952234.443272:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952234.443274:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762aee00, rc 0) 00000100:00100000:3.0:1783952234.443378:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+44:73554:x1870605447798016:12345-192.168.202.48@tcp:101:touch.0 Request processed in 1688us (2102us total) trans 124554051601 rc 0/0 00000100:00100000:3.0:1783952234.443389:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1470 00000100:00100000:0.0:1783952234.448944:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.449094:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447798272 00000100:00100000:3.0:1783952234.449108:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447798272 00000100:00100000:3.0:1783952234.449197:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1471 00000100:00100000:3.0:1783952234.449210:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+44:73554:x1870605447798272:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:3.0:1783952234.449313:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952234.449352:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb66af lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5d1 expref: 44 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.449375:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff97b158d55b00) 00010000:00010000:3.0:1783952234.449392:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952234.449461:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.449476:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.449488:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.449670:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005931b90a reply state 00000000cdb4b370 transno 124554051602 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.449684:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.449690:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff97b158d55900) 00010000:00010000:3.0:1783952234.449693:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.449696:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952234.449799:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+45:73554:x1870605447798272:12345-192.168.202.48@tcp:36:touch.0 Request processed in 592us (870us total) trans 124554051602 rc 0/0 00000100:00100000:3.0:1783952234.449807:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1471 00000100:00100000:0.0:1783952234.454135:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.454326:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447798400 00000100:00100000:3.0:1783952234.454341:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447798400 00000100:00100000:3.0:1783952234.454423:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1472 00000100:00100000:3.0:1783952234.454454:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+45:73554:x1870605447798400:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.454491:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.454521:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66c4 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5d8 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.455227:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66c4 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5d8 expref: 46 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.455264:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af600/0x22c73c7857bb66c4 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5d8 expref: 46 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.455292:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff97b158d55900) 00010000:00010000:0.0:1783952234.455296:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783952234.455300:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af600, rc 0) 00000100:00100000:0.0:1783952234.455434:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+46:73554:x1870605447798400:12345-192.168.202.48@tcp:101:touch.0 Request processed in 981us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952234.455444:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1472 00000100:00100000:0.0:1783952234.458770:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.458908:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447798528 00000100:00100000:3.0:1783952234.458923:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447798528 00000100:00100000:3.0:1783952234.459125:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4972 00000100:00100000:3.0:1783952234.459138:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2401:x1870605447798528:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:3.0:1783952234.459418:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2401:x1870605447798528:12345-192.168.202.48@tcp:2:touch.0 Request processed in 282us (662us total) trans 4294968962 rc 0/0 00000100:00100000:3.0:1783952234.459428:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4972 00000100:00100000:1.0:1783952234.462342:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.462456:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447798784 00000100:00100000:2.0:1783952234.462469:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447798784 00000100:00100000:2.0:1783952234.462614:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 250 00000100:00100000:2.0:1783952234.462628:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+46:73554:x1870605447798784:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:2.0:1783952234.463071:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+47:73554:x1870605447798784:12345-192.168.202.48@tcp:35:touch.0 Request processed in 444us (743us total) trans 124554051603 rc 0/0 00000100:00100000:2.0:1783952234.463080:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 250 00000100:00100000:0.0:1783952234.466807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.467112:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447799040 00000100:00100000:3.0:1783952234.467127:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447799040 00000100:00100000:3.0:1783952234.467207:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1473 00000100:00100000:3.0:1783952234.467220:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+47:73554:x1870605447799040:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.467254:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.467283:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb66cb lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5df expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.467423:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.467444:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.467459:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.467492:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.467500:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.467507:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783952234.468360:0:67035:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x787:0x0], index 0: 0 00010000:00010000:3.0:1783952234.468529:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb66e0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.468544:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb66e0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.468553:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb66e0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469060:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469071:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469078:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469085:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469093:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762af800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952234.469111:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469122:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469138:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:3.0:1783952234.469142:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952234.469148:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469167:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af800/0x22c73c7857bb66d2 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.469185:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ec7a5ff reply state 000000007a2af9ba transno 124554051604 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469199:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469206:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff97b158d55b00) 00010000:00010000:3.0:1783952234.469209:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.469212:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783952234.469257:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762aee00/0x22c73c7857bb66cb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5df expref: 50 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469275:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb66e0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5df expref: 49 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.469284:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:3.0:1783952234.469286:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952234.469294:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1762af200, rc 0) 00000100:00100000:3.0:1783952234.469397:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+50:73554:x1870605447799040:12345-192.168.202.48@tcp:101:touch.0 Request processed in 2179us (2605us total) trans 124554051604 rc 0/0 00000100:00100000:3.0:1783952234.469408:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1473 00000100:00100000:0.0:1783952234.473369:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.473489:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447799296 00000100:00100000:3.0:1783952234.473504:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447799296 00000100:00100000:3.0:1783952234.473749:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1474 00000100:00100000:3.0:1783952234.473764:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+50:73554:x1870605447799296:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:3.0:1783952234.473857:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952234.473910:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762af200/0x22c73c7857bb66e0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5df expref: 50 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.473934:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:3.0:1783952234.473951:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952234.474256:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.474273:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.474284:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.474424:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000053ede855 reply state 00000000988eebdc transno 124554051605 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.474439:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.474446:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff97b158d55200) 00010000:00010000:3.0:1783952234.474469:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.474473:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952234.474741:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:73554:x1870605447799296:12345-192.168.202.48@tcp:36:touch.0 Request processed in 978us (1384us total) trans 124554051605 rc 0/0 00000100:00100000:3.0:1783952234.474751:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1474 00000100:00100000:1.0:1783952234.478163:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.478288:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447799424 00000100:00100000:2.0:1783952234.478301:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447799424 00000100:00100000:2.0:1783952234.478412:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1475 00000100:00100000:2.0:1783952234.478425:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:73554:x1870605447799424:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.478460:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.478487:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3000/0x22c73c7857bb66f5 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5e6 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.478567:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3000/0x22c73c7857bb66f5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5e6 expref: 52 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.478640:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3000/0x22c73c7857bb66f5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5e6 expref: 52 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.478661:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff97b158d55200) 00010000:00010000:2.0:1783952234.478665:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783952234.478669:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3000, rc 0) 00000100:00100000:2.0:1783952234.478742:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+52:73554:x1870605447799424:12345-192.168.202.48@tcp:101:touch.0 Request processed in 320us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952234.478750:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1475 00000100:00100000:1.0:1783952234.483713:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.483904:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447799552 00000100:00100000:3.0:1783952234.483921:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447799552 00000100:00100000:3.0:1783952234.483996:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4973 00000100:00100000:3.0:1783952234.484007:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2399:x1870605447799552:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:3.0:1783952234.484339:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447799552:12345-192.168.202.48@tcp:2:touch.0 Request processed in 332us (637us total) trans 4294968963 rc 0/0 00000100:00100000:3.0:1783952234.484349:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4973 00000100:00100000:3.0:1783952234.488488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.489008:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447799808 00000100:00100000:0.0:1783952234.489022:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447799808 00000100:00100000:0.0:1783952234.489089:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 251 00000100:00100000:0.0:1783952234.489101:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+52:73554:x1870605447799808:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:0.0:1783952234.489523:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+53:73554:x1870605447799808:12345-192.168.202.48@tcp:35:touch.0 Request processed in 423us (1054us total) trans 124554051606 rc 0/0 00000100:00100000:0.0:1783952234.489534:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 251 00000100:00100000:1.0:1783952234.492978:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.493266:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447800064 00000100:00100000:3.0:1783952234.493281:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447800064 00000100:00100000:3.0:1783952234.493366:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1476 00000100:00100000:3.0:1783952234.493380:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+53:73554:x1870605447800064:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.493422:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.493458:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb66fc lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5ed expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.493649:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.493670:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.493685:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.493724:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.493733:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.493740:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783952234.495220:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x788:0x0], index 0: 0 00010000:00010000:0.0:1783952234.495461:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6711 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495478:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6711 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495511:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6711 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495560:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495568:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495574:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495622:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495629:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.495634:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495643:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495659:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952234.495663:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.495668:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495676:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6703 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952234.495694:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f7d82f5 reply state 0000000027dca8e8 transno 124554051607 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495714:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495721:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff97b158d55100) 00010000:00010000:0.0:1783952234.495723:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952234.495727:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783952234.495779:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb66fc lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5ed expref: 56 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495799:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6711 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5ed expref: 55 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.495807:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff97b143007800) 00010000:00010000:0.0:1783952234.495809:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952234.495812:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd400, rc 0) 00000100:00100000:0.0:1783952234.496193:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+56:73554:x1870605447800064:12345-192.168.202.48@tcp:101:touch.0 Request processed in 2815us (3230us total) trans 124554051607 rc 0/0 00000100:00100000:0.0:1783952234.496203:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1476 00000100:00100000:1.0:1783952234.501049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.501144:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447800320 00000100:00100000:2.0:1783952234.501158:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447800320 00000100:00100000:2.0:1783952234.501242:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1477 00000100:00100000:2.0:1783952234.501254:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+56:73554:x1870605447800320:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:2.0:1783952234.501341:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952234.501376:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6711 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5ed expref: 56 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.501399:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff97b143007800) 00010000:00010000:2.0:1783952234.501413:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952234.501497:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.501513:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.501525:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.501758:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099ffaa21 reply state 00000000c0022364 transno 124554051608 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.501774:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.501781:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff97b176e45c00) 00010000:00010000:2.0:1783952234.501784:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.501788:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952234.501930:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+57:73554:x1870605447800320:12345-192.168.202.48@tcp:36:touch.0 Request processed in 677us (895us total) trans 124554051608 rc 0/0 00000100:00100000:2.0:1783952234.501939:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1477 00000100:00100000:3.0:1783952234.506655:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.506766:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447800448 00000100:00100000:0.0:1783952234.506781:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447800448 00000100:00100000:0.0:1783952234.506873:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1478 00000100:00100000:0.0:1783952234.506897:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+57:73554:x1870605447800448:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952234.506934:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952234.506968:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6726 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5f4 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.507071:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6726 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5f4 expref: 58 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.507111:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbc400/0x22c73c7857bb6726 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5f4 expref: 58 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.507136:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff97b176e45c00) 00010000:00010000:0.0:1783952234.507140:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783952234.507144:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbc400, rc 0) 00000100:00100000:0.0:1783952234.507249:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+58:73554:x1870605447800448:12345-192.168.202.48@tcp:101:touch.0 Request processed in 366us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952234.507258:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1478 00000100:00100000:1.0:1783952234.512166:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.512291:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447800576 00000100:00100000:2.0:1783952234.512307:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447800576 00000100:00100000:2.0:1783952234.512399:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4974 00000100:00100000:2.0:1783952234.512413:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2398:x1870605447800576:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:2.0:1783952234.512791:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:2398:x1870605447800576:12345-192.168.202.48@tcp:2:touch.0 Request processed in 379us (659us total) trans 4294968964 rc 0/0 00000100:00100000:2.0:1783952234.512800:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4974 00000100:00100000:1.0:1783952234.516972:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.517146:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447800832 00000100:00100000:2.0:1783952234.517160:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447800832 00000100:00100000:2.0:1783952234.517242:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 252 00000100:00100000:2.0:1783952234.517255:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177062050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+58:73554:x1870605447800832:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:2.0:1783952234.517993:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177062050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+59:73554:x1870605447800832:12345-192.168.202.48@tcp:35:touch.0 Request processed in 735us (1031us total) trans 124554051609 rc 0/0 00000100:00100000:2.0:1783952234.518004:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 252 00000100:00100000:3.0:1783952234.521245:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.521420:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447801088 00000100:00100000:2.0:1783952234.521433:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447801088 00000100:00100000:2.0:1783952234.521515:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1479 00000100:00100000:2.0:1783952234.521527:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+59:73554:x1870605447801088:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.521562:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.521644:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb672d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a5fb expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.521825:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.521856:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.521870:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.521896:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.521904:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.521912:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952234.522501:0:66236:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x789:0x0], index 0: 0 00010000:00010000:2.0:1783952234.522715:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3e00/0x22c73c7857bb6742 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.522726:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3e00/0x22c73c7857bb6742 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.522748:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3e00/0x22c73c7857bb6742 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.522794:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.522802:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.522809:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.522817:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.522823:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c3600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952234.522828:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.523336:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.523355:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952234.523359:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952234.523365:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.523373:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6734 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.523392:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027085f1e reply state 00000000118fe34f transno 124554051610 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.523416:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.523424:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff97b176e45a00) 00010000:00010000:2.0:1783952234.523426:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.523430:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783952234.523655:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb672d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5fb expref: 62 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.523676:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3e00/0x22c73c7857bb6742 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5fb expref: 61 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.523685:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff97b176e45200) 00010000:00010000:3.0:1783952234.523687:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952234.523690:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3e00, rc 0) 00000100:00100000:3.0:1783952234.523785:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+62:73554:x1870605447801088:12345-192.168.202.48@tcp:101:touch.0 Request processed in 2259us (2555us total) trans 124554051610 rc 0/0 00000100:00100000:3.0:1783952234.523794:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1479 00000100:00100000:1.0:1783952234.527752:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.528281:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447801344 00000100:00100000:2.0:1783952234.528296:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447801344 00000100:00100000:2.0:1783952234.528423:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1480 00000100:00100000:2.0:1783952234.528438:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+62:73554:x1870605447801344:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:2.0:1783952234.528538:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952234.528695:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3e00/0x22c73c7857bb6742 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a5fb expref: 62 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.528723:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff97b176e45200) 00010000:00010000:2.0:1783952234.528737:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952234.528813:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.528830:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.528917:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.529136:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e0b7c57 reply state 00000000e9ebf7f6 transno 124554051611 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.529229:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.529432:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff97b176e45600) 00010000:00010000:2.0:1783952234.529436:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.529440:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952234.529758:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+63:73554:x1870605447801344:12345-192.168.202.48@tcp:36:touch.0 Request processed in 1321us (2183us total) trans 124554051611 rc 0/0 00000100:00100000:2.0:1783952234.529768:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1480 00000100:00100000:1.0:1783952234.533299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.533396:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447801472 00000100:00100000:0.0:1783952234.533407:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447801472 00000100:00100000:0.0:1783952234.533480:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1481 00000100:00100000:0.0:1783952234.533492:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+63:73554:x1870605447801472:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952234.533526:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952234.533553:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd200/0x22c73c7857bb6757 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a602 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.533660:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd200/0x22c73c7857bb6757 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a602 expref: 64 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.533677:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd200/0x22c73c7857bb6757 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a602 expref: 64 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.533696:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff97b176e45600) 00010000:00010000:0.0:1783952234.533924:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783952234.533948:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd200, rc 0) 00000100:00100000:0.0:1783952234.534028:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+64:73554:x1870605447801472:12345-192.168.202.48@tcp:101:touch.0 Request processed in 538us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952234.534036:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1481 00000100:00100000:0.0:1783952234.538089:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.538264:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447801600 00000100:00100000:1.0:1783952234.538280:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447801600 00000100:00100000:1.0:1783952234.538377:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4975 00000100:00100000:1.0:1783952234.538389:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:2399:x1870605447801600:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:1.0:1783952234.539135:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:2399:x1870605447801600:12345-192.168.202.48@tcp:2:touch.0 Request processed in 743us (1057us total) trans 4294968965 rc 0/0 00000100:00100000:1.0:1783952234.539146:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4975 00000100:00100000:1.0:1783952234.547082:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.547389:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447801856 00000100:00100000:3.0:1783952234.547404:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447801856 00000100:00100000:3.0:1783952234.547494:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 253 00000100:00100000:3.0:1783952234.547507:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+64:73554:x1870605447801856:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:1.0:1783952234.548418:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+65:73554:x1870605447801856:12345-192.168.202.48@tcp:35:touch.0 Request processed in 905us (1348us total) trans 124554051612 rc 0/0 00000100:00100000:1.0:1783952234.548429:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 253 00000100:00100000:2.0:1783952234.552012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.552250:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447802112 00000100:00100000:0.0:1783952234.552265:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447802112 00000100:00100000:0.0:1783952234.552358:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1482 00000100:00100000:0.0:1783952234.552371:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+65:73554:x1870605447802112:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952234.552407:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952234.552435:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb675e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a609 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.552642:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.552663:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.552680:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.552711:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.552720:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.552728:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783952234.553423:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78a:0x0], index 0: 0 00010000:00010000:0.0:1783952234.554271:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6773 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554290:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6773 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554303:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6773 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554353:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554361:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554367:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554374:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554381:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbd400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.554387:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554396:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554413:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952234.554416:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.554436:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554443:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6765 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952234.554462:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033640c87 reply state 00000000fc011d68 transno 124554051613 ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554475:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554481:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff97b143007d00) 00010000:00010000:0.0:1783952234.554484:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952234.554487:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783952234.554534:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb675e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a609 expref: 68 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554550:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6773 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a609 expref: 67 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.554558:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff97b143007a00) 00010000:00010000:0.0:1783952234.554560:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952234.554562:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644c600, rc 0) 00000100:00100000:0.0:1783952234.555295:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+68:73554:x1870605447802112:12345-192.168.202.48@tcp:101:touch.0 Request processed in 2919us (3291us total) trans 124554051613 rc 0/0 00000100:00100000:0.0:1783952234.555308:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1482 00000100:00100000:2.0:1783952234.560297:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.560413:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447802368 00000100:00100000:3.0:1783952234.560429:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447802368 00000100:00100000:3.0:1783952234.560555:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1483 00000100:00100000:3.0:1783952234.560568:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+68:73554:x1870605447802368:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:3.0:1783952234.560696:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952234.560922:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6773 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a609 expref: 68 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.560947:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff97b143007a00) 00010000:00010000:3.0:1783952234.560962:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952234.561047:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.561065:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.561077:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.561245:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000820bafe5 reply state 000000004bb1b0a6 transno 124554051614 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.561259:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.561265:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:3.0:1783952234.561268:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.561271:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952234.561410:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+69:73554:x1870605447802368:12345-192.168.202.48@tcp:36:touch.0 Request processed in 844us (1127us total) trans 124554051614 rc 0/0 00000100:00100000:3.0:1783952234.561440:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1483 00000100:00100000:1.0:1783952234.565105:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.565261:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447802496 00000100:00100000:2.0:1783952234.565274:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447802496 00000100:00100000:2.0:1783952234.565348:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1484 00000100:00100000:2.0:1783952234.565361:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+69:73554:x1870605447802496:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.565397:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.565426:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2800/0x22c73c7857bb6788 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a610 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.565505:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2800/0x22c73c7857bb6788 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a610 expref: 70 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.565521:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2800/0x22c73c7857bb6788 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a610 expref: 70 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.565545:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:2.0:1783952234.565549:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783952234.565554:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2800, rc 0) 00000100:00100000:2.0:1783952234.566000:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+70:73554:x1870605447802496:12345-192.168.202.48@tcp:101:touch.0 Request processed in 639us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952234.566040:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1484 00000100:00100000:1.0:1783952234.570393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.570768:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447802624 00000100:00100000:2.0:1783952234.570782:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447802624 00000100:00100000:2.0:1783952234.570890:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4976 00000100:00100000:2.0:1783952234.570904:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:2399:x1870605447802624:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:2.0:1783952234.571230:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:2399:x1870605447802624:12345-192.168.202.48@tcp:2:touch.0 Request processed in 328us (850us total) trans 4294968966 rc 0/0 00000100:00100000:2.0:1783952234.571239:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4976 00000100:00100000:1.0:1783952234.574937:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.575174:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447802880 00000100:00100000:0.0:1783952234.575188:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447802880 00000100:00100000:0.0:1783952234.575266:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 254 00000100:00100000:0.0:1783952234.575280:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+70:73554:x1870605447802880:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:0.0:1783952234.575929:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+71:73554:x1870605447802880:12345-192.168.202.48@tcp:35:touch.0 Request processed in 648us (1004us total) trans 124554051615 rc 0/0 00000100:00100000:0.0:1783952234.575938:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 254 00000100:00100000:3.0:1783952234.579139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.579371:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447803136 00000100:00100000:1.0:1783952234.579385:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447803136 00000100:00100000:1.0:1783952234.579466:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1485 00000100:00100000:1.0:1783952234.579479:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+71:73554:x1870605447803136:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:1.0:1783952234.579514:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952234.579544:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb678f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a617 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.579710:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.579731:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.579746:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.579785:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.579790:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.579795:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783952234.580439:0:66236:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78b:0x0], index 0: 0 00010000:00010000:1.0:1783952234.580670:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb67a4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580679:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb67a4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580685:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb67a4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580721:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580726:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580731:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580735:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580739:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952234.580749:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580756:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580768:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:1.0:1783952234.580770:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952234.580774:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580780:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb6796 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952234.580792:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000abcb0ae9 reply state 000000007643f212 transno 124554051616 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580800:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580804:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff97b15f403000) 00010000:00010000:1.0:1783952234.580806:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952234.580808:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783952234.580843:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb678f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a617 expref: 74 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580858:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb67a4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a617 expref: 73 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.580866:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff97b15f403f00) 00010000:00010000:1.0:1783952234.580868:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783952234.580877:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71a00, rc 0) 00000100:00100000:1.0:1783952234.582458:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+74:73554:x1870605447803136:12345-192.168.202.48@tcp:101:touch.0 Request processed in 2965us (3315us total) trans 124554051616 rc 0/0 00000100:00100000:1.0:1783952234.582475:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1485 00000100:00100000:2.0:1783952234.585869:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.586227:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447803392 00000100:00100000:3.0:1783952234.586242:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447803392 00000100:00100000:3.0:1783952234.586437:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1486 00000100:00100000:3.0:1783952234.586451:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+74:73554:x1870605447803392:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:3.0:1783952234.586561:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952234.586627:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb67a4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a617 expref: 74 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.586651:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff97b15f403f00) 00010000:00010000:3.0:1783952234.586666:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952234.586819:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.586845:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.586858:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952234.587022:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f550858 reply state 0000000084336c3e transno 124554051617 ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.587037:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.587043:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff97b15f403300) 00010000:00010000:1.0:1783952234.587046:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952234.587049:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783952234.587179:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+75:73554:x1870605447803392:12345-192.168.202.48@tcp:36:touch.0 Request processed in 729us (1323us total) trans 124554051617 rc 0/0 00000100:00100000:1.0:1783952234.587188:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1486 00000100:00100000:2.0:1783952234.590819:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.591062:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447803520 00000100:00100000:3.0:1783952234.591076:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447803520 00000100:00100000:3.0:1783952234.591155:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1487 00000100:00100000:3.0:1783952234.591168:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+75:73554:x1870605447803520:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.591204:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.591232:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb67b9 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a61e expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.591312:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb67b9 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a61e expref: 76 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.591330:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23400/0x22c73c7857bb67b9 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a61e expref: 76 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.591384:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff97b15f403300) 00010000:00010000:3.0:1783952234.591388:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783952234.591393:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23400, rc 0) 00000100:00100000:3.0:1783952234.591482:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+76:73554:x1870605447803520:12345-192.168.202.48@tcp:101:touch.0 Request processed in 317us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952234.591490:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1487 00000100:00100000:3.0:1783952234.595218:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.595395:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447803648 00000100:00100000:1.0:1783952234.595408:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447803648 00000100:00100000:1.0:1783952234.595537:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4977 00000100:00100000:1.0:1783952234.595550:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:2399:x1870605447803648:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:1.0:1783952234.595976:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:2399:x1870605447803648:12345-192.168.202.48@tcp:2:touch.0 Request processed in 427us (773us total) trans 4294968967 rc 0/0 00000100:00100000:1.0:1783952234.596013:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4977 00000100:00100000:3.0:1783952234.598755:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.599004:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447803904 00000100:00100000:2.0:1783952234.599017:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447803904 00000100:00100000:2.0:1783952234.599102:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 255 00000100:00100000:2.0:1783952234.599116:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+76:73554:x1870605447803904:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:2.0:1783952234.599521:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+77:73554:x1870605447803904:12345-192.168.202.48@tcp:35:touch.0 Request processed in 407us (778us total) trans 124554051618 rc 0/0 00000100:00100000:2.0:1783952234.599531:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 255 00000100:00100000:3.0:1783952234.603196:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.603334:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447804160 00000100:00100000:0.0:1783952234.603347:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447804160 00000100:00100000:0.0:1783952234.603426:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1488 00000100:00100000:0.0:1783952234.603438:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+77:73554:x1870605447804160:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952234.603473:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952234.603503:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb67c0 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a625 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.603734:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.603755:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.603770:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.603788:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.603796:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.603803:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783952234.605448:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78c:0x0], index 0: 0 00010000:00010000:0.0:1783952234.607280:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb67d5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607308:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb67d5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607324:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb67d5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607376:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607384:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607390:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607397:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607404:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.607409:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607417:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607432:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952234.607435:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.607441:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607466:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb67c7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952234.607482:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fdf76900 reply state 00000000908140d2 transno 124554051619 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607497:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607504:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff97b143007f00) 00010000:00010000:0.0:1783952234.607506:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952234.607510:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783952234.607563:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb67c0 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a625 expref: 80 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607644:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb67d5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a625 expref: 79 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.607654:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff97b143007300) 00010000:00010000:0.0:1783952234.607657:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952234.607660:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644ca00, rc 0) 00000100:00100000:0.0:1783952234.607761:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+80:73554:x1870605447804160:12345-192.168.202.48@tcp:101:touch.0 Request processed in 4324us (4577us total) trans 124554051619 rc 0/0 00000100:00100000:0.0:1783952234.607773:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1488 00000100:00100000:2.0:1783952234.611873:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.612069:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447804416 00000100:00100000:0.0:1783952234.612083:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447804416 00000100:00100000:0.0:1783952234.612174:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1489 00000100:00100000:0.0:1783952234.612187:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+80:73554:x1870605447804416:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:0.0:1783952234.612291:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952234.612329:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb67d5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a625 expref: 80 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.612351:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff97b143007300) 00010000:00010000:0.0:1783952234.612363:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952234.612437:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.612452:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.612464:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952234.612772:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1355a3b reply state 000000003ed796cc transno 124554051620 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.612788:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.612794:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff97b143007200) 00010000:00010000:0.0:1783952234.612797:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952234.612800:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952234.612978:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+81:73554:x1870605447804416:12345-192.168.202.48@tcp:36:touch.0 Request processed in 793us (1117us total) trans 124554051620 rc 0/0 00000100:00100000:0.0:1783952234.612994:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1489 00000100:00100000:0.0:1783952234.616180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.616329:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447804544 00000100:00100000:3.0:1783952234.616343:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447804544 00000100:00100000:3.0:1783952234.616467:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1490 00000100:00100000:3.0:1783952234.616480:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+81:73554:x1870605447804544:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.616513:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.616540:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22c00/0x22c73c7857bb67ea lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a62c expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.616646:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22c00/0x22c73c7857bb67ea lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a62c expref: 82 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.616664:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22c00/0x22c73c7857bb67ea lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a62c expref: 82 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.616686:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff97b143007200) 00010000:00010000:3.0:1783952234.616690:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783952234.616711:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22c00, rc 0) 00000100:00100000:3.0:1783952234.616792:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+82:73554:x1870605447804544:12345-192.168.202.48@tcp:101:touch.0 Request processed in 314us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952234.616800:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1490 00000100:00100000:1.0:1783952234.621134:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.621456:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447804672 00000100:00100000:0.0:1783952234.621471:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447804672 00000100:00100000:0.0:1783952234.621794:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4978 00000100:00100000:0.0:1783952234.621808:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:2399:x1870605447804672:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:0.0:1783952234.622328:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:2399:x1870605447804672:12345-192.168.202.48@tcp:2:touch.0 Request processed in 522us (1206us total) trans 4294968968 rc 0/0 00000100:00100000:0.0:1783952234.622339:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4978 00000100:00100000:2.0:1783952234.625868:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.626091:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447804928 00000100:00100000:1.0:1783952234.626105:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447804928 00000100:00100000:1.0:1783952234.626180:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 256 00000100:00100000:1.0:1783952234.626193:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+82:73554:x1870605447804928:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:1.0:1783952234.626619:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+83:73554:x1870605447804928:12345-192.168.202.48@tcp:35:touch.0 Request processed in 389us (725us total) trans 124554051621 rc 0/0 00000100:00100000:1.0:1783952234.626628:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 256 00000100:00100000:1.0:1783952234.630420:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.630520:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447805184 00000100:00100000:3.0:1783952234.630535:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447805184 00000100:00100000:3.0:1783952234.630662:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1491 00000100:00100000:3.0:1783952234.630675:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+83:73554:x1870605447805184:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.630710:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.630737:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22e00/0x22c73c7857bb67f1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a633 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.631325:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.631346:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.631361:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.631378:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.631385:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.631392:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952234.632763:0:66236:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78d:0x0], index 0: 0 00010000:00010000:2.0:1783952234.633271:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6806 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633288:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6806 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633323:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6806 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633371:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633379:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633386:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633394:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633401:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952234.633406:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633415:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633430:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952234.633433:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952234.633439:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633448:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb67f8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.633465:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000078f8d2be reply state 00000000cf252c6d transno 124554051622 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633484:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633491:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff97b158d55a00) 00010000:00010000:2.0:1783952234.633493:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.633497:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783952234.633547:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22e00/0x22c73c7857bb67f1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a633 expref: 86 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633564:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6806 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a633 expref: 85 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.633572:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff97b176e45200) 00010000:00010000:2.0:1783952234.633575:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952234.633784:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2e00, rc 0) 00000100:00100000:2.0:1783952234.633916:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+86:73554:x1870605447805184:12345-192.168.202.48@tcp:101:touch.0 Request processed in 3244us (3510us total) trans 124554051622 rc 0/0 00000100:00100000:2.0:1783952234.633927:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1491 00000100:00100000:3.0:1783952234.639566:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.639748:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447805440 00000100:00100000:0.0:1783952234.639760:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447805440 00000100:00100000:0.0:1783952234.639840:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1492 00000100:00100000:0.0:1783952234.639851:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+86:73554:x1870605447805440:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:0.0:1783952234.639940:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952234.639992:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6806 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a633 expref: 86 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.640017:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff97b176e45200) 00010000:00010000:0.0:1783952234.640030:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952234.640104:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.640121:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.640134:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952234.640277:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000055b00705 reply state 00000000795ef093 transno 124554051623 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.640291:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.640307:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff97b143007300) 00010000:00010000:0.0:1783952234.640310:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952234.640313:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952234.640442:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+87:73554:x1870605447805440:12345-192.168.202.48@tcp:36:touch.0 Request processed in 592us (888us total) trans 124554051623 rc 0/0 00000100:00100000:0.0:1783952234.640451:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1492 00000100:00100000:0.0:1783952234.644554:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.644754:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447805568 00000100:00100000:1.0:1783952234.644767:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447805568 00000100:00100000:1.0:1783952234.644934:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1493 00000100:00100000:1.0:1783952234.644948:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14474d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+87:73554:x1870605447805568:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:1.0:1783952234.644989:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952234.645016:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb681b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a63a expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.645090:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb681b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a63a expref: 88 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.645107:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71c00/0x22c73c7857bb681b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a63a expref: 88 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.645129:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff97b143007300) 00010000:00010000:1.0:1783952234.645149:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783952234.645164:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71c00, rc 0) 00000100:00100000:1.0:1783952234.645250:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14474d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+88:73554:x1870605447805568:12345-192.168.202.48@tcp:101:touch.0 Request processed in 305us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952234.647193:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1493 00000100:00100000:2.0:1783952234.649294:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.649756:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447805696 00000100:00100000:3.0:1783952234.649770:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447805696 00000100:00100000:3.0:1783952234.649852:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4979 00000100:00100000:3.0:1783952234.649865:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:2399:x1870605447805696:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:3.0:1783952234.650771:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:2399:x1870605447805696:12345-192.168.202.48@tcp:2:touch.0 Request processed in 900us (1480us total) trans 4294968969 rc 0/0 00000100:00100000:3.0:1783952234.650785:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4979 00000100:00100000:0.0:1783952234.654244:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.654406:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447805952 00000100:00100000:3.0:1783952234.654420:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447805952 00000100:00100000:3.0:1783952234.654522:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 257 00000100:00100000:3.0:1783952234.654534:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+88:73554:x1870605447805952:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:3.0:1783952234.654938:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+89:73554:x1870605447805952:12345-192.168.202.48@tcp:35:touch.0 Request processed in 405us (706us total) trans 124554051624 rc 0/0 00000100:00100000:3.0:1783952234.654947:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 257 00000100:00100000:1.0:1783952234.662621:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.662771:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447806208 00000100:00100000:0.0:1783952234.662785:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447806208 00000100:00100000:0.0:1783952234.662872:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1494 00000100:00100000:0.0:1783952234.662895:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+89:73554:x1870605447806208:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952234.662932:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952234.662960:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6822 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a641 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663107:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663128:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663142:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663160:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663169:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663195:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783952234.663671:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78e:0x0], index 0: 0 00010000:00010000:0.0:1783952234.663847:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6837 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663857:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6837 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663865:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6837 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663918:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663926:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663934:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663941:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663949:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.663953:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663962:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.663993:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952234.663996:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.664002:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.664011:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6829 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952234.664028:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004dd8b4b7 reply state 0000000082a76b52 transno 124554051625 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.664041:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.664048:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff97b143007100) 00010000:00010000:0.0:1783952234.664050:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952234.664053:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783952234.664093:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6822 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a641 expref: 92 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.664110:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6837 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a641 expref: 91 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.664118:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff97b143007e00) 00010000:00010000:0.0:1783952234.664121:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952234.664123:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644c000, rc 0) 00000100:00100000:0.0:1783952234.664224:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+92:73554:x1870605447806208:12345-192.168.202.48@tcp:101:touch.0 Request processed in 1342us (1646us total) trans 124554051625 rc 0/0 00000100:00100000:0.0:1783952234.664234:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1494 00000100:00100000:2.0:1783952234.672051:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.672362:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447806464 00000100:00100000:0.0:1783952234.672377:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447806464 00000100:00100000:0.0:1783952234.672459:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1495 00000100:00100000:0.0:1783952234.672471:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+92:73554:x1870605447806464:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:0.0:1783952234.672554:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952234.672622:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6837 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a641 expref: 92 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.672647:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff97b143007e00) 00010000:00010000:0.0:1783952234.672662:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952234.672733:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.672749:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.672761:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952234.673126:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8fd60bc reply state 0000000065d69f90 transno 124554051626 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.673145:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.673151:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff97b143007600) 00010000:00010000:0.0:1783952234.673154:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952234.673158:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952234.673286:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+93:73554:x1870605447806464:12345-192.168.202.48@tcp:36:touch.0 Request processed in 816us (1312us total) trans 124554051626 rc 0/0 00000100:00100000:0.0:1783952234.673317:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1495 00000100:00100000:3.0:1783952234.675804:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.676134:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447806592 00000100:00100000:1.0:1783952234.676147:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447806592 00000100:00100000:1.0:1783952234.676220:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1496 00000100:00100000:1.0:1783952234.676233:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+93:73554:x1870605447806592:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:1.0:1783952234.676267:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952234.676293:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb684c lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a648 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.676371:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb684c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a648 expref: 94 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.676387:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71a00/0x22c73c7857bb684c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a648 expref: 94 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.676408:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff97b143007600) 00010000:00010000:1.0:1783952234.676412:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783952234.676417:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71a00, rc 0) 00000100:00100000:1.0:1783952234.676499:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+94:73554:x1870605447806592:12345-192.168.202.48@tcp:101:touch.0 Request processed in 268us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952234.676508:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1496 00000100:00100000:1.0:1783952234.679353:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.679465:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447806720 00000100:00100000:0.0:1783952234.679479:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447806720 00000100:00100000:0.0:1783952234.679630:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4980 00000100:00100000:0.0:1783952234.679643:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:2399:x1870605447806720:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:0.0:1783952234.679952:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+18:2399:x1870605447806720:12345-192.168.202.48@tcp:2:touch.0 Request processed in 311us (612us total) trans 4294968970 rc 0/0 00000100:00100000:0.0:1783952234.679961:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4980 00000100:00100000:1.0:1783952234.688272:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.688369:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447806976 00000100:00100000:0.0:1783952234.688384:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447806976 00000100:00100000:0.0:1783952234.688459:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 258 00000100:00100000:0.0:1783952234.688472:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177060c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+94:73554:x1870605447806976:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:0.0:1783952234.688941:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177060c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+95:73554:x1870605447806976:12345-192.168.202.48@tcp:35:touch.0 Request processed in 469us (682us total) trans 124554051627 rc 0/0 00000100:00100000:0.0:1783952234.688951:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 258 00000100:00100000:1.0:1783952234.692692:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.693121:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447807232 00000100:00100000:0.0:1783952234.693138:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447807232 00000100:00100000:0.0:1783952234.693219:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1497 00000100:00100000:0.0:1783952234.693232:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04671fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+95:73554:x1870605447807232:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:0.0:1783952234.693267:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952234.693297:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6853 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a64f expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.693440:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.693480:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.693493:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.693510:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.693518:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.693525:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783952234.694386:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x78f:0x0], index 0: 0 00010000:00010000:0.0:1783952234.694575:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6868 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695268:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6868 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695281:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6868 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695333:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695341:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695348:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695367:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695374:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952234.695379:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695389:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695404:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952234.695408:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952234.695413:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695421:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb685a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783952234.695441:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd5f580a reply state 00000000e6d6ec28 transno 124554051628 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695455:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695462:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff97b143007b00) 00010000:00010000:0.0:1783952234.695465:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952234.695468:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783952234.695515:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6853 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a64f expref: 98 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695531:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6868 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a64f expref: 97 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952234.695548:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff97b143007500) 00010000:00010000:0.0:1783952234.695551:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952234.695553:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644d000, rc 0) 00000100:00100000:1.0:1783952234.696529:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04671fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+98:73554:x1870605447807232:12345-192.168.202.48@tcp:101:touch.0 Request processed in 3290us (3843us total) trans 124554051628 rc 0/0 00000100:00100000:1.0:1783952234.696542:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1497 00000100:00100000:1.0:1783952234.700900:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.701103:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447807488 00000100:00100000:2.0:1783952234.701117:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447807488 00000100:00100000:2.0:1783952234.701307:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1498 00000100:00100000:2.0:1783952234.701320:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+98:73554:x1870605447807488:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:2.0:1783952234.701462:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952234.701498:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6868 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a64f expref: 98 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.701539:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff97b143007500) 00010000:00010000:2.0:1783952234.701554:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952234.701671:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.701687:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.701698:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.701838:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000039a04b9 reply state 0000000098aa9977 transno 124554051629 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.702052:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.702059:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff97b176e45800) 00010000:00010000:2.0:1783952234.702062:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.702065:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952234.702207:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+99:73554:x1870605447807488:12345-192.168.202.48@tcp:36:touch.0 Request processed in 888us (1385us total) trans 124554051629 rc 0/0 00000100:00100000:2.0:1783952234.702218:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1498 00000100:00100000:1.0:1783952234.713130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.714186:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447807616 00000100:00100000:2.0:1783952234.714204:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447807616 00000100:00100000:2.0:1783952234.714388:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1499 00000100:00100000:2.0:1783952234.714402:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+99:73554:x1870605447807616:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.714440:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.714489:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3e00/0x22c73c7857bb687d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a656 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.714569:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3e00/0x22c73c7857bb687d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a656 expref: 100 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.714615:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3e00/0x22c73c7857bb687d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a656 expref: 100 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.714638:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff97b176e45800) 00010000:00010000:2.0:1783952234.714641:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783952234.714646:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3e00, rc 0) 00000100:00100000:2.0:1783952234.714788:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+100:73554:x1870605447807616:12345-192.168.202.48@tcp:101:touch.0 Request processed in 389us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952234.714797:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1499 00000100:00100000:1.0:1783952234.729218:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.729405:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447807744 00000100:00100000:3.0:1783952234.729419:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447807744 00000100:00100000:3.0:1783952234.729532:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4981 00000100:00100000:3.0:1783952234.729544:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+18:2399:x1870605447807744:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:3.0:1783952234.729899:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:2399:x1870605447807744:12345-192.168.202.48@tcp:2:touch.0 Request processed in 357us (695us total) trans 4294968971 rc 0/0 00000100:00100000:3.0:1783952234.729908:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4981 00000100:00100000:1.0:1783952234.733536:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.733930:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447808000 00000100:00100000:3.0:1783952234.733944:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447808000 00000100:00100000:3.0:1783952234.734156:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 259 00000100:00100000:3.0:1783952234.734170:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+100:73554:x1870605447808000:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:3.0:1783952234.734652:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+101:73554:x1870605447808000:12345-192.168.202.48@tcp:35:touch.0 Request processed in 484us (1131us total) trans 124554051630 rc 0/0 00000100:00100000:3.0:1783952234.734662:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 259 00000100:00100000:1.0:1783952234.739391:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.739525:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447808256 00000100:00100000:2.0:1783952234.739540:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447808256 00000100:00100000:2.0:1783952234.739808:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1500 00000100:00100000:2.0:1783952234.739822:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+101:73554:x1870605447808256:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.739988:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.740021:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb6884 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a65d expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.740366:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.740386:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.740421:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.740439:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.740446:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.740453:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952234.741131:0:66236:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x790:0x0], index 0: 0 00010000:00010000:2.0:1783952234.741518:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6899 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741531:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6899 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741541:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6899 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741639:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741647:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741654:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741662:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741682:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952234.741687:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741696:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741711:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952234.741715:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952234.741720:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741727:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb688b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.741743:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048665be3 reply state 0000000006773252 transno 124554051631 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741755:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.741762:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff97b176e45d00) 00010000:00010000:2.0:1783952234.741764:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.741768:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783952234.742118:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb6884 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a65d expref: 104 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.742138:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6899 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a65d expref: 103 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.742540:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff97b176e45200) 00010000:00010000:2.0:1783952234.742542:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952234.742546:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2600, rc 0) 00000100:00100000:2.0:1783952234.742808:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+104:73554:x1870605447808256:12345-192.168.202.48@tcp:101:touch.0 Request processed in 2987us (3429us total) trans 124554051631 rc 0/0 00000100:00100000:2.0:1783952234.742818:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1500 00000100:00100000:1.0:1783952234.747686:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.747797:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447808512 00000100:00100000:3.0:1783952234.747810:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447808512 00000100:00100000:3.0:1783952234.747900:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1501 00000100:00100000:3.0:1783952234.747912:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+104:73554:x1870605447808512:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:3.0:1783952234.748005:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952234.748044:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6899 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a65d expref: 104 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.748071:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff97b176e45200) 00010000:00010000:3.0:1783952234.748085:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952234.748405:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.748421:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.748433:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.748577:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039b9412b reply state 000000004029548b transno 124554051632 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.748639:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.748647:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff97b158d55800) 00010000:00010000:3.0:1783952234.748666:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.748669:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952234.748779:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+105:73554:x1870605447808512:12345-192.168.202.48@tcp:36:touch.0 Request processed in 867us (1105us total) trans 124554051632 rc 0/0 00000100:00100000:3.0:1783952234.748788:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1501 00000100:00100000:3.0:1783952234.752215:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.752386:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447808640 00000100:00100000:1.0:1783952234.752400:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447808640 00000100:00100000:1.0:1783952234.752478:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1502 00000100:00100000:1.0:1783952234.752489:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+105:73554:x1870605447808640:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:1.0:1783952234.752523:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952234.752553:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71600/0x22c73c7857bb68ae lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a664 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.752661:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71600/0x22c73c7857bb68ae lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a664 expref: 106 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.752677:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71600/0x22c73c7857bb68ae lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a664 expref: 106 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.752702:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff97b158d55800) 00010000:00010000:1.0:1783952234.752705:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783952234.752726:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71600, rc 0) 00000100:00100000:1.0:1783952234.752801:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+106:73554:x1870605447808640:12345-192.168.202.48@tcp:101:touch.0 Request processed in 312us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952234.752809:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1502 00000100:00100000:1.0:1783952234.757629:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.757967:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447808768 00000100:00100000:3.0:1783952234.757995:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447808768 00000100:00100000:3.0:1783952234.758079:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4982 00000100:00100000:3.0:1783952234.758092:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:2401:x1870605447808768:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:3.0:1783952234.758828:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+20:2401:x1870605447808768:12345-192.168.202.48@tcp:2:touch.0 Request processed in 734us (1250us total) trans 4294968972 rc 0/0 00000100:00100000:3.0:1783952234.758840:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4982 00000100:00100000:1.0:1783952234.763375:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.763489:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447809024 00000100:00100000:2.0:1783952234.763502:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447809024 00000100:00100000:2.0:1783952234.763789:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 260 00000100:00100000:2.0:1783952234.763803:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+106:73554:x1870605447809024:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:2.0:1783952234.764381:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+107:73554:x1870605447809024:12345-192.168.202.48@tcp:35:touch.0 Request processed in 578us (1016us total) trans 124554051633 rc 0/0 00000100:00100000:2.0:1783952234.764390:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 260 00000100:00100000:1.0:1783952234.767818:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.767937:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447809280 00000100:00100000:3.0:1783952234.767952:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447809280 00000100:00100000:3.0:1783952234.768114:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1503 00000100:00100000:3.0:1783952234.768127:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+107:73554:x1870605447809280:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.768170:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.768199:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb68b5 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a66b expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.768336:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.768352:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.768363:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.768390:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.768395:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.768399:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783952234.769967:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x791:0x0], index 0: 0 00010000:00010000:1.0:1783952234.770669:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb68ca lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770685:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb68ca lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770694:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb68ca lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770736:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770742:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770746:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770751:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770755:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952234.770759:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770780:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770792:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:1.0:1783952234.770795:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952234.770798:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770803:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb68bc lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952234.770815:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d915334c reply state 00000000b909d70a transno 124554051634 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770825:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770829:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff97b158d55500) 00010000:00010000:1.0:1783952234.770830:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952234.770833:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783952234.770889:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb68b5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a66b expref: 110 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770908:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb68ca lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a66b expref: 109 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.770916:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff97b15f403d00) 00010000:00010000:1.0:1783952234.770917:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783952234.770919:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b04db71400, rc 0) 00000100:00100000:1.0:1783952234.771163:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+110:73554:x1870605447809280:12345-192.168.202.48@tcp:101:touch.0 Request processed in 3037us (3357us total) trans 124554051634 rc 0/0 00000100:00100000:1.0:1783952234.771174:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1503 00000100:00100000:1.0:1783952234.774080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.774210:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447809536 00000100:00100000:3.0:1783952234.774221:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447809536 00000100:00100000:3.0:1783952234.774325:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1504 00000100:00100000:3.0:1783952234.774336:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+110:73554:x1870605447809536:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:3.0:1783952234.774407:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952234.774441:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71400/0x22c73c7857bb68ca lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a66b expref: 110 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.774464:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff97b15f403d00) 00010000:00010000:3.0:1783952234.774479:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952234.774549:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.774560:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.774568:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.774722:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000621fb6bc reply state 0000000092152c77 transno 124554051635 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.774748:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.774753:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff97b158d55e00) 00010000:00010000:3.0:1783952234.774755:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.774757:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952234.774853:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+111:73554:x1870605447809536:12345-192.168.202.48@tcp:36:touch.0 Request processed in 518us (786us total) trans 124554051635 rc 0/0 00000100:00100000:3.0:1783952234.774860:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1504 00000100:00100000:2.0:1783952234.776859:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.776959:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447809664 00000100:00100000:1.0:1783952234.776969:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447809664 00000100:00100000:1.0:1783952234.777116:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1505 00000100:00100000:1.0:1783952234.777130:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+111:73554:x1870605447809664:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:1.0:1783952234.777312:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952234.777336:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb68df lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a672 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.777398:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb68df lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a672 expref: 112 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.777410:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c800/0x22c73c7857bb68df lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a672 expref: 112 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.777426:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff97b158d55e00) 00010000:00010000:1.0:1783952234.777429:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783952234.777433:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2c800, rc 0) 00000100:00100000:1.0:1783952234.777492:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+112:73554:x1870605447809664:12345-192.168.202.48@tcp:101:touch.0 Request processed in 367us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952234.777498:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1505 00000100:00100000:3.0:1783952234.779496:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.779612:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447809792 00000100:00100000:2.0:1783952234.779621:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447809792 00000100:00100000:2.0:1783952234.779669:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4983 00000100:00100000:2.0:1783952234.779676:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+20:2400:x1870605447809792:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:2.0:1783952234.779923:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+21:2400:x1870605447809792:12345-192.168.202.48@tcp:2:touch.0 Request processed in 247us (436us total) trans 4294968973 rc 0/0 00000100:00100000:2.0:1783952234.779930:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4983 00000100:00100000:2.0:1783952234.781876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.781965:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447810048 00000100:00100000:3.0:1783952234.781975:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447810048 00000100:00100000:3.0:1783952234.782028:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 261 00000100:00100000:3.0:1783952234.782036:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+112:73554:x1870605447810048:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:3.0:1783952234.782395:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+113:73554:x1870605447810048:12345-192.168.202.48@tcp:35:touch.0 Request processed in 359us (531us total) trans 124554051636 rc 0/0 00000100:00100000:3.0:1783952234.782401:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 261 00000100:00100000:3.0:1783952234.784752:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.784912:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447810304 00000100:00100000:2.0:1783952234.784922:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447810304 00000100:00100000:2.0:1783952234.785003:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1506 00000100:00100000:2.0:1783952234.785012:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+113:73554:x1870605447810304:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.785038:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.785065:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb68e6 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a679 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.785539:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.785556:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.785567:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.785608:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.785614:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.785619:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952234.785997:0:66236:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x792:0x0], index 0: 0 00010000:00010000:2.0:1783952234.786147:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb68fb lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952234.786323:0:94423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f00a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94423:1870605465628032:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783952234.786383:0:94423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952234.786420:0:94423:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b0468646c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783952234.786480:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465628032 00000100:00100000:1.0:1783952234.786486:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465628032 00000100:00100000:1.0:1783952234.786524:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4984 00000100:00100000:1.0:1783952234.786531:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:94423:x1870605465628032:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783952234.786627:0:26205:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1954 00000100:00100000:1.0:1783952234.787854:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:94423:x1870605465628032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1317us (1463us total) trans 4294968974 rc 0/0 00000100:00100000:1.0:1783952234.787866:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4984 00000100:00100000:1.0:1783952234.787962:0:94423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f00a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94423:1870605465628032:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783952234.787976:0:94423:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x792:0x0]-[0x280000401:0x7c1:0x0] 00010000:00010000:2.0:1783952234.788405:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb68fb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788416:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb68fb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788485:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788490:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788495:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788500:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788504:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952234.788508:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788513:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788524:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952234.788526:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952234.788530:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788534:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb68ed lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.788547:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a874092c reply state 00000000dd6b1a0a transno 124554051637 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788556:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788565:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff97b176e45400) 00010000:00010000:2.0:1783952234.788566:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.788568:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783952234.788636:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb68e6 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a679 expref: 116 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788647:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb68fb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a679 expref: 115 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.788653:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff97b176e45100) 00010000:00010000:2.0:1783952234.788655:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952234.788656:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3200, rc 0) 00000100:00100000:2.0:1783952234.788716:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+116:73554:x1870605447810304:12345-192.168.202.48@tcp:101:touch.0 Request processed in 3706us (3973us total) trans 124554051637 rc 0/0 00000100:00100000:2.0:1783952234.788722:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1506 00000100:00100000:2.0:1783952234.791250:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.791378:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447810560 00000100:00100000:1.0:1783952234.791389:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447810560 00000100:00100000:1.0:1783952234.791446:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1507 00000100:00100000:1.0:1783952234.791455:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+116:73554:x1870605447810560:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:1.0:1783952234.791520:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952234.791549:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb68fb lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a679 expref: 116 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.791565:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff97b176e45100) 00010000:00010000:1.0:1783952234.791709:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952234.791775:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.791787:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.791796:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952234.791944:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cff4ff49 reply state 00000000f00eda5e transno 124554051638 ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.791973:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.792075:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff97b15f403100) 00010000:00010000:1.0:1783952234.792077:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952234.792079:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783952234.792223:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+117:73554:x1870605447810560:12345-192.168.202.48@tcp:36:touch.0 Request processed in 767us (984us total) trans 124554051638 rc 0/0 00000100:00100000:1.0:1783952234.792231:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1507 00000100:00100000:1.0:1783952234.794473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.794737:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447810688 00000100:00100000:2.0:1783952234.794748:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447810688 00000100:00100000:2.0:1783952234.794833:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1508 00000100:00100000:2.0:1783952234.794845:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+117:73554:x1870605447810688:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.794886:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.794911:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb6910 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a680 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.794971:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb6910 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a680 expref: 118 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.795052:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2000/0x22c73c7857bb6910 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a680 expref: 118 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.795073:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff97b15f403100) 00010000:00010000:2.0:1783952234.795076:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783952234.795079:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2000, rc 0) 00000100:00100000:2.0:1783952234.795215:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+118:73554:x1870605447810688:12345-192.168.202.48@tcp:101:touch.0 Request processed in 373us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952234.795222:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1508 00000100:00100000:3.0:1783952234.797262:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.797409:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447810816 00000100:00100000:2.0:1783952234.797419:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447810816 00000100:00100000:2.0:1783952234.797477:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4985 00000100:00100000:2.0:1783952234.797486:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d33551be-a709-4ba2-a74c-f4d7b53c6817+21:2400:x1870605447810816:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:2.0:1783952234.797778:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:2400:x1870605447810816:12345-192.168.202.48@tcp:2:touch.0 Request processed in 293us (527us total) trans 4294968975 rc 0/0 00000100:00100000:2.0:1783952234.797784:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4985 00000100:00100000:3.0:1783952234.799836:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.799919:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447811072 00000100:00100000:2.0:1783952234.799931:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447811072 00000100:00100000:3.0:1783952234.800012:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 262 00000100:00100000:3.0:1783952234.800026:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+118:73554:x1870605447811072:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:3.0:1783952234.800465:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+119:73554:x1870605447811072:12345-192.168.202.48@tcp:35:touch.0 Request processed in 442us (637us total) trans 124554051639 rc 0/0 00000100:00100000:3.0:1783952234.800475:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 262 00000100:00100000:1.0:1783952234.802240:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.802367:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447811328 00000100:00100000:3.0:1783952234.802379:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447811328 00000100:00100000:3.0:1783952234.802448:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1509 00000100:00100000:3.0:1783952234.802459:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+119:73554:x1870605447811328:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:3.0:1783952234.802494:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952234.802523:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6917 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a687 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.802681:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.802701:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.802712:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.802730:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.802734:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.802739:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783952234.803167:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x793:0x0], index 0: 0 00010000:00010000:3.0:1783952234.803434:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb692c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803442:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb692c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803454:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb692c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803487:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803493:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803497:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803502:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803506:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952234.803509:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803514:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803524:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:3.0:1783952234.803526:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952234.803530:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803535:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb691e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783952234.803546:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c46c5be7 reply state 00000000369607dc transno 124554051640 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803559:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803564:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff97b14396e300) 00010000:00010000:3.0:1783952234.803565:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952234.803568:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783952234.803754:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6917 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a687 expref: 122 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803771:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb692c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a687 expref: 121 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.803779:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff97b14396e700) 00010000:00010000:3.0:1783952234.803781:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952234.803784:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23800, rc 0) 00000100:00100000:2.0:1783952234.803917:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+122:73554:x1870605447811328:12345-192.168.202.48@tcp:101:touch.0 Request processed in 1458us (1687us total) trans 124554051640 rc 0/0 00000100:00100000:2.0:1783952234.803925:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1509 00000100:00100000:1.0:1783952234.806144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.806403:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447811584 00000100:00100000:3.0:1783952234.806416:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447811584 00000100:00100000:3.0:1783952234.806485:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1510 00000100:00100000:3.0:1783952234.806496:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+122:73554:x1870605447811584:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:3.0:1783952234.806573:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952234.806639:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb692c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a687 expref: 122 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952234.806664:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff97b14396e700) 00010000:00010000:3.0:1783952234.806677:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952234.806809:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.806822:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.806854:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.807042:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f62827c8 reply state 000000005e17d7ab transno 124554051641 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.807054:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.807059:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff97b176e45b00) 00010000:00010000:2.0:1783952234.807061:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.807063:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952234.807165:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+123:73554:x1870605447811584:12345-192.168.202.48@tcp:36:touch.0 Request processed in 671us (1033us total) trans 124554051641 rc 0/0 00000100:00100000:2.0:1783952234.807172:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1510 00000100:00100000:3.0:1783952234.809106:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.809401:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447811712 00000100:00100000:1.0:1783952234.809410:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447811712 00000100:00100000:1.0:1783952234.809465:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1511 00000100:00100000:1.0:1783952234.809473:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+123:73554:x1870605447811712:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:1.0:1783952234.809501:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952234.809520:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb6941 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a68e expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.809574:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb6941 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a68e expref: 124 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.809622:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2da00/0x22c73c7857bb6941 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a68e expref: 124 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.809644:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff97b176e45b00) 00010000:00010000:1.0:1783952234.809665:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783952234.809670:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2da00, rc 0) 00000100:00100000:1.0:1783952234.809735:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+124:73554:x1870605447811712:12345-192.168.202.48@tcp:101:touch.0 Request processed in 262us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952234.809742:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1511 00000100:00100000:1.0:1783952234.814698:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.814801:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447811840 00000100:00100000:2.0:1783952234.814815:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447811840 00000100:00100000:2.0:1783952234.814935:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4986 00000100:00100000:2.0:1783952234.814957:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:2400:x1870605447811840:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:2.0:1783952234.815379:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:2400:x1870605447811840:12345-192.168.202.48@tcp:2:touch.0 Request processed in 424us (693us total) trans 4294968976 rc 0/0 00000100:00100000:2.0:1783952234.815388:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4986 00000100:00100000:3.0:1783952234.817460:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.817542:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447812096 00000100:00100000:0.0:1783952234.817554:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447812096 00000100:00100000:0.0:1783952234.817637:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 263 00000100:00100000:0.0:1783952234.817649:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+124:73554:x1870605447812096:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:0.0:1783952234.818342:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+125:73554:x1870605447812096:12345-192.168.202.48@tcp:35:touch.0 Request processed in 692us (888us total) trans 124554051642 rc 0/0 00000100:00100000:0.0:1783952234.818353:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 263 00000100:00100000:3.0:1783952234.820719:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.820830:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447812352 00000100:00100000:2.0:1783952234.820844:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447812352 00000100:00100000:2.0:1783952234.820932:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1512 00000100:00100000:2.0:1783952234.821064:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+125:73554:x1870605447812352:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:2.0:1783952234.821101:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952234.821385:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6948 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a695 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.821534:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.821554:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.821568:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.821634:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.821644:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.821651:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783952234.822496:0:66236:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x794:0x0], index 0: 0 00010000:00010000:2.0:1783952234.822738:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb695d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.822753:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb695d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.822764:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb695d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.822811:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.822833:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.822841:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.822849:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.822855:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952234.822859:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.822868:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.822895:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952234.822899:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952234.822905:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.822912:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb694f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.822929:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000094cc89c7 reply state 0000000011fe1b8c transno 124554051643 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.823069:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.823077:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff97b176e45100) 00010000:00010000:2.0:1783952234.823085:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.823088:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783952234.823133:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6948 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a695 expref: 128 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.823218:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb695d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a695 expref: 127 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.823289:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff97b176e45200) 00010000:00010000:2.0:1783952234.823291:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952234.823294:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3200, rc 0) 00000100:00100000:2.0:1783952234.823410:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+128:73554:x1870605447812352:12345-192.168.202.48@tcp:101:touch.0 Request processed in 2350us (2702us total) trans 124554051643 rc 0/0 00000100:00100000:2.0:1783952234.823421:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1512 00000100:00100000:1.0:1783952234.832307:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.837318:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447812608 00000100:00100000:2.0:1783952234.837343:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447812608 00000100:00100000:2.0:1783952234.837451:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1513 00000100:00100000:2.0:1783952234.837467:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+128:73554:x1870605447812608:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:2.0:1783952234.837548:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952234.837622:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb695d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a695 expref: 128 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.837650:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff97b176e45200) 00010000:00010000:2.0:1783952234.837664:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952234.837739:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.837754:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.837782:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.837927:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006311630 reply state 000000007900a575 transno 124554051644 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.837938:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.837943:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff97b1584d4700) 00010000:00010000:2.0:1783952234.837945:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.837947:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952234.838070:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+129:73554:x1870605447812608:12345-192.168.202.48@tcp:36:touch.0 Request processed in 606us (5779us total) trans 124554051644 rc 0/0 00000100:00100000:2.0:1783952234.838081:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1513 00000100:00100000:3.0:1783952234.841634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.841955:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447812736 00000100:00100000:1.0:1783952234.841970:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447812736 00000100:00100000:1.0:1783952234.842062:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1514 00000100:00100000:1.0:1783952234.842075:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+129:73554:x1870605447812736:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:1.0:1783952234.842112:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952234.842143:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c600/0x22c73c7857bb6972 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a69c expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.842370:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c600/0x22c73c7857bb6972 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a69c expref: 130 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.842391:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c600/0x22c73c7857bb6972 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a69c expref: 130 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.842415:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff97b1584d4700) 00010000:00010000:1.0:1783952234.842418:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783952234.842421:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2c600, rc 0) 00000100:00100000:1.0:1783952234.842496:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+130:73554:x1870605447812736:12345-192.168.202.48@tcp:101:touch.0 Request processed in 425us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952234.842505:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1514 00000100:00100000:1.0:1783952234.847221:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.847440:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447812864 00000100:00100000:3.0:1783952234.847454:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447812864 00000100:00100000:3.0:1783952234.847566:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4987 00000100:00100000:3.0:1783952234.847681:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:2401:x1870605447812864:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:3.0:1783952234.848184:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+24:2401:x1870605447812864:12345-192.168.202.48@tcp:2:touch.0 Request processed in 606us (976us total) trans 4294968977 rc 0/0 00000100:00100000:3.0:1783952234.848204:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4987 00000100:00100000:1.0:1783952234.852065:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952234.852169:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447813120 00000100:00100000:3.0:1783952234.852183:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447813120 00000100:00100000:3.0:1783952234.852500:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 264 00000100:00100000:3.0:1783952234.852513:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177061850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+130:73554:x1870605447813120:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:3.0:1783952234.853140:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177061850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+131:73554:x1870605447813120:12345-192.168.202.48@tcp:35:touch.0 Request processed in 627us (1088us total) trans 124554051645 rc 0/0 00000100:00100000:3.0:1783952234.853150:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 264 00000100:00100000:3.0:1783952234.856518:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.856573:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447813376 00000100:00100000:1.0:1783952234.856704:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447813376 00000100:00100000:1.0:1783952234.856784:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1515 00000100:00100000:1.0:1783952234.856797:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+131:73554:x1870605447813376:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:1.0:1783952234.856832:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952234.856864:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb6979 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6a3 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.857102:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.857121:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.857135:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.857489:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.857501:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.857509:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783952234.858254:0:83761:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x795:0x0], index 0: 0 00010000:00010000:1.0:1783952234.858519:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb698e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858556:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb698e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858568:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb698e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858782:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858791:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858798:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858806:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858812:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2de00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952234.858817:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858825:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858841:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:1.0:1783952234.858844:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952234.858850:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858856:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6980 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952234.858893:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007321628e reply state 000000003c4bfb20 transno 124554051646 ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858907:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.858914:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff97b15f403c00) 00010000:00010000:1.0:1783952234.858916:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952234.858920:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783952234.858967:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb6979 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6a3 expref: 134 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.859050:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb698e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6a3 expref: 133 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.859059:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff97b15f403200) 00010000:00010000:1.0:1783952234.859062:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783952234.859065:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d800, rc 0) 00000100:00100000:1.0:1783952234.860105:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+134:73554:x1870605447813376:12345-192.168.202.48@tcp:101:touch.0 Request processed in 3301us (3589us total) trans 124554051646 rc 0/0 00000100:00100000:1.0:1783952234.860119:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1515 00000100:00100000:1.0:1783952234.866769:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952234.867018:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447813632 00000100:00100000:2.0:1783952234.867033:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447813632 00000100:00100000:2.0:1783952234.867256:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1516 00000100:00100000:2.0:1783952234.867269:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+134:73554:x1870605447813632:12345-192.168.202.48@tcp:36:touch.0 00010000:00010000:2.0:1783952234.867355:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952234.867393:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb698e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6a3 expref: 134 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.867422:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff97b15f403200) 00010000:00010000:2.0:1783952234.867439:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952234.867511:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.867546:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.867558:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783952234.867747:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013005130 reply state 00000000acc45b46 transno 124554051647 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.867761:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952234.867767:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:2.0:1783952234.867770:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952234.867773:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952234.869069:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+135:73554:x1870605447813632:12345-192.168.202.48@tcp:36:touch.0 Request processed in 1792us (2305us total) trans 124554051647 rc 0/0 00000100:00100000:2.0:1783952234.869081:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1516 00000100:00100000:2.0:1783952234.874073:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952234.874266:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447813760 00000100:00100000:1.0:1783952234.874279:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447813760 00000100:00100000:1.0:1783952234.874355:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1517 00000100:00100000:1.0:1783952234.874368:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+135:73554:x1870605447813760:12345-192.168.202.48@tcp:101:touch.0 00010000:00010000:1.0:1783952234.874402:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952234.874451:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb69a3 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6aa expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.874531:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb69a3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6aa expref: 136 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.874550:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2ca00/0x22c73c7857bb69a3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6aa expref: 136 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952234.874573:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:1.0:1783952234.874576:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783952234.874581:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2ca00, rc 0) 00000100:00100000:1.0:1783952234.874805:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+136:73554:x1870605447813760:12345-192.168.202.48@tcp:101:touch.0 Request processed in 439us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952234.874814:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1517 00000100:00100000:2.0:1783952234.884203:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.884783:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447813888 00000100:00100000:0.0:1783952234.884798:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447813888 00000100:00100000:0.0:1783952234.885193:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4988 00000100:00100000:0.0:1783952234.885210:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b05095bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+24:2400:x1870605447813888:12345-192.168.202.48@tcp:2:touch.0 00000100:00100000:0.0:1783952234.885620:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b05095bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447813888:12345-192.168.202.48@tcp:2:touch.0 Request processed in 383us (1402us total) trans 4294968978 rc 0/0 00000100:00100000:0.0:1783952234.885628:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4988 00000100:00100000:1.0:1783952234.889244:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952234.889368:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447814144 00000100:00100000:0.0:1783952234.889381:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447814144 00000100:00100000:0.0:1783952234.889492:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 265 00000100:00100000:0.0:1783952234.889506:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+136:73554:x1870605447814144:12345-192.168.202.48@tcp:35:touch.0 00000100:00100000:0.0:1783952234.890489:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+137:73554:x1870605447814144:12345-192.168.202.48@tcp:35:touch.0 Request processed in 980us (1252us total) trans 124554051648 rc 0/0 00000100:00100000:0.0:1783952234.890501:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 265 00010000:00010000:3.0:1783952235.041218:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952235.105538:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783952235.105607:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b050958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465628160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952235.105704:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952235.107375:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465628160 00000100:00100000:1.0:1783952235.107395:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465628160 00000100:00100000:1.0:1783952235.107486:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271 00000100:00100000:1.0:1783952235.107502:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465628160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783952235.107536:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783952235.107692:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465628160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 195us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952235.107700:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271 00000100:00080000:1.0:1783952235.107726:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952235.107788:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b050958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465628160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783952235.110025:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465628288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952235.110273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952235.110694:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465628288 00000100:00100000:0.0:1783952235.110706:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465628288 00000100:00100000:0.0:1783952235.110789:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272 00000100:00100000:0.0:1783952235.110802:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465628288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952235.110838:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952235.110919:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465628288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952235.110926:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272 00000100:00100000:3.0:1783952235.111100:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465628288:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783952235.111687:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783952236.064950:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952236.589403:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952236.589516:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447814272 00000100:00100000:2.0:1783952236.589531:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447814272 00000100:00100000:2.0:1783952236.589690:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1518 00000100:00100000:2.0:1783952236.589704:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+137:73582:x1870605447814272:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:2.0:1783952236.589769:0:66236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:2.0:1783952236.589901:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+137:73582:x1870605447814272:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 202us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952236.589909:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1518 00000100:00080000:1.0:1783952236.591025:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952236.593507:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952236.594392:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447814400 00000100:00100000:0.0:1783952236.594408:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447814400 00000100:00100000:0.0:1783952236.594577:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1519 00000100:00100000:0.0:1783952236.594641:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:73582:x1870605447814400:12345-192.168.202.48@tcp:41:lfs.0 00000004:00000024:0.0:1783952236.594698:0:66237:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:0.0:1783952236.594794:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:73582:x1870605447814400:12345-192.168.202.48@tcp:41:lfs.0 Request processed in 207us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952236.594803:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1519 00000100:00080000:1.0:1783952236.598974:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952236.599095:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952236.599659:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447814528 00000100:00100000:3.0:1783952236.599675:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447814528 00000100:00100000:3.0:1783952236.599815:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2273 00000100:00100000:3.0:1783952236.599829:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:73582:x1870605447814528:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783952236.599887:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783952236.599990:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:73582:x1870605447814528:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 165us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952236.600017:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2273 00000100:00080000:1.0:1783952236.600268:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952236.603555:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952236.603803:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447814656 00000100:00100000:3.0:1783952236.603828:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447814656 00000100:00100000:3.0:1783952236.603922:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2274 00000100:00100000:3.0:1783952236.603935:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:73582:x1870605447814656:12345-192.168.202.48@tcp:13:lfs.0 00002000:00000024:3.0:1783952236.603983:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952236.604093:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:73582:x1870605447814656:12345-192.168.202.48@tcp:13:lfs.0 Request processed in 161us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952236.604102:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2274 00000100:00080000:1.0:1783952236.604491:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783952237.090987:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783952237.161876:0:94405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051648 is committed 00010000:00010000:2.0:1783952237.162049:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162064:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162072:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162079:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162084:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162094:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162115:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff97b176e45000) 00010000:00010000:2.0:1783952237.162119:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.162124:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162131:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6551 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162156:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162184:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162190:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162196:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162199:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162206:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162215:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952237.162217:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.162220:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162226:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6558 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162245:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162252:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162257:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162262:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162272:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162279:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162289:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952237.162291:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783952237.162295:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162302:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb65b3 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162315:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162321:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162327:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162332:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162335:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162341:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162348:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff97b176e45300) 00010000:00010000:2.0:1783952237.162351:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.162360:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162367:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb65e4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162384:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162392:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162398:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162403:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162406:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162412:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162421:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff97b158d55300) 00010000:00010000:2.0:1783952237.162423:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.162426:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162432:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb65f9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162445:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162462:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162469:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162475:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbce00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162479:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162485:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162493:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff97b143007000) 00010000:00010000:2.0:1783952237.162496:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.162499:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162505:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6615 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162522:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162529:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162535:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162541:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86aa00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162551:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162558:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162582:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff97b158d55700) 00010000:00010000:2.0:1783952237.162613:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.162617:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162624:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb662a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162638:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162644:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162650:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162656:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1820cd200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162659:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162666:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162675:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff97b176e45900) 00010000:00010000:2.0:1783952237.162677:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.162689:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162695:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd200/0x22c73c7857bb6646 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162712:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162718:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162723:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162728:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162731:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162736:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162744:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff97b176e45f00) 00010000:00010000:2.0:1783952237.162747:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.162749:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162755:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb665b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162766:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162782:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162788:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162792:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162795:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162801:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162809:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff97b176e45700) 00010000:00010000:2.0:1783952237.162812:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.162815:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162821:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6677 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162838:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162844:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162850:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162855:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162873:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162881:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162890:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff97b158d55f00) 00010000:00010000:2.0:1783952237.162893:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.162895:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162901:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb668c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162913:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162919:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162926:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162930:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.162934:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162940:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.162947:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff97b158d55400) 00010000:00010000:2.0:1783952237.162949:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.163212:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163221:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae200/0x22c73c7857bb66a8 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163241:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163248:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163253:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163258:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762afa00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.163261:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163267:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163276:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff97b158d55900) 00010000:00010000:2.0:1783952237.163278:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.163281:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163287:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762afa00/0x22c73c7857bb66bd lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163298:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163315:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163322:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163326:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1762ae800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.163329:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163335:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163343:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff97b158d55b00) 00010000:00010000:2.0:1783952237.163346:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.163349:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163354:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1762ae800/0x22c73c7857bb66d9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163370:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163377:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163382:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163387:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ba00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.163395:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163401:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163409:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff97b158d55200) 00010000:00010000:2.0:1783952237.163411:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.163414:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163419:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb66ee lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163432:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163439:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163444:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163449:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.163452:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163457:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163465:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff97b158d55100) 00010000:00010000:2.0:1783952237.163468:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.163477:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163484:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb670a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163500:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163508:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163513:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163519:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.163521:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163528:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163537:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff97b176e45c00) 00010000:00010000:2.0:1783952237.163539:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.163542:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.163549:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb671f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165356:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165382:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165390:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165396:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c3a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.165400:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165408:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165425:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff97b176e45a00) 00010000:00010000:2.0:1783952237.165428:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.165434:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165440:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb673b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165460:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165467:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165473:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165479:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c3c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.165487:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165495:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165503:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff97b176e45600) 00010000:00010000:2.0:1783952237.165506:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.165509:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165515:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6750 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165526:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165532:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165538:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165543:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbcc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.165546:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.165552:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.167855:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff97b143007d00) 00010000:00010000:2.0:1783952237.167871:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.167889:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.167899:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb676c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.167934:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.167941:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.167947:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.167952:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.168775:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168790:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168802:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:2.0:1783952237.168805:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.168808:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168815:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6781 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168831:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168849:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168855:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168871:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db70600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.168875:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168881:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168889:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff97b15f403000) 00010000:00010000:2.0:1783952237.168891:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.168894:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168900:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db70600/0x22c73c7857bb679d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168922:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168929:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168935:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.168940:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.168949:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169747:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169768:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff97b15f403300) 00010000:00010000:2.0:1783952237.169771:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.169775:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169782:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b04db71e00/0x22c73c7857bb67b2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169797:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169804:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169811:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169816:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.169820:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169826:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169834:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff97b143007f00) 00010000:00010000:2.0:1783952237.169837:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.169848:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169854:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb67ce lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169903:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169910:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169916:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169921:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644dc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.169924:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169929:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169938:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff97b143007200) 00010000:00010000:2.0:1783952237.169940:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.169943:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.169949:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb67e3 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170065:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170084:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170090:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170095:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.170098:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170104:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170113:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff97b158d55a00) 00010000:00010000:2.0:1783952237.170115:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.170119:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170124:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb67ff lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170142:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170148:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170154:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170158:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644da00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.170167:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170174:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170182:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff97b143007300) 00010000:00010000:2.0:1783952237.170185:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.170188:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170194:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6814 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170206:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170212:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170218:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170224:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.170227:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170233:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170241:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff97b143007100) 00010000:00010000:2.0:1783952237.170243:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.170253:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170258:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6830 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170273:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170279:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170285:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170302:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.170306:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170312:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170320:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff97b143007600) 00010000:00010000:2.0:1783952237.170322:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.170325:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170330:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6845 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170340:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170355:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170360:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170365:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644cc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.170367:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170372:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170381:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff97b143007b00) 00010000:00010000:2.0:1783952237.170383:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.170385:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170390:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6861 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170403:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170409:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170415:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170419:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c3600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.170426:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170432:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170439:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff97b176e45800) 00010000:00010000:2.0:1783952237.170441:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.170444:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170449:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6876 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170461:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170467:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170473:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170478:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.170481:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170486:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170493:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff97b176e45d00) 00010000:00010000:2.0:1783952237.170495:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.170503:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170509:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6892 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170526:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170532:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170538:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170542:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.170545:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.170551:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172041:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff97b158d55800) 00010000:00010000:2.0:1783952237.172045:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.172053:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172062:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb68a7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172085:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172109:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172116:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172122:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.172126:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172134:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172142:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff97b158d55500) 00010000:00010000:2.0:1783952237.172145:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.172148:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172155:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb68c3 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172176:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172182:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172188:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172193:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.172202:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172209:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172217:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff97b158d55e00) 00010000:00010000:2.0:1783952237.172220:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.172223:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172229:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb68d8 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172241:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172246:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172252:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172256:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c3400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.172259:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172265:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172272:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff97b176e45400) 00010000:00010000:2.0:1783952237.172275:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.172283:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172289:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb68f4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172307:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172314:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172320:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172325:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2dc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.172328:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172334:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172343:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff97b15f403100) 00010000:00010000:2.0:1783952237.172345:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.172349:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172354:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6909 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172366:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172382:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172388:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172394:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.172397:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172403:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172410:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff97b14396e300) 00010000:00010000:2.0:1783952237.172413:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.172415:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172421:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6925 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172434:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172440:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172445:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172450:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.172473:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172479:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172487:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff97b176e45b00) 00010000:00010000:2.0:1783952237.172490:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.172493:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172500:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb693a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172513:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172518:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172524:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172530:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.172533:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172539:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172547:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff97b176e45100) 00010000:00010000:2.0:1783952237.172549:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.172570:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.172578:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6956 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173751:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173767:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173774:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173780:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.173784:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173792:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173806:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff97b1584d4700) 00010000:00010000:2.0:1783952237.173809:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.173814:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173820:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb696b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173834:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173853:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173866:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173871:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2c200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.173874:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173880:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173888:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff97b15f403c00) 00010000:00010000:2.0:1783952237.173891:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.173893:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173899:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6987 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173918:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173924:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173930:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173935:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.173943:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.173948:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.174710:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:2.0:1783952237.174717:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.174724:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.174732:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb699c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783952237.602509:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968978 is committed 00000001:00080000:2.0:1783952237.602532:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968974 is committed 00000100:00100000:2.0:1783952237.779974:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952237.780058:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447814912 00000100:00100000:1.0:1783952237.780071:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447814912 00000100:00100000:1.0:1783952237.780160:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1520 00000100:00100000:1.0:1783952237.780174:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:73623:x1870605447814912:12345-192.168.202.48@tcp:36:mcreate.0 00010000:00010000:1.0:1783952237.780257:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952237.780295:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6590 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a584 expref: 31 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.780316:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:1.0:1783952237.780324:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952237.780412:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.780430:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.780442:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.780461:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.780487:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.780495:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.781075:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.781088:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.781095:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.781102:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.781109:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952237.781114:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.781122:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.781133:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:1.0:1783952237.781136:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952237.781140:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.781147:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb69aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952237.781171:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000adfd2158 reply state 00000000d5b60503 transno 124554051649 ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.781183:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.781191:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b15f403a00) 00010000:00010000:1.0:1783952237.781193:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952237.781196:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783952237.781321:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+32:73623:x1870605447814912:12345-192.168.202.48@tcp:36:mcreate.0 Request processed in 1147us (1371us total) trans 124554051649 rc 0/0 00000100:00100000:1.0:1783952237.781330:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1520 00000100:00100000:3.0:1783952237.832508:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952237.834394:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447815040 00000100:00100000:2.0:1783952237.834407:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447815040 00000100:00100000:3.0:1783952237.834828:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1521 00000100:00100000:3.0:1783952237.834846:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+32:73626:x1870605447815040:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:3.0:1783952237.834891:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952237.834919:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb69b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6b1 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.835076:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb69bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.835094:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb69bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.835110:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb69bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952237.835176:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783952237.835181:0:66236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783952237.835218:0:66236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb69bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.835247:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23800/0x22c73c7857bb69b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6b1 expref: 34 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.835265:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb69bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6b1 expref: 33 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.835274:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:3.0:1783952237.835278:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783952237.835282:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23600, rc 0) 00000100:00100000:3.0:1783952237.835376:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:73626:x1870605447815040:12345-192.168.202.48@tcp:101:rm.0 Request processed in 536us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952237.835384:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1521 00000100:00100000:1.0:1783952237.849943:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952237.850039:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447815168 00000100:00100000:2.0:1783952237.850055:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447815168 00000100:00100000:2.0:1783952237.850133:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1522 00000100:00100000:2.0:1783952237.850160:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:73626:x1870605447815168:12345-192.168.202.48@tcp:101:rm.0 00010000:00010000:2.0:1783952237.850184:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952237.850210:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb69c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6b8 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850404:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850420:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850525:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850541:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb69d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850550:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb69d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850558:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb69d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850694:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb69db lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850703:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb69db lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850711:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb69db lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952237.850761:0:68591:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1a:0x0]: returning size 0 00000004:00200000:2.0:1783952237.850766:0:68591:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783952237.850789:0:68591:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb69db lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850801:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb69db lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850811:0:68591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850832:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850838:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850846:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850862:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.850867:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850875:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850888:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:2.0:1783952237.850892:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.850896:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850903:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb69cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850920:0:68591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb69d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850926:0:68591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb69d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850932:0:68591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb69d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850947:0:68591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c3400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952237.850951:0:68591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb69d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850958:0:68591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb69d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850966:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b15f403a00) 00010000:00010000:2.0:1783952237.850969:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952237.850972:0:68591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb69d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.850978:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb69d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.851001:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb69c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6b8 expref: 35 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.851013:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb69db lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6b8 expref: 34 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952237.851020:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff97b174267100) 00010000:00010000:2.0:1783952237.851023:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952237.851025:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2200, rc 0) 00000100:00100000:2.0:1783952237.851104:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:73626:x1870605447815168:12345-192.168.202.48@tcp:101:rm.0 Request processed in 961us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952237.851111:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1522 00000100:00100000:3.0:1783952237.854147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952237.854240:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447815424 00000100:00100000:1.0:1783952237.854251:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447815424 00000100:00100000:1.0:1783952237.854309:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1523 00000100:00100000:1.0:1783952237.854317:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:73626:x1870605447815424:12345-192.168.202.48@tcp:36:rm.0 00010000:00010000:1.0:1783952237.854384:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783952237.854420:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb69db lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6b8 expref: 34 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854443:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff97b174267100) 00010000:00010000:1.0:1783952237.854458:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb69bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6b1 expref: 33 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854465:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:1.0:1783952237.854468:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952237.854503:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854516:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854523:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854533:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854537:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854541:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854674:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb69f0 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854680:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb69f0 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854685:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb69f0 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854898:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854907:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854914:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854930:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854944:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854951:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.854972:0:66238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783952237.854998:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb69f0 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855003:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb69f0 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855010:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb69f0 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855017:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2dc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952237.855022:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb69f0 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855031:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb69f0 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855041:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff97b15f403b00) 00010000:00010000:1.0:1783952237.855044:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783952237.855048:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb69f0 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855065:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb69f0 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855085:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855091:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855096:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855102:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855107:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952237.855110:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855116:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855123:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:1.0:1783952237.855125:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952237.855128:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855134:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb69e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783952237.855143:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c233f598 reply state 00000000568cb5af transno 124554051650 ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855161:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952237.855167:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b15f403a00) 00010000:00010000:1.0:1783952237.855169:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952237.855173:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783952237.855278:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:73626:x1870605447815424:12345-192.168.202.48@tcp:36:rm.0 Request processed in 960us (1145us total) trans 124554051650 rc 0/0 00000100:00100000:1.0:1783952237.855287:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1523 00010000:00010000:3.0:1783952237.855860:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783952237.855870:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.855878:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2de00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:3.0:1783952237.855882:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.855888:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.855901:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff97b15f403b00) 00010000:00010000:3.0:1783952237.855903:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783952237.855906:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.855919:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb69f7 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952237.855936:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952237.855938:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952237.855940:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952238.113279:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952238.688868:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465628544:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.688941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952238.688966:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465629056:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.688986:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952238.688997:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465629568:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.689014:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952238.689032:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783952238.689036:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465628672:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.689052:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952238.689062:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465629184:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.689079:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952238.689090:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465629696:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.689105:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952238.689256:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465629184 00000100:00100000:2.0:1783952238.689274:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465629184 00000100:00100000:2.0:1783952238.689327:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465629696 00000100:00100000:2.0:1783952238.689330:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465629696 00000100:00100000:2.0:1783952238.689366:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1783952238.689374:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465629184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.689420:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465629184:12345-0@lo:400:kworker.0 Request processed in 47us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952238.689427:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1783952238.689443:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:2.0:1783952238.689449:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465629696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.689473:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465629696:12345-0@lo:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952238.689479:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00080000:2.0:1783952238.689495:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952238.689700:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465628416:0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.689731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952238.689760:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465628928:0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.689778:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952238.689790:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465629440:0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.689805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952238.689818:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465629952:0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.689834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952238.689858:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783952238.689864:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17300ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465628800:0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.689942:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952238.689961:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465629312:0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.689982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952238.689995:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465629824:0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.690011:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952238.690031:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952238.690037:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465630080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952238.690057:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952238.690086:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465628544 00000100:00100000:3.0:1783952238.690089:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465628544 00000100:00100000:3.0:1783952238.690113:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465628672 00000100:00100000:3.0:1783952238.690115:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465628672 00000100:00100000:3.0:1783952238.690125:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465628928 00000100:00100000:3.0:1783952238.690127:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465628928 00000100:00100000:3.0:1783952238.690137:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465629440 00000100:00100000:3.0:1783952238.690139:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465629440 00000100:00100000:3.0:1783952238.690148:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465629952 00000100:00100000:3.0:1783952238.690149:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465629952 00000100:00100000:3.0:1783952238.690157:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465628800 00000100:00100000:3.0:1783952238.690159:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465628800 00000100:00100000:3.0:1783952238.690169:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:3.0:1783952238.690174:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465628544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.690203:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465628544:12345-0@lo:400:kworker.0 Request processed in 28us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952238.690209:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:3.0:1783952238.690220:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1783952238.690224:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465628672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.690244:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465628672:12345-0@lo:400:kworker.0 Request processed in 20us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952238.690249:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1783952238.690266:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1783952238.690272:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465628928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.690301:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465628928:12345-0@lo:400:kworker.0 Request processed in 29us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952238.690306:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1783952238.690318:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:3.0:1783952238.690324:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465629440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.690434:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465629440:12345-0@lo:400:kworker.0 Request processed in 110us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952238.690440:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:3.0:1783952238.690453:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:3.0:1783952238.690459:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465629952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.690484:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465629952:12345-0@lo:400:kworker.0 Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952238.690489:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:3.0:1783952238.690501:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:3.0:1783952238.690507:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465628800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.690532:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465628800:12345-0@lo:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952238.690537:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:3.0:1783952238.690556:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465629056 00000100:00100000:3.0:1783952238.690560:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465629056 00000100:00100000:3.0:1783952238.690582:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465629568 00000100:00100000:3.0:1783952238.690585:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465629568 00000100:00100000:3.0:1783952238.690625:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465630080 00000100:00100000:3.0:1783952238.690628:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465630080 00000100:00100000:3.0:1783952238.690638:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:3.0:1783952238.690643:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465629056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.690675:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465629056:12345-0@lo:400:kworker.0 Request processed in 32us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952238.690681:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00100000:3.0:1783952238.690694:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:3.0:1783952238.690699:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04796e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465629568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952238.690739:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04796e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1870605465629568:12345-0@lo:400:kworker.0 Request processed in 39us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952238.690744:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00100000:3.0:1783952238.690757:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:3.0:1783952238.690762:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465630080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952238.690787:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:3.0:1783952238.690819:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465630080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952238.690826:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00100000:3.0:1783952238.690862:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465629312 00000100:00100000:3.0:1783952238.690866:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465629312 00000100:00100000:2.0:1783952238.691013:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465628416 00000100:00100000:2.0:1783952238.691017:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465628416 00000100:00100000:2.0:1783952238.691046:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783952238.691052:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465628416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.691085:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465628416:12345-0@lo:400:kworker.0 Request processed in 33us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952238.691091:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1783952238.691133:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783952238.691137:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783952238.691140:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952238.691200:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465629824 00000100:00100000:3.0:1783952238.691205:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465629824 00000100:00100000:1.0:1783952238.691403:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465628672:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.691416:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465629184:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.691437:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968974 gen 2 00000100:00100000:1.0:1783952238.691455:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465629696:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.691468:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465628544:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.691478:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465629056:0@lo:400:kworker.0 00000100:00100000:1.0:1783952238.691487:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465629568:0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.696404:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:2.0:1783952238.696425:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465629312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.696524:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465629312:12345-0@lo:400:kworker.0 Request processed in 107us (6540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952238.696538:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:2.0:1783952238.696572:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:2.0:1783952238.696580:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465629824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.696641:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465629824:12345-0@lo:400:kworker.0 Request processed in 61us (6628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952238.696647:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000100:00080000:2.0:1783952238.696686:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783952238.696753:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465630080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783952238.696796:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17300ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465628800:0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.696806:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465629312:0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.696814:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465629824:0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.696823:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465628416:0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.696833:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465628928:0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.696854:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465629440:0@lo:400:kworker.0 00000100:00100000:2.0:1783952238.696865:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465629952:0@lo:400:kworker.0 00000100:00100000:0.0:1783952239.093331:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952239.093373:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952239.093398:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952239.093430:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952239.093470:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952239.093505:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447815552 00000100:00100000:0.0:1783952239.093513:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447815552 00000100:00100000:0.0:1783952239.093551:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 179 00000100:00100000:0.0:1783952239.093558:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17490a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447815552:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952239.093644:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17490a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447815552:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952239.093649:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 179 00000100:00100000:0.0:1783952239.093676:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447816064 00000100:00100000:0.0:1783952239.093678:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447816064 00000100:00100000:0.0:1783952239.093701:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447815936 00000100:00100000:0.0:1783952239.093703:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447815936 00000100:00100000:0.0:1783952239.093715:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2914 00000100:00100000:0.0:1783952239.093719:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447816064:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952239.093735:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447816064:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 17us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952239.093739:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2914 00000100:00100000:0.0:1783952239.093746:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2915 00000100:00100000:0.0:1783952239.093749:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447815936:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000080:0.0:1783952239.093758:0:26208:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b146f01500 x1870605447815936/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:500/0 lens 224/224 e 0 to 0 dl 1783952250 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952239.093770:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2399:x1870605447815936:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 21us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952239.093774:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2915 00000100:00080000:0.0:1783952239.094348:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783952239.094359:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952239.094745:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447815680 00000100:00100000:3.0:1783952239.094751:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447815680 00000100:00100000:3.0:1783952239.094888:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447815808 00000100:00100000:3.0:1783952239.094892:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447815808 00000100:00080000:0.0:1783952239.094922:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952239.094933:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783952239.094973:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1466 00000100:00100000:1.0:1783952239.094985:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:2399:x1870605447815680:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952239.095083:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:2399:x1870605447815680:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 102us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952239.095090:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1466 00000100:00100000:3.0:1783952239.097247:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1467 00000100:00100000:3.0:1783952239.097263:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2398:x1870605447815808:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952239.097333:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2398:x1870605447815808:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 75us (3933us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952239.097357:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1467 00010000:00010000:1.0:1783952239.136881:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952239.200925:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465630208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952239.201002:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952239.201042:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465630336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952239.201068:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952239.201108:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465630208 00000100:00100000:3.0:1783952239.201112:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465630336 00000100:00100000:3.0:1783952239.201116:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465630336 00000100:00100000:0.0:1783952239.201116:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465630208 00000100:00100000:0.0:1783952239.201164:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275 00000100:00100000:0.0:1783952239.201173:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465630208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783952239.201202:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00010000:00000080:0.0:1783952239.201216:0:8437:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd79f80 x1870605465630208/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:500/0 lens 224/368 e 0 to 0 dl 1783952250 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952239.201260:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465630208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952239.201267:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275 00000100:00100000:0.0:1783952239.201289:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276 00000100:00100000:0.0:1783952239.201295:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465630336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783952239.201310:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952239.201335:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465630336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952239.201340:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276 00000100:00100000:2.0:1783952239.201656:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783952239.201665:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465630464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952239.201693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952239.203659:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465630464 00000100:00100000:3.0:1783952239.203671:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465630464 00000100:00100000:3.0:1783952239.203719:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:3.0:1783952239.203727:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465630464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783952239.203760:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:3.0:1783952239.203834:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465630464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952239.203850:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00100000:3.0:1783952239.203909:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465630208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783952239.204154:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465630464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952239.204430:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465630336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783952240.161396:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952240.226645:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465630592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952240.226714:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952240.226800:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465630592 00000100:00100000:2.0:1783952240.226808:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465630592 00000100:00100000:2.0:1783952240.226884:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277 00000100:00100000:2.0:1783952240.226892:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465630592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783952240.226915:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952240.226952:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465630592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952240.226959:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277 00000100:00080000:3.0:1783952240.227002:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952240.227038:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465630592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783952240.232353:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783952240.232390:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465630720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952240.232462:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952240.232608:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465630720 00000100:00100000:3.0:1783952240.232617:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465630720 00000100:00100000:3.0:1783952240.232673:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278 00000100:00100000:3.0:1783952240.232683:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465630720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783952240.232705:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00010000:00000080:3.0:1783952240.232720:0:11087:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04ef1c380 x1870605465630720/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:501/0 lens 224/368 e 0 to 0 dl 1783952251 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952240.232766:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465630720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952240.232774:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278 00000100:00080000:3.0:1783952240.232817:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783952240.232860:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465630720:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783952241.184758:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952242.213238:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952243.233414:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952243.809239:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465630976:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.809312:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952243.809348:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465631488:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.809374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952243.809394:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465632000:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.809413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952243.809433:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783952243.809438:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465631104:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.809459:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952243.809474:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465631616:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.809507:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952243.809534:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465632128:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.809567:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952243.809629:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465631488 00000100:00100000:1.0:1783952243.809637:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465631488 00000100:00100000:1.0:1783952243.809679:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465632000 00000100:00100000:1.0:1783952243.809683:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465632000 00000100:00100000:1.0:1783952243.809705:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:1.0:1783952243.809713:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465631488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.809767:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465631488:12345-0@lo:400:kworker.0 Request processed in 55us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952243.809774:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:1.0:1783952243.809792:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:1.0:1783952243.809808:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465632000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.809837:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465632000:12345-0@lo:400:kworker.0 Request processed in 40us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952243.809843:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:1.0:1783952243.809866:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465630976 00000100:00100000:1.0:1783952243.809869:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465630976 00000100:00100000:0.0:1783952243.810224:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465631232:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.810257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952243.810318:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465630848:0@lo:400:kworker.0 00000100:00100000:3.0:1783952243.810353:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952243.810384:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465631360:0@lo:400:kworker.0 00000100:00100000:3.0:1783952243.810425:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465630848 00000100:00100000:3.0:1783952243.810430:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465630848 00000100:00100000:3.0:1783952243.810461:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783952243.810468:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465630848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952243.810502:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465630848:12345-0@lo:400:kworker.0 Request processed in 35us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952243.810508:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783952243.811078:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b048fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465631744:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.811108:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952243.811127:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465632256:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.811150:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952243.811184:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465631616 00000100:00100000:0.0:1783952243.811188:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465631616 00000100:00100000:0.0:1783952243.811233:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465632128 00000100:00100000:0.0:1783952243.811237:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465632128 00000100:00100000:0.0:1783952243.811256:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465631744 00000100:00100000:0.0:1783952243.811259:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465631744 00000100:00100000:0.0:1783952243.811276:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465632256 00000100:00100000:0.0:1783952243.811279:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465632256 00000100:00100000:0.0:1783952243.811298:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:0.0:1783952243.811305:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465631616:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952243.811322:0:26199:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b17300ce00 x1870605465631616/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:504/0 lens 224/224 e 0 to 0 dl 1783952254 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952243.811354:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465631616:12345-0@lo:400:kworker.0 Request processed in 49us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952243.811361:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:0.0:1783952243.811373:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:0.0:1783952243.811379:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465632128:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783952243.811390:0:26199:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b17300d180 x1870605465632128/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:504/0 lens 224/224 e 0 to 0 dl 1783952254 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952243.811417:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465632128:12345-0@lo:400:kworker.0 Request processed in 38us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952243.811424:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:0.0:1783952243.811435:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:0.0:1783952243.811442:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465631744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.811471:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465631744:12345-0@lo:400:kworker.0 Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952243.811477:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00100000:0.0:1783952243.811487:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:0.0:1783952243.811500:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465632256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.811537:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465632256:12345-0@lo:400:kworker.0 Request processed in 44us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952243.811543:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:0.0:1783952243.811628:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952243.811868:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465631104 00000100:00100000:1.0:1783952243.811873:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465631104 00000100:00100000:1.0:1783952243.811912:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465631232 00000100:00100000:1.0:1783952243.811916:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465631232 00000100:00100000:1.0:1783952243.811940:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:1.0:1783952243.811947:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465630976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.811994:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465630976:12345-0@lo:400:kworker.0 Request processed in 47us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952243.812000:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:1.0:1783952243.812013:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:1.0:1783952243.812027:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465631104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.812056:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465631104:12345-0@lo:400:kworker.0 Request processed in 30us (2596us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952243.812061:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:1.0:1783952243.812072:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:1.0:1783952243.812077:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465631232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.812105:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465631232:12345-0@lo:400:kworker.0 Request processed in 28us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952243.812109:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00080000:1.0:1783952243.812142:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952243.812147:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952243.812149:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783952243.812151:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783952243.812212:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465631104:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.812224:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465631616:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.812234:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465632128:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.812244:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465630976:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.812257:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465631488:0@lo:400:kworker.0 00000100:00100000:1.0:1783952243.812268:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465632000:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.812428:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465631872:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.812457:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952243.812473:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465632384:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.812494:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952243.812526:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465630848:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.812771:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465631232:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.812783:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b048fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465631744:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.812793:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465632256:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.812874:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465631360 00000100:00100000:0.0:1783952243.812878:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465631360 00000100:00100000:0.0:1783952243.812905:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1783952243.812912:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465631360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.812952:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465631360:12345-0@lo:400:kworker.0 Request processed in 41us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952243.812959:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1783952243.812970:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465631872 00000100:00100000:0.0:1783952243.812973:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465631872 00000100:00100000:0.0:1783952243.812986:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465632384 00000100:00100000:0.0:1783952243.812989:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465632384 00000100:00100000:0.0:1783952243.812999:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:0.0:1783952243.813004:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465631872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.813042:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ab00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465631872:12345-0@lo:400:kworker.0 Request processed in 37us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952243.813048:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:0.0:1783952243.813059:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1783952243.813064:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465632384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.813088:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465632384:12345-0@lo:400:kworker.0 Request processed in 24us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952243.813094:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1783952243.813155:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b147740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465631360:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.813165:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465631872:0@lo:400:kworker.0 00000100:00100000:0.0:1783952243.813174:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b17483aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465632384:0@lo:400:kworker.0 00000100:00080000:1.0:1783952243.814620:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952243.814632:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952243.814649:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465632512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783952243.814702:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952243.815046:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465632512 00000100:00100000:0.0:1783952243.815053:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465632512 00000100:00100000:0.0:1783952243.816075:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:0.0:1783952243.816089:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17300ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465632512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783952243.816128:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:0.0:1783952243.816200:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17300ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465632512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952243.816206:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000001:00080000:1.0:1783952243.819911:0:94405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051650 is committed 00010000:00010000:1.0:1783952243.819952:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.819964:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.819971:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.819977:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952243.819982:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.819990:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.820007:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b15f403a00) 00010000:00010000:1.0:1783952243.820010:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952243.820016:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.820022:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb69b1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.820041:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.820048:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.820053:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.820068:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2c200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952243.820072:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.820078:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.820086:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8711572 (ffff97b15f403a00) 00010000:00010000:1.0:1783952243.820089:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952243.820092:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952243.820097:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb69e9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8711572 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952243.820230:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465632512:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1783952243.886109:0:95944:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:0.0:1783952244.170961:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.171071:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447816192 00000100:00100000:2.0:1783952244.171083:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447816192 00000100:00080000:1.0:1783952244.171216:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952244.171864:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1524 00000100:00100000:2.0:1783952244.171878:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+30:73704:x1870605447816192:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.171911:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.171935:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb69fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6bf expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.171996:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6a05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.172009:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.172023:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952244.172074:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783952244.172079:0:83761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783952244.172111:0:83761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.172160:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb69fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6bf expref: 32 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.172180:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2e00/0x22c73c7857bb6a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6bf expref: 31 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.172189:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97b14396ed00) 00010000:00010000:2.0:1783952244.172192:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783952244.172195:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2e00, rc 0) 00000100:00100000:2.0:1783952244.172257:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:73704:x1870605447816192:12345-192.168.202.48@tcp:101:dd.0 Request processed in 383us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.172265:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1524 00000100:00100000:0.0:1783952244.184674:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.184759:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447816448 00000100:00100000:1.0:1783952244.184769:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447816448 00000100:00100000:1.0:1783952244.184901:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1525 00000100:00100000:1.0:1783952244.184914:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:73704:x1870605447816448:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.184937:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.184960:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb6a0c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6c6 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185100:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185114:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185144:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185179:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6a1a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185187:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6a1a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185194:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6a1a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185256:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb6a21 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185264:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb6a21 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185271:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb6a21 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952244.185281:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x6:0x0]: returning size 0 00010000:00010000:1.0:1783952244.185371:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185379:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185386:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185392:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185406:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952244.185410:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185417:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185430:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:1.0:1783952244.185433:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952244.185437:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185444:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6a13 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185458:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6a1a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185464:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6a1a lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185469:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6a1a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185473:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2de00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952244.185476:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6a1a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185482:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6a1a lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185501:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff97b15f403a00) 00010000:00010000:1.0:1783952244.185504:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952244.185507:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6a1a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185513:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2de00/0x22c73c7857bb6a1a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185557:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb6a0c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6c6 expref: 34 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185571:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb6a21 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6c6 expref: 33 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.185578:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff97b158d55300) 00010000:00010000:1.0:1783952244.185580:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783952244.185583:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d200, rc 0) 00000100:00100000:1.0:1783952244.185697:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:73704:x1870605447816448:12345-192.168.202.48@tcp:101:dd.0 Request processed in 787us (1034us total) trans 124554051651 rc 0/0 00000100:00100000:1.0:1783952244.185705:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1525 00000100:00100000:0.0:1783952244.196118:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.196172:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.196404:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447816576 00000100:00100000:2.0:1783952244.196413:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447816576 00000100:00100000:2.0:1783952244.196475:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447816832 00000100:00100000:2.0:1783952244.196479:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447816832 00000100:00100000:2.0:1783952244.196509:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1526 00000100:00100000:2.0:1783952244.196519:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:73704:x1870605447816576:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.196545:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.196566:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb6a2f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6cd expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.196642:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6a36 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.196659:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6a36 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.196689:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6a36 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.196830:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2a00/0x22c73c7857bb6a2f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6cd expref: 36 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.196849:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2200/0x22c73c7857bb6a36 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6cd expref: 35 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.196858:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff97b158d55300) 00010000:00010000:2.0:1783952244.196861:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783952244.196864:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2200, rc 0) 00000100:00100000:2.0:1783952244.196997:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17483aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+35:73704:x1870605447816576:12345-192.168.202.48@tcp:101:dd.0 Request processed in 478us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.197005:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1526 00000100:00100000:2.0:1783952244.197025:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1527 00000100:00100000:2.0:1783952244.197033:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:73705:x1870605447816832:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.197042:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.197050:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a3d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6d4 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197144:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197321:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197340:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197355:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a4b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197361:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a4b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197366:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a4b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197419:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6a52 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197428:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6a52 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197435:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6a52 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952244.197444:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783952244.197522:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197530:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197537:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197543:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197555:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.197559:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197566:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197576:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952244.197579:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.197582:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197625:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a44 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197636:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a4b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197641:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a4b lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197646:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a4b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197650:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c3400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.197652:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a4b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197656:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a4b lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197672:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff97b174267800) 00010000:00010000:2.0:1783952244.197675:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.197677:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a4b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197683:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a4b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197720:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a3d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6d4 expref: 37 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197731:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6a52 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6d4 expref: 36 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.197738:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff97b158d55700) 00010000:00010000:2.0:1783952244.197740:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952244.197742:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2c00, rc 0) 00000100:00100000:2.0:1783952244.197780:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+36:73705:x1870605447816832:12345-192.168.202.48@tcp:101:dd.0 Request processed in 748us (1607us total) trans 124554051652 rc 0/0 00000100:00100000:2.0:1783952244.197786:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1527 00000100:00100000:0.0:1783952244.210724:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.210807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.210922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.222899:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447817088 00000100:00100000:2.0:1783952244.222915:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447817088 00000100:00100000:2.0:1783952244.223022:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447817216 00000100:00100000:2.0:1783952244.223025:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447817216 00000100:00100000:2.0:1783952244.223037:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447817472 00000100:00100000:2.0:1783952244.223040:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447817472 00000100:00100000:2.0:1783952244.223062:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1528 00000100:00100000:2.0:1783952244.223070:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+38:73704:x1870605447817088:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:2.0:1783952244.223134:0:67035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952244.223161:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb6a21 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6c6 expref: 38 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.223179:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff97b158d55300) 00010000:00010000:2.0:1783952244.223184:0:67035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952244.223341:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.223354:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.223365:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783952244.223401:0:67035:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051653 00000004:00010000:2.0:1783952244.223419:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6fe2f6b reply state 000000003f1d30e1 transno 124554051654 ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.223431:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.223437:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff97b158d55300) 00010000:00010000:2.0:1783952244.223440:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952244.223442:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952244.223535:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+40:73704:x1870605447817088:12345-192.168.202.48@tcp:36:dd.0 Request processed in 465us (12825us total) trans 124554051654 rc 0/0 00000100:00100000:2.0:1783952244.223542:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1528 00000020:00080000:2.0:1783952244.223547:0:67035:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783952244.223567:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1529 00000100:00100000:2.0:1783952244.223581:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+39:73705:x1870605447817216:12345-192.168.202.48@tcp:101:dd.0 00000100:00100000:0.0:1783952244.223639:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1530 00010000:00010000:2.0:1783952244.223648:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.223661:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a67 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6db expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952244.223670:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+39:73709:x1870605447817472:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.223695:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a6e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.223699:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.223711:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a6e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.223722:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a6e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.223728:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6a75 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6e2 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.223813:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3400/0x22c73c7857bb6a67 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6db expref: 42 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.223830:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2600/0x22c73c7857bb6a6e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6db expref: 41 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.223838:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff97b158d55700) 00010000:00010000:2.0:1783952244.223840:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783952244.223843:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2600, rc 0) 00000100:00100000:2.0:1783952244.223873:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+41:73705:x1870605447817216:12345-192.168.202.48@tcp:101:dd.0 Request processed in 293us (13082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.223880:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1529 00010000:00010000:0.0:1783952244.224042:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.224059:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.224070:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.224088:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6a83 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.224095:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6a83 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.225052:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6a83 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.225161:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6a8a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.225173:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6a8a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.225218:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6a8a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952244.225232:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783952244.226865:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.226885:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.226893:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.226901:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.226908:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952244.226914:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.226924:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.226947:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952244.226950:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952244.226957:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.226964:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6a7c lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.226984:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6a83 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.227005:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6a83 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.227012:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6a83 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.227016:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644cc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952244.227019:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6a83 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.227025:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6a83 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.227033:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff97b1512a2400) 00010000:00010000:0.0:1783952244.227036:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952244.227039:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6a83 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.227045:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6a83 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.227130:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6a75 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6e2 expref: 42 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.227147:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6a8a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6e2 expref: 41 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.227155:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff97b158d55200) 00010000:00010000:0.0:1783952244.227158:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952244.227168:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644ce00, rc 0) 00000100:00100000:0.0:1783952244.227249:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+41:73709:x1870605447817472:12345-192.168.202.48@tcp:101:dd.0 Request processed in 3595us (16325us total) trans 124554051655 rc 0/0 00000100:00100000:0.0:1783952244.227259:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1530 00000100:00100000:0.0:1783952244.244425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.244479:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.244687:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.244719:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447817600 00000100:00100000:0.0:1783952244.244732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.244738:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447817600 00000100:00100000:2.0:1783952244.244818:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 181 00000100:00100000:2.0:1783952244.244850:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447817600:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952244.244992:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447817600:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 146us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.245000:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 181 00000100:00100000:3.0:1783952244.245520:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447817728 00000100:00100000:3.0:1783952244.245531:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447817728 00000100:00100000:3.0:1783952244.245625:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1474 00000100:00100000:3.0:1783952244.245636:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2401:x1870605447817728:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952244.245713:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2401:x1870605447817728:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 79us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.245720:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1474 00000100:00080000:3.0:1783952244.245781:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783952244.246973:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.247082:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447817856 00000100:00100000:1.0:1783952244.247091:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447817856 00000100:00100000:1.0:1783952244.247213:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447817984 00000100:00100000:1.0:1783952244.247218:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447817984 00000100:00080000:3.0:1783952244.247501:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783952244.247507:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783952244.247745:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2920 00000100:00100000:1.0:1783952244.247756:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447817856:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000080:1.0:1783952244.247801:0:8494:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14de1f480 x1870605447817856/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 224/224 e 0 to 0 dl 1783952255 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952244.248064:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2401:x1870605447817856:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 309us (3583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.248073:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2920 00000100:00100000:1.0:1783952244.248093:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2921 00000100:00100000:1.0:1783952244.248101:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2401:x1870605447817984:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952244.248133:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2401:x1870605447817984:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 33us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.248140:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2921 00000100:00100000:0.0:1783952244.254956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.254993:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.255117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.255160:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447818368 00000100:00100000:0.0:1783952244.255172:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447818368 00000100:00100000:0.0:1783952244.255779:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447818752 00000100:00100000:0.0:1783952244.255786:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447818752 00000100:00100000:1.0:1783952244.256060:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447818624 00000100:00100000:1.0:1783952244.256066:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447818624 00000100:00100000:1.0:1783952244.256105:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1531 00000100:00100000:1.0:1783952244.256118:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+43:73705:x1870605447818368:12345-192.168.202.48@tcp:36:dd.0 00000100:00100000:2.0:1783952244.256610:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447818112 00000100:00100000:2.0:1783952244.256617:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447818112 00000100:00100000:2.0:1783952244.256658:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4989 00000100:00100000:2.0:1783952244.256667:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:73704:x1870605447818112:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.256680:0:26202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.256711:0:26202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5527b89/0x22c73c7857bb6a98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6e9 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952244.256746:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x782:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:2.0:1783952244.256770:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x782:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:2.0:1783952244.256776:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x782:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952244.256787:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5527b89/0x22c73c7857bb6a98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6e9 expref: 6 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.256821:0:26202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5527b89/0x22c73c7857bb6a98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6e9 expref: 6 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.256837:0:26202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2a00, rc 0) 00010000:00000080:2.0:1783952244.256847:0:26202:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14de1dc00 x1870605447818112/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.257225:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:73704:x1870605447818112:12345-192.168.202.48@tcp:101:dd.0 Request processed in 556us (10256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.257469:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4989 00000100:00100000:2.0:1783952244.257723:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1532 00000100:00100000:2.0:1783952244.257735:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+43:73706:x1870605447818752:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.257757:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.257776:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6a9f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6f0 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258106:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258122:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258136:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258153:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6aad lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258160:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6aad lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258166:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6aad lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258489:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6ab4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258499:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6ab4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258522:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6ab4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952244.258535:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x8:0x0]: returning size 0 00010000:00010000:2.0:1783952244.258673:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258681:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258688:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258695:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258701:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.258706:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258714:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258727:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952244.258731:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.258736:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258743:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2400/0x22c73c7857bb6aa6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258761:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6aad lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258774:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6aad lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258780:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6aad lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258786:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c3200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.258789:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6aad lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258807:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6aad lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258815:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff97b174267b00) 00010000:00010000:2.0:1783952244.258818:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.258821:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6aad lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.258827:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6aad lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.258946:0:66236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952244.258972:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6a52 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6d4 expref: 45 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.258985:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff97b158d55700) 00010000:00010000:1.0:1783952244.258989:0:66236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952244.259136:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.259147:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.259156:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783952244.259503:0:66236:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051657 00000004:00010000:1.0:1783952244.259533:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003830c0a3 reply state 0000000001f512ea transno 124554051658 ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.259547:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.259554:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff97b158d55700) 00010000:00010000:1.0:1783952244.259556:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952244.259560:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783952244.259711:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+47:73705:x1870605447818368:12345-192.168.202.48@tcp:36:dd.0 Request processed in 3594us (4778us total) trans 124554051658 rc 0/0 00000100:00100000:1.0:1783952244.259721:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1531 00000020:00080000:1.0:1783952244.259727:0:66236:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783952244.260083:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1533 00000100:00100000:1.0:1783952244.260096:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+46:73709:x1870605447818624:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.260118:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.260132:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb6ac9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6f7 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.260162:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb6ad0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.260173:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb6ad0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.260181:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb6ad0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.260563:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb6ac9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6f7 expref: 48 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.260584:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d000/0x22c73c7857bb6ad0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6f7 expref: 47 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.260620:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff97b158d55200) 00010000:00010000:1.0:1783952244.260623:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783952244.260627:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2d000, rc 0) 00000100:00100000:1.0:1783952244.260684:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+47:73709:x1870605447818624:12345-192.168.202.48@tcp:101:dd.0 Request processed in 592us (5566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.260692:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1533 00010000:00010000:2.0:1783952244.261492:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6a9f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6f0 expref: 47 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.261518:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6ab4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6f0 expref: 46 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.261526:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff97b176e45f00) 00010000:00010000:2.0:1783952244.261529:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952244.261543:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a600, rc 0) 00010000:00010000:3.0:1783952244.262526:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952244.263540:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.263665:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447818880 00000100:00100000:3.0:1783952244.263678:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447818880 00002000:00010000:3.0:1783952244.263728:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1922 (0->18446744073709551615) 00002000:00100000:3.0:1783952244.263733:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b04ef1e300 with x1870605447818880 ext(0->18446744073709551615) 00002000:00010000:3.0:1783952244.263747:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b04ef1e300. 00000100:00100000:3.0:1783952244.263785:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1008 00000100:00100000:3.0:1783952244.263807:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2399:x1870605447818880:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:3.0:1783952244.264158:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783952244.264163:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:3.0:1783952244.264166:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:3.0:1783952244.264169:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:3.0:1783952244.264171:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x782:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783952244.264182:0:8441:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04ef1e300 x1870605447818880/t4294968979(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.264461:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447818880:12345-192.168.202.48@tcp:10:dd.0 Request processed in 666us (930us total) trans 4294968979 rc 0/0 00000100:00100000:3.0:1783952244.264470:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1008 00002000:00010000:3.0:1783952244.264475:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1922 (0->18446744073709551615) 00002000:00100000:3.0:1783952244.264478:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b04ef1e300 with x1870605447818880 ext(0->18446744073709551615) 00002000:00010000:3.0:1783952244.264484:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b04ef1e300. 00000100:00100000:0.0:1783952244.264840:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+46:73706:x1870605447818752:12345-192.168.202.48@tcp:101:dd.0 Request processed in 7104us (9841us total) trans 124554051656 rc 0/0 00000100:00100000:0.0:1783952244.264851:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1532 00000100:00100000:1.0:1783952244.268169:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.268325:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.268409:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447819264 00000100:00100000:2.0:1783952244.268424:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447819264 00000100:00100000:2.0:1783952244.268495:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1534 00000100:00100000:2.0:1783952244.268507:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+46:73709:x1870605447819264:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:2.0:1783952244.268619:0:66236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952244.268657:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6a8a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6e2 expref: 46 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.268680:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff97b158d55200) 00010000:00010000:2.0:1783952244.268687:0:66236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952244.268974:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.268992:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.269006:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783952244.269059:0:66236:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051659 00000004:00010000:2.0:1783952244.269082:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d210b7a reply state 000000000e5b784b transno 124554051660 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.269096:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.269103:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff97b158d55200) 00010000:00010000:2.0:1783952244.269106:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952244.269127:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952244.269487:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447819008 00000100:00100000:3.0:1783952244.269494:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447819008 00000100:00100000:3.0:1783952244.269542:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4990 00000100:00100000:3.0:1783952244.269550:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:73705:x1870605447819008:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.269565:0:26204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.269611:0:26204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c305c023/0x22c73c7857bb6ade lrc: 2/0,0 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a6fe expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952244.269636:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x783:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:3.0:1783952244.269657:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x783:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:3.0:1783952244.269662:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x783:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783952244.269670:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c305c023/0x22c73c7857bb6ade lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6fe expref: 8 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.269686:0:26204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c305c023/0x22c73c7857bb6ade lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6fe expref: 8 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.269698:0:26204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22e00, rc 0) 00010000:00000080:3.0:1783952244.269706:0:26204:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14de8f800 x1870605447819008/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.270811:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+48:73709:x1870605447819264:12345-192.168.202.48@tcp:36:dd.0 Request processed in 2286us (2465us total) trans 124554051660 rc 0/0 00000100:00100000:2.0:1783952244.270823:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1534 00000020:00080000:2.0:1783952244.270832:0:66236:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783952244.271033:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:73705:x1870605447819008:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1481us (2878us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.271041:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4990 00000100:00100000:1.0:1783952244.277871:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.278130:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447819392 00000100:00100000:0.0:1783952244.278148:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447819392 00000100:00100000:0.0:1783952244.278474:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1535 00000100:00100000:0.0:1783952244.278489:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+48:73706:x1870605447819392:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.278525:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.278559:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6ae5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a705 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.279091:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6aec lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.279131:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6aec lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.279146:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6aec lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.279846:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644cc00/0x22c73c7857bb6ae5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a705 expref: 50 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.279871:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c200/0x22c73c7857bb6aec lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a705 expref: 49 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.279881:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff97b176e45f00) 00010000:00010000:0.0:1783952244.279885:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783952244.279889:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644c200, rc 0) 00000100:00100000:0.0:1783952244.280128:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+49:73706:x1870605447819392:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1641us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.280137:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1535 00000100:00100000:1.0:1783952244.280551:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.281066:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447819648 00000100:00100000:3.0:1783952244.281078:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447819648 00000100:00100000:3.0:1783952244.281463:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 266 00000100:00100000:3.0:1783952244.281478:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+49:73704:x1870605447819648:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:3.0:1783952244.282510:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+50:73704:x1870605447819648:12345-192.168.202.48@tcp:35:dd.0 Request processed in 1030us (1953us total) trans 124554051661 rc 0/0 00000100:00100000:3.0:1783952244.282521:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 266 00000100:00100000:1.0:1783952244.284181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.284531:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.284678:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.284872:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447820032 00000100:00100000:0.0:1783952244.284886:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447820032 00000100:00100000:0.0:1783952244.288026:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4991 00000100:00100000:0.0:1783952244.288059:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:73709:x1870605447820032:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.288086:0:26205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.288118:0:26205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb6af3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a713 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952244.288154:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x787:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:0.0:1783952244.288205:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x787:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:0.0:1783952244.288211:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x787:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952244.288222:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb6af3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a713 expref: 9 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.288546:0:26205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb6af3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a713 expref: 9 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.288564:0:26205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644cc00, rc 0) 00010000:00000080:0.0:1783952244.288574:0:26205:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147741180 x1870605447820032/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.288696:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:73709:x1870605447820032:12345-192.168.202.48@tcp:101:dd.0 Request processed in 653us (4164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.288705:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4991 00000100:00100000:3.0:1783952244.290113:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447819904 00000100:00100000:3.0:1783952244.290145:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447819904 00000100:00100000:3.0:1783952244.290990:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.291573:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447820288 00000100:00100000:3.0:1783952244.291651:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.291727:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447820416 00000100:00100000:0.0:1783952244.291737:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447820416 00002000:00010000:0.0:1783952244.291783:0:25538:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1923 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.291788:0:25538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16dd7aa00 with x1870605447820416 ext(0->18446744073709551615) 00000100:00100000:1.0:1783952244.291804:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447820544 00002000:00010000:0.0:1783952244.291812:0:25538:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16dd7aa00. 00000100:00100000:1.0:1783952244.291816:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447820544 00000100:00100000:0.0:1783952244.291856:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1009 00000100:00100000:0.0:1783952244.291873:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2401:x1870605447820416:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:1.0:1783952244.291929:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1927 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.291998:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16dd78a80 with x1870605447820544 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.292011:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16dd78a80. 00002000:00010000:0.0:1783952244.292049:0:25538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783952244.292054:0:25538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.292058:0:25538:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:0.0:1783952244.292061:0:25538:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.292082:0:25538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783952244.292093:0:25538:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd7aa00 x1870605447820416/t4294968980(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.292096:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1010 00000100:00100000:1.0:1783952244.292115:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2400:x1870605447820544:12345-192.168.202.48@tcp:10:dd.0 00000100:00100000:0.0:1783952244.292180:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2401:x1870605447820416:12345-192.168.202.48@tcp:10:dd.0 Request processed in 312us (1199us total) trans 4294968980 rc 0/0 00000100:00100000:0.0:1783952244.292188:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1009 00002000:00010000:0.0:1783952244.292192:0:25538:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1923 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.292195:0:25538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16dd7aa00 with x1870605447820416 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.292200:0:25538:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16dd7aa00. 00000100:00100000:2.0:1783952244.292290:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447820288 00000100:00100000:2.0:1783952244.292332:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1536 00000100:00100000:2.0:1783952244.292339:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:73706:x1870605447820288:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:2.0:1783952244.292386:0:67035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952244.292411:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6ab4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6f0 expref: 51 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.292428:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff97b176e45f00) 00010000:00010000:2.0:1783952244.292433:0:67035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952244.292551:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.292563:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.292573:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783952244.292647:0:67035:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051662 00000004:00010000:2.0:1783952244.292673:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045302d42 reply state 000000001f3ff11b transno 124554051663 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.292687:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.292707:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff97b176e45f00) 00010000:00010000:2.0:1783952244.292709:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952244.292712:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00002000:00010000:1.0:1783952244.292733:0:24869:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783952244.292739:0:24869:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.292743:0:24869:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:1.0:1783952244.292746:0:24869:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.292748:0:24869:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783952244.292760:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd78a80 x1870605447820544/t4294968981(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.292775:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+53:73706:x1870605447820288:12345-192.168.202.48@tcp:36:dd.0 Request processed in 433us (8094us total) trans 124554051663 rc 0/0 00000100:00100000:2.0:1783952244.292783:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1536 00000020:00080000:2.0:1783952244.292787:0:67035:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783952244.292831:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2400:x1870605447820544:12345-192.168.202.48@tcp:10:dd.0 Request processed in 716us (1179us total) trans 4294968981 rc 0/0 00000100:00100000:1.0:1783952244.292841:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1010 00002000:00010000:1.0:1783952244.292846:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1927 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.292849:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16dd78a80 with x1870605447820544 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.292855:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16dd78a80. 00000100:00100000:2.0:1783952244.293611:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1537 00000100:00100000:2.0:1783952244.293622:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+52:73707:x1870605447819904:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.293636:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.293648:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb6b01 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a70c expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.296766:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.296788:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.296833:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.296852:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6b0f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.296859:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6b0f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.296866:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6b0f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952244.297378:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.298004:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447820672 00000100:00100000:0.0:1783952244.298015:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447820672 00000100:00100000:0.0:1783952244.298089:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4992 00000100:00100000:0.0:1783952244.298098:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:73706:x1870605447820672:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.298114:0:26207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.298131:0:26207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6b16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a71a expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952244.298161:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x784:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:0.0:1783952244.298179:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x784:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:0.0:1783952244.298184:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x784:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952244.298190:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6b16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a71a expref: 12 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.298205:0:26207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6b16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a71a expref: 12 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.298233:0:26207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644d400, rc 0) 00010000:00010000:2.0:1783952244.299059:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6b1d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299074:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6b1d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299083:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6b1d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952244.299094:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1783952244.299181:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299188:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299195:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299201:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299207:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.299211:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299218:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299228:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952244.299231:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.299242:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299249:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6b08 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299264:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6b0f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299271:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6b0f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299277:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6b0f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299281:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.299284:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6b0f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299289:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6b0f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299296:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff97b174267b00) 00010000:00010000:2.0:1783952244.299298:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.299301:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6b0f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299306:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a400/0x22c73c7857bb6b0f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299351:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb6b01 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a70c expref: 55 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299373:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6b1d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a70c expref: 54 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.299380:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff97b158d55f00) 00010000:00010000:2.0:1783952244.299382:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952244.299384:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3a00, rc 0) 00000100:00100000:2.0:1783952244.299452:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+54:73707:x1870605447819904:12345-192.168.202.48@tcp:101:dd.0 Request processed in 5832us (15282us total) trans 124554051664 rc 0/0 00000100:00100000:2.0:1783952244.299460:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1537 00010000:00000080:0.0:1783952244.300484:0:26207:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147742680 x1870605447820672/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.300548:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:73706:x1870605447820672:12345-192.168.202.48@tcp:101:dd.0 Request processed in 2450us (3357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.300555:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4992 00000100:00100000:1.0:1783952244.301906:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.303130:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447820928 00000100:00100000:3.0:1783952244.303150:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447820928 00000100:00100000:3.0:1783952244.303363:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 267 00000100:00100000:3.0:1783952244.303377:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+54:73705:x1870605447820928:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:3.0:1783952244.304172:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+55:73705:x1870605447820928:12345-192.168.202.48@tcp:35:dd.0 Request processed in 794us (2273us total) trans 124554051665 rc 0/0 00000100:00100000:3.0:1783952244.304184:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 267 00000100:00100000:1.0:1783952244.305035:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.305082:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.305096:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447821184 00000100:00100000:2.0:1783952244.305110:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447821184 00000100:00100000:1.0:1783952244.305117:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.305126:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447821440 00000100:00100000:3.0:1783952244.305135:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447821440 00000100:00100000:1.0:1783952244.305158:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.305182:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 268 00002000:00010000:2.0:1783952244.305183:0:24879:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1924 (0->18446744073709551615) 00000100:00100000:1.0:1783952244.305186:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447821056 00000100:00100000:3.0:1783952244.305192:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+55:73709:x1870605447821440:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:1.0:1783952244.305192:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447821056 00002000:00100000:2.0:1783952244.305193:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147742300 with x1870605447821184 ext(0->18446744073709551615) 00002000:00010000:2.0:1783952244.305210:0:24879:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b147742300. 00000100:00100000:1.0:1783952244.305229:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447821696 00000100:00100000:1.0:1783952244.305234:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447821696 00000100:00100000:2.0:1783952244.305257:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1011 00000100:00100000:1.0:1783952244.305277:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1538 00000100:00100000:2.0:1783952244.305279:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:2398:x1870605447821184:12345-192.168.202.48@tcp:10:dd.0 00000100:00100000:1.0:1783952244.305293:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+57:73707:x1870605447821056:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.305319:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.305367:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6b2b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a721 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.305411:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6b32 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.305430:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6b32 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.305447:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6b32 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952244.305449:0:24879:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783952244.305459:0:24879:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:2.0:1783952244.305470:0:24879:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:2.0:1783952244.305473:0:24879:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:2.0:1783952244.305475:0:24879:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x784:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783952244.305485:0:24879:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147742300 x1870605447821184/t4294968982(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.305559:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:2398:x1870605447821184:12345-192.168.202.48@tcp:10:dd.0 Request processed in 291us (527us total) trans 4294968982 rc 0/0 00010000:00010000:1.0:1783952244.305584:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2c200/0x22c73c7857bb6b2b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a721 expref: 59 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952244.305585:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1011 00002000:00010000:2.0:1783952244.305626:0:24879:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1924 (0->18446744073709551615) 00002000:00100000:2.0:1783952244.305640:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147742300 with x1870605447821184 ext(0->18446744073709551615) 00002000:00010000:2.0:1783952244.305648:0:24879:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b147742300. 00010000:00010000:1.0:1783952244.305661:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2dc00/0x22c73c7857bb6b32 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a721 expref: 58 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.305673:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff97b158d55f00) 00010000:00010000:1.0:1783952244.305677:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783952244.305681:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b047b2dc00, rc 0) 00000100:00100000:1.0:1783952244.305730:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+58:73707:x1870605447821056:12345-192.168.202.48@tcp:101:dd.0 Request processed in 443us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.305739:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1538 00000100:00100000:1.0:1783952244.305762:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1539 00000100:00100000:1.0:1783952244.305772:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+57:73708:x1870605447821696:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.305781:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.305803:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb6b39 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a728 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.305933:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.305944:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.305952:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.305969:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b47 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.305976:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b47 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.305983:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b47 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306026:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6b4e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306035:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6b4e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306043:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6b4e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952244.306054:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xa:0x0]: returning size 0 00010000:00010000:1.0:1783952244.306113:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306123:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306138:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952244.306141:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+60:73709:x1870605447821440:12345-192.168.202.48@tcp:35:dd.0 Request processed in 942us (1052us total) trans 124554051666 rc 0/0 00010000:00010000:1.0:1783952244.306146:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952244.306151:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 268 00010000:00010000:1.0:1783952244.306153:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952244.306158:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306166:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306178:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:1.0:1783952244.306181:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952244.306185:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306192:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d800/0x22c73c7857bb6b40 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306203:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b47 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306209:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b47 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306214:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b47 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306218:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952244.306227:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b47 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306234:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b47 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306242:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff97b15f403a00) 00010000:00010000:1.0:1783952244.306245:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952244.306248:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b47 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306252:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b47 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306288:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d200/0x22c73c7857bb6b39 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a728 expref: 60 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306301:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6b4e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a728 expref: 59 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.306308:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff97b158d55900) 00010000:00010000:1.0:1783952244.306310:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783952244.306312:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499dc00, rc 0) 00000100:00100000:1.0:1783952244.316336:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+59:73708:x1870605447821696:12345-192.168.202.48@tcp:101:dd.0 Request processed in 10544us (11154us total) trans 124554051667 rc 0/0 00000100:00100000:1.0:1783952244.316356:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1539 00000100:00100000:3.0:1783952244.317103:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.317162:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447821952 00000100:00100000:1.0:1783952244.317175:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447821952 00000100:00100000:1.0:1783952244.317237:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1540 00000100:00100000:1.0:1783952244.317249:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+59:73707:x1870605447821952:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:1.0:1783952244.317350:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952244.317515:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6b1d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a70c expref: 59 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.317541:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff97b158d55f00) 00000100:00100000:3.0:1783952244.317543:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1783952244.317547:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783952244.317571:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447822208 00000100:00100000:3.0:1783952244.317575:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447822208 00000100:00100000:3.0:1783952244.317635:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 269 00000100:00100000:3.0:1783952244.317642:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+59:73706:x1870605447822208:12345-192.168.202.48@tcp:35:dd.0 00010000:00010000:1.0:1783952244.317813:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.317831:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.317844:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783952244.317892:0:66237:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051668 00000004:00010000:1.0:1783952244.317915:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000657f4064 reply state 00000000921f15e9 transno 124554051670 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.317929:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.317934:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff97b158d55f00) 00010000:00010000:1.0:1783952244.317937:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952244.317940:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783952244.318031:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+63:73707:x1870605447821952:12345-192.168.202.48@tcp:36:dd.0 Request processed in 784us (931us total) trans 124554051670 rc 0/0 00000100:00100000:1.0:1783952244.318039:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1540 00000020:00080000:1.0:1783952244.318045:0:66237:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783952244.318426:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+62:73706:x1870605447822208:12345-192.168.202.48@tcp:35:dd.0 Request processed in 784us (882us total) trans 124554051669 rc 0/0 00000100:00100000:3.0:1783952244.318435:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 269 00000100:00100000:0.0:1783952244.320715:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.320928:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952244.321031:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465632640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783952244.321101:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952244.321162:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465632640 00000100:00100000:3.0:1783952244.321172:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465632640 00000100:00100000:3.0:1783952244.321372:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:3.0:1783952244.321384:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465632640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783952244.321426:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00010000:00000080:3.0:1783952244.321445:0:8438:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd7b100 x1870605465632640/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:505/0 lens 224/368 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952244.321644:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447822336 00000100:00100000:1.0:1783952244.321664:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447822336 00000100:00100000:1.0:1783952244.321709:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1541 00000100:00100000:1.0:1783952244.321718:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+62:73708:x1870605447822336:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.321740:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.321770:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b63 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a72f expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.321831:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499de00/0x22c73c7857bb6b6a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.321851:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499de00/0x22c73c7857bb6b6a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.321865:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499de00/0x22c73c7857bb6b6a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.322006:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6b63 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a72f expref: 64 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.322027:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499de00/0x22c73c7857bb6b6a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a72f expref: 63 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.322036:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff97b158d55900) 00010000:00010000:1.0:1783952244.322039:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783952244.322043:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499de00, rc 0) 00000100:00100000:0.0:1783952244.322929:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465632768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952244.323082:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465632640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1698us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.323095:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:2.0:1783952244.323307:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465632640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783952244.323562:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952244.323642:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783952244.323657:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b04ef1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465632896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952244.323696:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952244.323920:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465632768 00000100:00100000:3.0:1783952244.323930:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465632768 00000100:00100000:3.0:1783952244.324063:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280 00000100:00100000:3.0:1783952244.324073:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465632768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952244.324112:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952244.324163:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465632768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.324171:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280 00000100:00100000:2.0:1783952244.325070:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465632896 00000100:00100000:2.0:1783952244.325083:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465632896 00000100:00100000:0.0:1783952244.325111:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465632768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952244.325666:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:3.0:1783952244.325682:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465632896:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952244.325884:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00000024:3.0:1783952244.325999:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:3.0:1783952244.326065:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465632896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 390us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.326094:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:3.0:1783952244.326144:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b04ef1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465632896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952244.326669:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.326701:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447822592 00000100:00100000:0.0:1783952244.326708:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447822592 00000100:00100000:3.0:1783952244.326881:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447822720 00000100:00100000:3.0:1783952244.326886:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447822720 00000100:00100000:0.0:1783952244.327031:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1542 00000100:00100000:0.0:1783952244.327039:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+64:73710:x1870605447822592:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.327058:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.327083:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6b71 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a736 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952244.327421:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4993 00000100:00100000:3.0:1783952244.327433:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:73707:x1870605447822720:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.327443:0:26201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.327928:0:26201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0d9601/0x22c73c7857bb6b78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a73d expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952244.328021:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x785:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:3.0:1783952244.328044:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x785:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:3.0:1783952244.328049:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x785:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783952244.328059:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0d9601/0x22c73c7857bb6b78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a73d expref: 14 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.328077:0:26201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab0d9601/0x22c73c7857bb6b78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a73d expref: 14 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.328092:0:26201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23800, rc 0) 00010000:00000080:3.0:1783952244.328102:0:26201:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04b602680 x1870605447822720/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.328182:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:73707:x1870605447822720:12345-192.168.202.48@tcp:101:dd.0 Request processed in 753us (1515us total) trans 0 rc 0/0 00010000:00010000:0.0:1783952244.328601:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.328626:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.328638:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.328655:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6b86 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.328662:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6b86 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.328669:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6b86 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329034:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6b8d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329044:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6b8d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329050:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6b8d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952244.329063:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xc:0x0]: returning size 0 00010000:00010000:0.0:1783952244.329174:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329182:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329188:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329471:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329479:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ce00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952244.329485:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329495:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329513:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952244.329517:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952244.329523:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329533:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6b7f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329552:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6b86 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329559:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6b86 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329567:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6b86 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329573:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644da00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952244.329577:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6b86 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329647:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6b86 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329661:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff97b1512a2900) 00010000:00010000:0.0:1783952244.329664:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952244.329668:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6b86 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329675:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644da00/0x22c73c7857bb6b86 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329838:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6b71 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a736 expref: 67 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329855:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6b8d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a736 expref: 66 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.329863:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff97b176e45c00) 00010000:00010000:0.0:1783952244.329866:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952244.329869:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644dc00, rc 0) 00000100:00100000:0.0:1783952244.330015:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+66:73710:x1870605447822592:12345-192.168.202.48@tcp:101:dd.0 Request processed in 2975us (4132us total) trans 124554051671 rc 0/0 00000100:00100000:0.0:1783952244.330027:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1542 00000100:00100000:1.0:1783952244.330049:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+65:73708:x1870605447822336:12345-192.168.202.48@tcp:101:dd.0 Request processed in 8331us (9348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.330057:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1541 00000100:00100000:3.0:1783952244.330874:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4993 00000100:00100000:1.0:1783952244.339275:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.339642:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447822848 00000100:00100000:0.0:1783952244.339657:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447822848 00002000:00010000:0.0:1783952244.339708:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1925 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.339713:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b1518e0a80 with x1870605447822848 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.341386:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b1518e0a80. 00000100:00100000:1.0:1783952244.341501:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1012 00000100:00100000:1.0:1783952244.341522:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:2401:x1870605447822848:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:1.0:1783952244.341778:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783952244.341783:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.341786:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:1.0:1783952244.341789:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.341801:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783952244.341813:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1518e0a80 x1870605447822848/t4294968983(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.341961:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:2401:x1870605447822848:12345-192.168.202.48@tcp:10:dd.0 Request processed in 446us (2701us total) trans 4294968983 rc 0/0 00000100:00100000:1.0:1783952244.341970:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1012 00002000:00010000:1.0:1783952244.341975:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1925 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.341979:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b1518e0a80 with x1870605447822848 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.341984:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b1518e0a80. 00000100:00100000:0.0:1783952244.345704:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.345759:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.345802:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.347802:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447823232 00000100:00100000:2.0:1783952244.347823:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447823232 00000100:00100000:3.0:1783952244.347928:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447823488 00000100:00100000:3.0:1783952244.347934:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447823488 00000100:00100000:3.0:1783952244.347997:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1543 00000100:00100000:3.0:1783952244.348011:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+66:73708:x1870605447823232:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:3.0:1783952244.348099:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952244.348140:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6b4e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a728 expref: 66 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.348166:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff97b158d55900) 00010000:00010000:3.0:1783952244.348172:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952244.348714:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.348748:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.348761:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783952244.348828:0:83761:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051672 00000004:00010000:3.0:1783952244.348852:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003150c271 reply state 00000000823b864b transno 124554051673 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.348867:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.348875:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff97b158d55900) 00010000:00010000:3.0:1783952244.348878:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952244.348899:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952244.349029:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+68:73708:x1870605447823232:12345-192.168.202.48@tcp:36:dd.0 Request processed in 1018us (3267us total) trans 124554051673 rc 0/0 00000100:00100000:3.0:1783952244.349038:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1543 00000020:00080000:3.0:1783952244.349044:0:83761:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783952244.349072:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1544 00000100:00100000:3.0:1783952244.349082:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+67:73711:x1870605447823488:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.349095:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.349107:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb6ba2 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a74b expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952244.349648:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447822976 00010000:00010000:3.0:1783952244.349654:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952244.349659:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447822976 00010000:00010000:3.0:1783952244.349666:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.349674:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.349690:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6bb0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.349697:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6bb0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.349703:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6bb0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952244.349709:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1545 00000100:00100000:1.0:1783952244.349716:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+69:73710:x1870605447822976:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.349726:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.349737:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6bb7 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a744 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.349760:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb6bbe lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.349785:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb6bbe lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.349802:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb6bbe lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.349885:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6bc5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.349894:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6bb7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a744 expref: 71 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.349904:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6bc5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.349912:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6bc5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.349913:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d400/0x22c73c7857bb6bbe lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a744 expref: 70 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.349921:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff97b176e45c00) 00000004:00200000:3.0:1783952244.349922:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xd:0x0]: returning size 0 00010000:00010000:1.0:1783952244.349923:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783952244.349926:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499d400, rc 0) 00000100:00100000:1.0:1783952244.349970:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+70:73710:x1870605447822976:12345-192.168.202.48@tcp:101:dd.0 Request processed in 254us (4281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.349977:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1545 00010000:00010000:3.0:1783952244.350050:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350058:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350065:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350071:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350078:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952244.350083:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350092:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350102:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:3.0:1783952244.350105:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952244.350110:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350116:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6ba9 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350135:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6bb0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350141:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6bb0 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350149:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6bb0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350154:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952244.350157:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6bb0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350163:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6bb0 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350171:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff97b155d9db00) 00010000:00010000:3.0:1783952244.350173:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952244.350176:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6bb0 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.350181:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6bb0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.352643:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23a00/0x22c73c7857bb6ba2 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a74b expref: 71 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.352678:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6bc5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a74b expref: 70 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.352712:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff97b176e45600) 00010000:00010000:3.0:1783952244.352715:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952244.352720:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23600, rc 0) 00000100:00100000:0.0:1783952244.353067:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.353116:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447823744 00000100:00100000:0.0:1783952244.353127:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447823744 00000100:00100000:0.0:1783952244.353191:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 270 00000100:00100000:0.0:1783952244.353536:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177063c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+71:73707:x1870605447823744:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:3.0:1783952244.354038:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+71:73711:x1870605447823488:12345-192.168.202.48@tcp:101:dd.0 Request processed in 4956us (8241us total) trans 124554051674 rc 0/0 00000100:00100000:3.0:1783952244.354048:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1544 00000100:00100000:0.0:1783952244.359533:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177063c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+71:73707:x1870605447823744:12345-192.168.202.48@tcp:35:dd.0 Request processed in 6315us (6451us total) trans 124554051675 rc 0/0 00000100:00100000:0.0:1783952244.359552:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 270 00000100:00100000:0.0:1783952244.359701:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.359871:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.359900:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447823872 00000100:00100000:0.0:1783952244.359910:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447823872 00000100:00100000:0.0:1783952244.359960:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4994 00000100:00100000:0.0:1783952244.359968:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:73708:x1870605447823872:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.359989:0:26200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.360015:0:26200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb6bd3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a752 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952244.360049:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x786:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:0.0:1783952244.360085:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x786:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:0.0:1783952244.360090:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x786:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952244.360100:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb6bd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a752 expref: 16 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.360144:0:26200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb6bd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a752 expref: 16 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.360159:0:26200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644da00, rc 0) 00010000:00000080:0.0:1783952244.360167:0:26200:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147740700 x1870605447823872/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.360844:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:73708:x1870605447823872:12345-192.168.202.48@tcp:101:dd.0 Request processed in 230us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.360858:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4994 00000100:00100000:3.0:1783952244.363206:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447824128 00000100:00100000:3.0:1783952244.363228:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447824128 00000100:00100000:3.0:1783952244.363613:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1546 00000100:00100000:3.0:1783952244.363626:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b050959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+71:73710:x1870605447824128:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:3.0:1783952244.363710:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952244.363762:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6b8d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a736 expref: 71 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.363789:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff97b176e45c00) 00010000:00010000:3.0:1783952244.363806:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952244.364131:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.364150:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.364162:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783952244.364220:0:66237:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051676 00000004:00010000:3.0:1783952244.365034:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d10d99a5 reply state 0000000071067d55 transno 124554051677 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.365072:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.365082:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff97b176e45c00) 00010000:00010000:3.0:1783952244.365086:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952244.365089:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952244.366401:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b050959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+73:73710:x1870605447824128:12345-192.168.202.48@tcp:36:dd.0 Request processed in 2756us (6679us total) trans 124554051677 rc 0/0 00000100:00100000:3.0:1783952244.366416:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1546 00000020:00080000:3.0:1783952244.366427:0:66237:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783952244.367088:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.367416:0:24880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447824256 00000100:00100000:0.0:1783952244.367430:0:24880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447824256 00002000:00010000:0.0:1783952244.367476:0:24880:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1926 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.367482:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b04ef1d880 with x1870605447824256 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.367506:0:24880:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b04ef1d880. 00000100:00100000:0.0:1783952244.367538:0:24880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1013 00000100:00100000:0.0:1783952244.367547:0:24880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:2399:x1870605447824256:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:0.0:1783952244.367766:0:24880:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783952244.367770:0:24880:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.367773:0:24880:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:0.0:1783952244.367776:0:24880:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.367778:0:24880:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783952244.367801:0:24880:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04ef1d880 x1870605447824256/t4294968984(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.367901:0:24880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:2399:x1870605447824256:12345-192.168.202.48@tcp:10:dd.0 Request processed in 355us (818us total) trans 4294968984 rc 0/0 00000100:00100000:0.0:1783952244.367908:0:24880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1013 00002000:00010000:0.0:1783952244.367912:0:24880:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1926 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.367916:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b04ef1d880 with x1870605447824256 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.367920:0:24880:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b04ef1d880. 00000100:00100000:1.0:1783952244.384896:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.385158:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.385193:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.385251:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447824512 00000100:00100000:3.0:1783952244.385263:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447824512 00000100:00100000:3.0:1783952244.385336:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4995 00000100:00100000:3.0:1783952244.385347:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:73710:x1870605447824512:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.385371:0:26196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.385411:0:26196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb6be1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a760 expref: -99 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952244.385444:0:26196:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x788:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:3.0:1783952244.385475:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x788:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:3.0:1783952244.385480:0:26196:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x788:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783952244.385490:0:26196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb6be1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a760 expref: 18 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.385510:0:26196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb6be1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a760 expref: 18 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.385549:0:26196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23a00, rc 0) 00010000:00000080:3.0:1783952244.385560:0:26196:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1518e2a00 x1870605447824512/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.386637:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+18:73710:x1870605447824512:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1281us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.386649:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4995 00000100:00100000:0.0:1783952244.386786:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447824384 00000100:00100000:0.0:1783952244.386808:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447824384 00000100:00100000:0.0:1783952244.386871:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447824768 00000100:00100000:0.0:1783952244.386875:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447824768 00000100:00100000:0.0:1783952244.386901:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1547 00000100:00100000:0.0:1783952244.386910:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+74:73711:x1870605447824384:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.386942:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.386967:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6be8 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a759 expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.387012:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c800/0x22c73c7857bb6bef lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.387030:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c800/0x22c73c7857bb6bef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.387043:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c800/0x22c73c7857bb6bef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.387508:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6be8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a759 expref: 76 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.387545:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c800/0x22c73c7857bb6bef lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a759 expref: 75 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.387554:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff97b176e45600) 00010000:00010000:0.0:1783952244.387557:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783952244.387561:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644c800, rc 0) 00000100:00100000:2.0:1783952244.387800:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1548 00000100:00100000:2.0:1783952244.387816:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+75:73713:x1870605447824768:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.387832:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.387845:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6bf6 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a767 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.387996:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388008:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388018:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388035:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c04 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388067:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c04 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388316:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c04 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388392:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6c0b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388401:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6c0b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388408:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6c0b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952244.388421:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xf:0x0]: returning size 0 00010000:00010000:2.0:1783952244.388528:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388536:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388543:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388549:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388555:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c3a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.388560:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388579:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388620:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952244.388623:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.388628:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388635:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3a00/0x22c73c7857bb6bfd lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388649:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c04 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388655:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c04 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388661:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c04 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388666:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c2c00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.388669:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c04 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388675:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c04 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388682:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff97b174267b00) 00010000:00010000:2.0:1783952244.388685:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.388688:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c04 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388702:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c04 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388751:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6bf6 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a767 expref: 78 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388765:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6c0b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a767 expref: 77 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.388773:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff97b15f403300) 00010000:00010000:2.0:1783952244.388775:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952244.388777:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3200, rc 0) 00000100:00100000:1.0:1783952244.390321:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.390403:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+77:73711:x1870605447824384:12345-192.168.202.48@tcp:101:dd.0 Request processed in 3489us (5516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.390415:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1547 00000100:00100000:2.0:1783952244.391067:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+76:73713:x1870605447824768:12345-192.168.202.48@tcp:101:dd.0 Request processed in 3253us (5868us total) trans 124554051678 rc 0/0 00000100:00100000:2.0:1783952244.391077:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1548 00000100:00100000:3.0:1783952244.394572:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447825024 00000100:00100000:3.0:1783952244.394713:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447825024 00000100:00100000:0.0:1783952244.395208:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 271 00000100:00100000:0.0:1783952244.395222:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+76:73708:x1870605447825024:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:0.0:1783952244.395677:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+77:73708:x1870605447825024:12345-192.168.202.48@tcp:35:dd.0 Request processed in 455us (6552us total) trans 124554051679 rc 0/0 00000100:00100000:0.0:1783952244.395687:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 271 00000100:00100000:2.0:1783952244.397511:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.397753:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447825152 00000100:00100000:3.0:1783952244.397767:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447825152 00002000:00010000:3.0:1783952244.398985:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1928 (0->18446744073709551615) 00002000:00100000:3.0:1783952244.398995:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b04ef1d500 with x1870605447825152 ext(0->18446744073709551615) 00002000:00010000:3.0:1783952244.399012:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b04ef1d500. 00000100:00100000:3.0:1783952244.399062:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1014 00000100:00100000:3.0:1783952244.399157:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+18:2400:x1870605447825152:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:3.0:1783952244.399383:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783952244.399387:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:3.0:1783952244.399389:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:3.0:1783952244.399392:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:3.0:1783952244.399394:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783952244.399405:0:8441:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04ef1d500 x1870605447825152/t4294968985(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.399499:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:2400:x1870605447825152:12345-192.168.202.48@tcp:10:dd.0 Request processed in 427us (1998us total) trans 4294968985 rc 0/0 00000100:00100000:3.0:1783952244.399531:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1014 00002000:00010000:3.0:1783952244.399535:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1928 (0->18446744073709551615) 00002000:00100000:3.0:1783952244.399538:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b04ef1d500 with x1870605447825152 ext(0->18446744073709551615) 00002000:00010000:3.0:1783952244.399544:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b04ef1d500. 00000100:00100000:0.0:1783952244.421929:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.421967:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.422032:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.422126:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447825408 00000100:00100000:2.0:1783952244.422139:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447825408 00000100:00100000:3.0:1783952244.422189:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447825536 00000100:00100000:3.0:1783952244.422194:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447825536 00000100:00100000:2.0:1783952244.422217:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447825792 00000100:00100000:2.0:1783952244.422220:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447825792 00000100:00100000:3.0:1783952244.422230:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1549 00000100:00100000:3.0:1783952244.422251:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+79:73711:x1870605447825408:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:3.0:1783952244.422328:0:66237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952244.422366:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6bc5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a74b expref: 79 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.422389:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff97b176e45600) 00010000:00010000:3.0:1783952244.422396:0:66237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952244.422666:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.422685:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.422697:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783952244.422755:0:66237:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051680 00000004:00010000:3.0:1783952244.422781:0:66237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000469a3983 reply state 00000000c156848b transno 124554051681 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.422811:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.422834:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff97b176e45600) 00010000:00010000:3.0:1783952244.422836:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952244.422839:0:66237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952244.422970:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+81:73711:x1870605447825408:12345-192.168.202.48@tcp:36:dd.0 Request processed in 711us (1045us total) trans 124554051681 rc 0/0 00000100:00100000:2.0:1783952244.423034:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1550 00000100:00100000:2.0:1783952244.423048:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+81:73713:x1870605447825536:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.423064:0:68591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1783952244.423135:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1551 00000100:00100000:0.0:1783952244.423147:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+81:73712:x1870605447825792:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.423157:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.423173:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6c20 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a775 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952244.425541:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1549 00000020:00080000:3.0:1783952244.425555:0:66237:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783952244.426859:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.426908:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.426924:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.426946:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6c2e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.426955:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6c2e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.426962:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6c2e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427039:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6c35 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427048:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6c35 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427056:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6c35 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952244.427131:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783952244.427370:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427379:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427397:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427412:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427420:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952244.427425:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427434:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427448:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952244.427452:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952244.427457:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427464:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c27 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427481:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6c2e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427487:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6c2e lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427492:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6c2e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427497:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952244.427500:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6c2e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427533:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6c2e lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427543:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff97b1512a2e00) 00010000:00010000:0.0:1783952244.427545:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952244.427548:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6c2e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427555:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6c2e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427654:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6c20 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a775 expref: 83 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427670:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6c35 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a775 expref: 82 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.427678:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:0.0:1783952244.427680:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952244.427683:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644de00, rc 0) 00010000:00010000:2.0:1783952244.427845:0:68591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6c43 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a76e expref: -99 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.427885:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c4a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.427903:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c4a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.427912:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c4a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.428005:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3c00/0x22c73c7857bb6c43 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a76e expref: 84 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.428021:0:68591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c2c00/0x22c73c7857bb6c4a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a76e expref: 83 pid: 68591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.428028:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff97b15f403300) 00010000:00010000:2.0:1783952244.428030:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783952244.428033:0:68591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2c00, rc 0) 00000100:00100000:2.0:1783952244.428180:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+83:73713:x1870605447825536:12345-192.168.202.48@tcp:101:dd.0 Request processed in 5135us (6210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.428191:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1550 00000100:00100000:0.0:1783952244.428445:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+82:73712:x1870605447825792:12345-192.168.202.48@tcp:101:dd.0 Request processed in 5299us (6410us total) trans 124554051682 rc 0/0 00000100:00100000:0.0:1783952244.428453:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1551 00000100:00100000:3.0:1783952244.431749:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.431908:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447826048 00000100:00100000:0.0:1783952244.431923:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447826048 00000100:00100000:0.0:1783952244.432002:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 272 00000100:00100000:0.0:1783952244.432015:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+82:73710:x1870605447826048:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:0.0:1783952244.432619:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+83:73710:x1870605447826048:12345-192.168.202.48@tcp:35:dd.0 Request processed in 604us (882us total) trans 124554051683 rc 0/0 00000100:00100000:0.0:1783952244.432627:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 272 00000100:00100000:2.0:1783952244.439288:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.439473:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447826176 00000100:00100000:1.0:1783952244.439498:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447826176 00000100:00100000:1.0:1783952244.439584:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1552 00000100:00100000:1.0:1783952244.439974:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+83:73712:x1870605447826176:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.440006:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.440064:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6c51 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a77c expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.440119:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d800/0x22c73c7857bb6c58 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.440138:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d800/0x22c73c7857bb6c58 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.440152:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d800/0x22c73c7857bb6c58 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.440315:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6c51 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a77c expref: 85 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.440338:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d800/0x22c73c7857bb6c58 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a77c expref: 84 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.440349:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:1.0:1783952244.440352:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783952244.440357:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499d800, rc 0) 00000100:00100000:1.0:1783952244.440457:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+84:73712:x1870605447826176:12345-192.168.202.48@tcp:101:dd.0 Request processed in 497us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.441814:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1552 00000100:00100000:1.0:1783952244.444399:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.444685:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.444994:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447826816 00000100:00100000:2.0:1783952244.445008:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447826816 00000100:00100000:2.0:1783952244.445091:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4996 00000100:00100000:2.0:1783952244.445103:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:73711:x1870605447826816:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.445132:0:26203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.445164:0:26203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087caf4c3/0x22c73c7857bb6c5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a78a expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952244.445224:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x789:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:2.0:1783952244.445267:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x789:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:2.0:1783952244.445273:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x789:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952244.445284:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087caf4c3/0x22c73c7857bb6c5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a78a expref: 20 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.445305:0:26203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087caf4c3/0x22c73c7857bb6c5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a78a expref: 20 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.445323:0:26203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3c00, rc 0) 00010000:00000080:2.0:1783952244.445333:0:26203:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b146b4d500 x1870605447826816/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.445762:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+20:73711:x1870605447826816:12345-192.168.202.48@tcp:101:dd.0 Request processed in 660us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.445771:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4996 00000100:00100000:3.0:1783952244.448293:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447826432 00000100:00100000:3.0:1783952244.448315:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447826432 00000100:00100000:3.0:1783952244.448416:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1553 00000100:00100000:3.0:1783952244.448428:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+84:73714:x1870605447826432:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.448456:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.448484:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6c66 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a783 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449101:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449122:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449137:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449155:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6c74 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449162:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6c74 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449186:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6c74 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449277:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb6c7b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449286:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb6c7b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449294:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb6c7b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952244.449307:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x10:0x0]: returning size 0 00010000:00010000:3.0:1783952244.449412:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449420:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449428:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449436:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449443:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952244.449449:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449457:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449482:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:3.0:1783952244.449486:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952244.449633:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449642:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6c6d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449657:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6c74 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449664:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6c74 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449670:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6c74 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449675:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952244.449678:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6c74 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449684:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6c74 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449691:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff97b155d9d000) 00010000:00010000:3.0:1783952244.449693:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952244.449696:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6c74 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449702:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6c74 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449765:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6c66 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a783 expref: 87 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449781:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb6c7b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a783 expref: 86 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.449865:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff97b143007200) 00010000:00010000:3.0:1783952244.449868:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952244.449871:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22000, rc 0) 00000100:00100000:3.0:1783952244.449980:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+86:73714:x1870605447826432:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1553us (5603us total) trans 124554051684 rc 0/0 00000100:00100000:3.0:1783952244.449990:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1553 00000100:00100000:1.0:1783952244.451986:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.452027:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.452066:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.452119:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447827200 00000100:00100000:1.0:1783952244.452150:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447827200 00000100:00100000:0.0:1783952244.452156:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447826688 00000100:00100000:0.0:1783952244.452160:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447826688 00000100:00100000:0.0:1783952244.452211:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447827072 00000100:00100000:0.0:1783952244.452214:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447827072 00000100:00100000:0.0:1783952244.452240:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1554 00000100:00100000:0.0:1783952244.452251:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+87:73713:x1870605447826688:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:0.0:1783952244.452314:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952244.452348:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3200/0x22c73c7857bb6c0b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a767 expref: 87 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.452368:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff97b15f403300) 00010000:00010000:0.0:1783952244.452373:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1783952244.452425:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1929 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.452431:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b146b4f100 with x1870605447827200 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.452443:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b146b4f100. 00000100:00100000:1.0:1783952244.452467:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1015 00000100:00100000:1.0:1783952244.452475:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+20:2400:x1870605447827200:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:1.0:1783952244.452628:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783952244.452632:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.452635:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:1.0:1783952244.452637:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.452639:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x789:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783952244.452650:0:8439:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b146b4f100 x1870605447827200/t4294968986(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1783952244.452681:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.452697:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.452709:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952244.452719:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+21:2400:x1870605447827200:12345-192.168.202.48@tcp:10:dd.0 Request processed in 246us (654us total) trans 4294968986 rc 0/0 00000001:00080000:0.0:1783952244.452759:0:68591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051685 00000004:00010000:0.0:1783952244.452782:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000928165b7 reply state 00000000c6fd6926 transno 124554051686 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.452814:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.452830:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff97b15f403300) 00010000:00010000:0.0:1783952244.452833:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952244.452836:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952244.452898:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+89:73713:x1870605447826688:12345-192.168.202.48@tcp:36:dd.0 Request processed in 649us (922us total) trans 124554051686 rc 0/0 00000100:00100000:0.0:1783952244.452905:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1554 00000020:00080000:0.0:1783952244.452911:0:68591:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783952244.452927:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1555 00000100:00100000:0.0:1783952244.452934:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+88:73712:x1870605447827072:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:0.0:1783952244.452957:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952244.452970:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6c35 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a775 expref: 88 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.452982:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:0.0:1783952244.452985:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952244.453012:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1015 00002000:00010000:1.0:1783952244.453016:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1929 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.453019:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b146b4f100 with x1870605447827200 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.453024:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b146b4f100. 00010000:00010000:0.0:1783952244.453063:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.453073:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.453081:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783952244.453111:0:68591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051687 00000004:00010000:0.0:1783952244.453130:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f44baebd reply state 00000000c5f22db0 transno 124554051688 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.453155:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.453161:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:0.0:1783952244.453163:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952244.453165:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952244.453206:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+90:73712:x1870605447827072:12345-192.168.202.48@tcp:36:dd.0 Request processed in 271us (1177us total) trans 124554051688 rc 0/0 00000100:00100000:0.0:1783952244.453212:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1555 00000020:00080000:0.0:1783952244.453216:0:68591:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783952244.459870:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.460151:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.460367:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.460559:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447827328 00000100:00100000:3.0:1783952244.460573:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447827328 00000100:00100000:2.0:1783952244.460702:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447827712 00000100:00100000:2.0:1783952244.460707:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447827712 00000100:00100000:2.0:1783952244.460757:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4997 00000100:00100000:2.0:1783952244.460769:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+21:73713:x1870605447827712:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.460808:0:11961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.460838:0:11961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000384ef6ea/0x22c73c7857bb6c97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a79f expref: -99 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952244.460873:0:11961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78b:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:2.0:1783952244.460930:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78b:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:2.0:1783952244.460944:0:11961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952244.460956:0:11961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000384ef6ea/0x22c73c7857bb6c97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a79f expref: 22 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.460975:0:11961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000384ef6ea/0x22c73c7857bb6c97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a79f expref: 22 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.460990:0:11961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3a00, rc 0) 00010000:00000080:2.0:1783952244.461000:0:11961:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1447b3800 x1870605447827712/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.461087:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:73713:x1870605447827712:12345-192.168.202.48@tcp:101:dd.0 Request processed in 320us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.461097:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4997 00000100:00100000:1.0:1783952244.463714:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447827584 00000100:00100000:1.0:1783952244.463735:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447827584 00000100:00100000:1.0:1783952244.463970:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1556 00000100:00100000:1.0:1783952244.463983:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b048fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+91:73714:x1870605447827328:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.464023:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.464065:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6c9e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a791 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.464138:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c200/0x22c73c7857bb6ca5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.464156:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c200/0x22c73c7857bb6ca5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.464171:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c200/0x22c73c7857bb6ca5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.464324:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6c9e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a791 expref: 93 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.464348:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c200/0x22c73c7857bb6ca5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a791 expref: 92 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.464357:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff97b143007200) 00010000:00010000:1.0:1783952244.464360:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783952244.464376:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499c200, rc 0) 00000100:00100000:1.0:1783952244.464470:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b048fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+92:73714:x1870605447827328:12345-192.168.202.48@tcp:101:dd.0 Request processed in 490us (4683us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.464478:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1556 00000100:00100000:1.0:1783952244.465429:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1557 00000100:00100000:1.0:1783952244.465443:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+91:73715:x1870605447827584:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.465464:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.465483:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d600/0x22c73c7857bb6cac lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a798 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.465705:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.465719:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.465731:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.465747:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6cba lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.465754:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6cba lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.465760:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6cba lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.465898:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d000/0x22c73c7857bb6cc1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.465908:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d000/0x22c73c7857bb6cc1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.465914:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d000/0x22c73c7857bb6cc1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952244.465926:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x11:0x0]: returning size 0 00010000:00010000:1.0:1783952244.466226:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466235:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466250:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466257:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466263:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499da00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952244.466268:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466276:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466290:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:1.0:1783952244.466293:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952244.466298:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466305:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6cb3 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466320:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6cba lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466326:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6cba lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466331:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6cba lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466336:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499c800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952244.466346:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6cba lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466353:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6cba lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466360:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff97b15f403a00) 00010000:00010000:1.0:1783952244.466363:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952244.466365:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6cba lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466371:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6cba lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466426:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d600/0x22c73c7857bb6cac lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a798 expref: 94 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466441:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d000/0x22c73c7857bb6cc1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a798 expref: 93 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.466449:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff97b143007300) 00010000:00010000:1.0:1783952244.466451:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783952244.466454:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499d000, rc 0) 00000100:00100000:1.0:1783952244.467180:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+93:73715:x1870605447827584:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1736us (7023us total) trans 124554051689 rc 0/0 00000100:00100000:1.0:1783952244.467190:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1557 00000100:00100000:3.0:1783952244.467454:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.467663:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447827840 00000100:00100000:2.0:1783952244.467675:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447827840 00000100:00100000:2.0:1783952244.467733:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4998 00000100:00100000:2.0:1783952244.467743:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:73712:x1870605447827840:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.467764:0:15187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.467787:0:15187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562f73b2/0x22c73c7857bb6ccf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7a6 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952244.467831:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78a:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:2.0:1783952244.467861:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78a:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:2.0:1783952244.467867:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952244.467877:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f73b2/0x22c73c7857bb6ccf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7a6 expref: 23 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.467912:0:15187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000562f73b2/0x22c73c7857bb6ccf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7a6 expref: 23 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.467926:0:15187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c2400, rc 0) 00010000:00000080:2.0:1783952244.467945:0:15187:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd7bb80 x1870605447827840/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.467990:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:73712:x1870605447827840:12345-192.168.202.48@tcp:101:dd.0 Request processed in 249us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.467997:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4998 00000100:00100000:3.0:1783952244.468731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.468888:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447828096 00000100:00100000:1.0:1783952244.468896:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447828096 00000100:00100000:1.0:1783952244.468954:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 273 00000100:00100000:1.0:1783952244.468963:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+93:73711:x1870605447828096:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:1.0:1783952244.469448:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+94:73711:x1870605447828096:12345-192.168.202.48@tcp:35:dd.0 Request processed in 483us (717us total) trans 124554051690 rc 0/0 00000100:00100000:1.0:1783952244.469457:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 273 00000100:00100000:2.0:1783952244.477202:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.477337:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447828224 00000100:00100000:0.0:1783952244.477352:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447828224 00002000:00010000:0.0:1783952244.477415:0:25538:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1931 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.477422:0:25538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049dee300 with x1870605447828224 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.477439:0:25538:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049dee300. 00000100:00100000:0.0:1783952244.477567:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1016 00000100:00100000:0.0:1783952244.477580:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:2401:x1870605447828224:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:0.0:1783952244.478475:0:25538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783952244.478481:0:25538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.478484:0:25538:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:0.0:1783952244.478487:0:25538:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.478560:0:25538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783952244.478576:0:25538:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dee300 x1870605447828224/t4294968987(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.478734:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+24:2401:x1870605447828224:12345-192.168.202.48@tcp:10:dd.0 Request processed in 1155us (1546us total) trans 4294968987 rc 0/0 00000100:00100000:0.0:1783952244.478743:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1016 00002000:00010000:0.0:1783952244.478750:0:25538:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1931 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.478754:0:25538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049dee300 with x1870605447828224 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.478762:0:25538:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049dee300. 00000100:00100000:3.0:1783952244.489505:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.490761:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447828480 00000100:00100000:0.0:1783952244.490780:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447828480 00000100:00100000:0.0:1783952244.490892:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1558 00000100:00100000:0.0:1783952244.490905:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+94:73714:x1870605447828480:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:0.0:1783952244.490996:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952244.491034:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb6c7b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a783 expref: 94 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.491235:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff97b143007200) 00010000:00010000:0.0:1783952244.491242:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952244.491486:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.491578:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.491730:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783952244.492005:0:83761:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051691 00000004:00010000:0.0:1783952244.492039:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e9201b4 reply state 000000009dbe5fa5 transno 124554051692 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.492140:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.492148:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff97b143007200) 00010000:00010000:0.0:1783952244.492151:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952244.492155:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952244.492456:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+96:73714:x1870605447828480:12345-192.168.202.48@tcp:36:dd.0 Request processed in 1550us (2975us total) trans 124554051692 rc 0/0 00000100:00100000:0.0:1783952244.492466:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1558 00000020:00080000:0.0:1783952244.492474:0:83761:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783952244.495119:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.495164:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.495256:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.495302:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447828608 00000100:00100000:1.0:1783952244.495319:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447828608 00002000:00010000:1.0:1783952244.495389:0:24879:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1930 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.495395:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049dece00 with x1870605447828608 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.495413:0:24879:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049dece00. 00000100:00100000:1.0:1783952244.495457:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1017 00000100:00100000:1.0:1783952244.495470:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+24:2401:x1870605447828608:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:1.0:1783952244.495721:0:24879:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783952244.495726:0:24879:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.495729:0:24879:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:1.0:1783952244.495732:0:24879:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.495734:0:24879:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783952244.495746:0:24879:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dece00 x1870605447828608/t4294968988(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.498515:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2401:x1870605447828608:12345-192.168.202.48@tcp:10:dd.0 Request processed in 3019us (3382us total) trans 4294968988 rc 0/0 00000100:00100000:1.0:1783952244.498534:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1017 00002000:00010000:1.0:1783952244.498544:0:24879:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1930 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.498548:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049dece00 with x1870605447828608 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.498561:0:24879:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049dece00. 00000100:00100000:1.0:1783952244.499004:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447828736 00000100:00100000:1.0:1783952244.499018:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447828736 00000100:00100000:1.0:1783952244.499106:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447828992 00000100:00100000:1.0:1783952244.499111:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447828992 00000100:00100000:1.0:1783952244.499142:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1559 00000100:00100000:1.0:1783952244.499157:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+97:73715:x1870605447828736:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.499189:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.499215:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d600/0x22c73c7857bb6cdd lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7ad expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.499261:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6ce4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.499279:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6ce4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.499294:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6ce4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.499444:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d600/0x22c73c7857bb6cdd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7ad expref: 99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.499464:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c800/0x22c73c7857bb6ce4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7ad expref: 98 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.499474:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff97b143007300) 00010000:00010000:1.0:1783952244.499477:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783952244.499482:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499c800, rc 0) 00000100:00100000:3.0:1783952244.500375:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1560 00000100:00100000:3.0:1783952244.500394:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+98:73716:x1870605447828992:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.500413:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.500434:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6ceb lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7b4 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.500677:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.500692:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.500716:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.500735:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6cf9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.500743:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6cf9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.500749:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6cf9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.500901:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6d00 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.500911:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6d00 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.500919:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6d00 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952244.500931:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x12:0x0]: returning size 0 00010000:00010000:3.0:1783952244.502135:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783952244.502279:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.503955:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447829248 00000100:00100000:0.0:1783952244.503975:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447829248 00000100:00100000:0.0:1783952244.504714:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 274 00000100:00100000:0.0:1783952244.504733:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+101:73713:x1870605447829248:12345-192.168.202.48@tcp:35:dd.0 00010000:00010000:3.0:1783952244.505719:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.505735:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.505744:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.505771:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952244.505778:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.507289:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.507330:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:3.0:1783952244.507333:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952244.507341:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952244.507457:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+102:73713:x1870605447829248:12345-192.168.202.48@tcp:35:dd.0 Request processed in 2722us (5173us total) trans 124554051694 rc 0/0 00000100:00100000:0.0:1783952244.507472:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 274 00000100:00100000:2.0:1783952244.507693:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.507741:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447829376 00000100:00100000:2.0:1783952244.507753:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447829376 00000100:00100000:2.0:1783952244.508204:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4999 00000100:00100000:2.0:1783952244.508217:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:73714:x1870605447829376:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.508242:0:26197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.508270:0:26197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b54b91cb/0x22c73c7857bb6d0e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7bb expref: -99 pid: 26197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952244.508303:0:26197:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78c:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00000100:00100000:1.0:1783952244.508465:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+101:73715:x1870605447828736:12345-192.168.202.48@tcp:101:dd.0 Request processed in 9312us (13297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.508477:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1559 00010000:00010000:3.0:1783952244.508697:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6cf2 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.508720:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6cf9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.508727:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6cf9 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.508735:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6cf9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.508742:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952244.508746:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6cf9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.508754:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6cf9 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.508782:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff97b155d9d000) 00010000:00010000:3.0:1783952244.508785:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.509149:0:26197:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78c:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:2.0:1783952244.509157:0:26197:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952244.509169:0:26197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b54b91cb/0x22c73c7857bb6d0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7bb expref: 26 pid: 26197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.509191:0:26197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b54b91cb/0x22c73c7857bb6d0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7bb expref: 26 pid: 26197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.509206:0:26197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1742c3200, rc 0) 00010000:00000080:2.0:1783952244.509216:0:26197:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049ded880 x1870605447829376/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.509287:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+26:73714:x1870605447829376:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1074us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.509296:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4999 00010000:00010000:3.0:1783952244.509414:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6cf9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.509422:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6cf9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.511141:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6ceb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7b4 expref: 101 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.511179:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6d00 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7b4 expref: 100 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.511190:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff97b143007600) 00010000:00010000:3.0:1783952244.511194:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952244.511198:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22800, rc 0) 00000100:00100000:3.0:1783952244.511328:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+100:73716:x1870605447828992:12345-192.168.202.48@tcp:101:dd.0 Request processed in 10940us (16069us total) trans 124554051693 rc 0/0 00000100:00100000:3.0:1783952244.511337:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1560 00000100:00100000:0.0:1783952244.523280:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.523339:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.523379:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.523413:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447829888 00000100:00100000:0.0:1783952244.523426:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447829888 00000100:00100000:0.0:1783952244.523497:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447830016 00000100:00100000:0.0:1783952244.523501:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447830016 00000100:00100000:0.0:1783952244.523524:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1561 00000100:00100000:0.0:1783952244.523537:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+101:73715:x1870605447829888:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:0.0:1783952244.523674:0:83761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952244.523720:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d000/0x22c73c7857bb6cc1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a798 expref: 101 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.523742:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff97b143007300) 00010000:00010000:0.0:1783952244.523748:0:83761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952244.523983:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.524001:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.524014:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783952244.524085:0:83761:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051695 00000004:00010000:0.0:1783952244.524110:0:83761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bdafd32 reply state 00000000a2103644 transno 124554051696 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.524124:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.524131:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff97b143007300) 00010000:00010000:0.0:1783952244.524134:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952244.524137:0:83761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952244.524253:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+103:73715:x1870605447829888:12345-192.168.202.48@tcp:36:dd.0 Request processed in 718us (912us total) trans 124554051696 rc 0/0 00000100:00100000:0.0:1783952244.524261:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1561 00000020:00080000:0.0:1783952244.524267:0:83761:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783952244.524305:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1562 00000100:00100000:0.0:1783952244.524313:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+102:73716:x1870605447830016:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.524336:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.524349:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6d1c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7c2 expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.524375:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6d23 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.524384:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6d23 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.524392:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6d23 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.524475:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d600/0x22c73c7857bb6d1c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7c2 expref: 104 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.524493:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ce00/0x22c73c7857bb6d23 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7c2 expref: 103 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.524501:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff97b143007600) 00010000:00010000:0.0:1783952244.524504:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783952244.524507:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644ce00, rc 0) 00000100:00100000:0.0:1783952244.524535:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+103:73716:x1870605447830016:12345-192.168.202.48@tcp:101:dd.0 Request processed in 224us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.524541:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1562 00000100:00100000:0.0:1783952244.524663:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.524698:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447830144 00000100:00100000:0.0:1783952244.524705:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447830144 00002000:00010000:0.0:1783952244.524734:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1932 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.524745:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b046acea00 with x1870605447830144 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.524756:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b046acea00. 00000100:00100000:0.0:1783952244.524777:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1018 00000100:00100000:0.0:1783952244.524785:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b046acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+26:2400:x1870605447830144:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:0.0:1783952244.524927:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783952244.524931:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.524934:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:0.0:1783952244.524936:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.524939:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783952244.524948:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b046acea00 x1870605447830144/t4294968989(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.524975:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b046acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2400:x1870605447830144:12345-192.168.202.48@tcp:10:dd.0 Request processed in 192us (313us total) trans 4294968989 rc 0/0 00000100:00100000:0.0:1783952244.524982:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1018 00002000:00010000:0.0:1783952244.524985:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1932 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.524988:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b046acea00 with x1870605447830144 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.524993:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b046acea00. 00000100:00100000:2.0:1783952244.525773:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447829632 00000100:00100000:2.0:1783952244.525782:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447829632 00000100:00100000:2.0:1783952244.525849:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 275 00000100:00100000:2.0:1783952244.525858:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+103:73712:x1870605447829632:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:2.0:1783952244.526153:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+104:73712:x1870605447829632:12345-192.168.202.48@tcp:35:dd.0 Request processed in 295us (2889us total) trans 124554051697 rc 0/0 00000100:00100000:2.0:1783952244.526161:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 275 00000100:00100000:3.0:1783952244.528137:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.528352:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447830400 00000100:00100000:1.0:1783952244.528364:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447830400 00000100:00100000:1.0:1783952244.528437:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1563 00000100:00100000:1.0:1783952244.528448:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+104:73717:x1870605447830400:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.528481:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.528519:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d600/0x22c73c7857bb6d2a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7c9 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.528734:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.528754:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.528768:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.528786:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d38 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.528809:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.528817:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.528893:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c600/0x22c73c7857bb6d3f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.528902:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c600/0x22c73c7857bb6d3f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.528945:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c600/0x22c73c7857bb6d3f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783952244.528958:0:66237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x13:0x0]: returning size 0 00010000:00010000:1.0:1783952244.529190:0:66237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529198:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529206:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529213:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529220:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499da00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952244.529224:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529233:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529248:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:1.0:1783952244.529251:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952244.529256:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529263:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499da00/0x22c73c7857bb6d31 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529279:0:66237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529294:0:66237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d38 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529300:0:66237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d38 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529305:0:66237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499cc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:1.0:1783952244.529308:0:66237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d38 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529315:0:66237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d38 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529324:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff97b15f403a00) 00010000:00010000:1.0:1783952244.529326:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783952244.529329:0:66237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d38 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529335:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d38 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529389:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d600/0x22c73c7857bb6d2a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7c9 expref: 107 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529405:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c600/0x22c73c7857bb6d3f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7c9 expref: 106 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.529412:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff97b176e45800) 00010000:00010000:1.0:1783952244.529415:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783952244.529424:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499c600, rc 0) 00000100:00100000:1.0:1783952244.529498:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+106:73717:x1870605447830400:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1053us (1374us total) trans 124554051698 rc 0/0 00000100:00100000:1.0:1783952244.529507:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1563 00000100:00100000:3.0:1783952244.547125:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.547195:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.547244:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.547272:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.547300:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.547684:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447831040 00000100:00100000:2.0:1783952244.547700:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447831040 00000100:00100000:2.0:1783952244.547770:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5000 00000100:00100000:2.0:1783952244.547782:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17738d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:73715:x1870605447831040:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.547837:0:26208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.547867:0:26208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539633d7/0x22c73c7857bb6d4d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7d0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952244.547909:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78d:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:2.0:1783952244.547948:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78d:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:2.0:1783952244.547955:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952244.547966:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539633d7/0x22c73c7857bb6d4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7d0 expref: 28 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.547985:0:26208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000539633d7/0x22c73c7857bb6d4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7d0 expref: 28 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.548001:0:26208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86a400, rc 0) 00010000:00000080:2.0:1783952244.548011:0:26208:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b17738d850 x1870605447831040/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.548103:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17738d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+28:73715:x1870605447831040:12345-192.168.202.48@tcp:101:dd.0 Request processed in 323us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.548112:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5000 00000100:00100000:2.0:1783952244.548320:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447830656 00000100:00100000:2.0:1783952244.548325:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447830656 00000100:00100000:2.0:1783952244.548366:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447831168 00000100:00100000:2.0:1783952244.548370:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447831168 00000100:00100000:2.0:1783952244.548390:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447831424 00000100:00100000:2.0:1783952244.548393:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447831424 00000100:00100000:2.0:1783952244.548413:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1564 00000100:00100000:2.0:1783952244.548420:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+108:73716:x1870605447830656:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:2.0:1783952244.548498:0:67035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783952244.548528:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6d00 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7b4 expref: 108 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.548550:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff97b143007600) 00010000:00010000:2.0:1783952244.548555:0:67035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783952244.548820:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.548834:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.548845:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783952244.548901:0:67035:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051699 00000004:00010000:2.0:1783952244.548927:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7d955c3 reply state 000000009b2d70a9 transno 124554051700 ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.548940:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.548948:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff97b143007600) 00010000:00010000:2.0:1783952244.548951:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783952244.548953:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783952244.549044:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+110:73716:x1870605447830656:12345-192.168.202.48@tcp:36:dd.0 Request processed in 624us (1936us total) trans 124554051700 rc 0/0 00000100:00100000:2.0:1783952244.549052:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1564 00000020:00080000:2.0:1783952244.549058:0:67035:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783952244.549078:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1565 00000100:00100000:2.0:1783952244.549096:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+109:73717:x1870605447831168:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.549112:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.549125:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6d5b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7d7 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549149:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb6d62 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549158:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb6d62 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549165:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb6d62 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549257:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6d5b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7d7 expref: 111 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549275:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86aa00/0x22c73c7857bb6d62 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7d7 expref: 110 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549283:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff97b176e45800) 00010000:00010000:2.0:1783952244.549285:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783952244.549288:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b14d86aa00, rc 0) 00000100:00100000:2.0:1783952244.549321:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+110:73717:x1870605447831168:12345-192.168.202.48@tcp:101:dd.0 Request processed in 227us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.549327:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1565 00000100:00100000:2.0:1783952244.549342:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1566 00000100:00100000:2.0:1783952244.549349:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+109:73718:x1870605447831424:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.549366:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.549377:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6d69 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7de expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549499:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549510:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549518:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549534:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6d77 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549541:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6d77 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549548:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6d77 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549636:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6d7e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549645:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6d7e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549652:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6d7e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783952244.549662:0:67035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x14:0x0]: returning size 0 00010000:00010000:2.0:1783952244.549733:0:67035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549741:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549748:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549755:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549761:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.549767:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549775:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549786:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952244.549800:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.549806:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549813:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6d70 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549824:0:67035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6d77 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549831:0:67035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6d77 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549837:0:67035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6d77 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549849:0:67035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.549853:0:67035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6d77 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549859:0:67035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6d77 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549867:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff97b174267200) 00010000:00010000:2.0:1783952244.549869:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.549871:0:67035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6d77 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549877:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6d77 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549917:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6d69 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7de expref: 112 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549930:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6d7e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7de expref: 111 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.549937:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff97b158d55800) 00010000:00010000:2.0:1783952244.549940:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952244.549942:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031600, rc 0) 00000100:00100000:2.0:1783952244.549972:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+111:73718:x1870605447831424:12345-192.168.202.48@tcp:101:dd.0 Request processed in 623us (2671us total) trans 124554051701 rc 0/0 00000100:00100000:2.0:1783952244.549978:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1566 00000100:00100000:1.0:1783952244.550725:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447830912 00000100:00100000:1.0:1783952244.550738:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447830912 00000100:00100000:1.0:1783952244.550805:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 276 00000100:00100000:1.0:1783952244.550816:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177061050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+111:73714:x1870605447830912:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:1.0:1783952244.551114:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177061050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+112:73714:x1870605447830912:12345-192.168.202.48@tcp:35:dd.0 Request processed in 298us (3917us total) trans 124554051702 rc 0/0 00000100:00100000:1.0:1783952244.551123:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 276 00000100:00100000:3.0:1783952244.554966:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.555254:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.555538:0:24880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447831552 00000100:00100000:0.0:1783952244.555551:0:24880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447831552 00002000:00010000:0.0:1783952244.555648:0:24880:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1933 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.555655:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b144731180 with x1870605447831552 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.555672:0:24880:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b144731180. 00000100:00100000:0.0:1783952244.555706:0:24880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1019 00000100:00100000:0.0:1783952244.555717:0:24880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+28:2400:x1870605447831552:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:0.0:1783952244.555957:0:24880:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783952244.555971:0:24880:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.555974:0:24880:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:0.0:1783952244.555976:0:24880:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.555979:0:24880:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783952244.555993:0:24880:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b144731180 x1870605447831552/t4294968990(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.556304:0:24880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2400:x1870605447831552:12345-192.168.202.48@tcp:10:dd.0 Request processed in 587us (1350us total) trans 4294968990 rc 0/0 00000100:00100000:0.0:1783952244.556313:0:24880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1019 00002000:00010000:0.0:1783952244.556318:0:24880:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1933 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.556320:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b144731180 with x1870605447831552 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.556325:0:24880:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b144731180. 00000100:00100000:1.0:1783952244.557799:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447831680 00000100:00100000:1.0:1783952244.557821:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447831680 00000100:00100000:1.0:1783952244.557905:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1567 00000100:00100000:1.0:1783952244.557917:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+112:73718:x1870605447831680:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.557952:0:67035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.557980:0:67035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d600/0x22c73c7857bb6d8c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7e5 expref: -99 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.558026:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d93 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.558044:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d93 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.558230:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d93 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.558389:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d600/0x22c73c7857bb6d8c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7e5 expref: 114 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.558422:0:67035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499cc00/0x22c73c7857bb6d93 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7e5 expref: 113 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.558433:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff97b158d55800) 00010000:00010000:1.0:1783952244.558437:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783952244.558441:0:67035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499cc00, rc 0) 00000100:00100000:1.0:1783952244.559035:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+113:73718:x1870605447831680:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1117us (3777us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.559044:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1567 00000100:00100000:3.0:1783952244.559234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.559398:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.559430:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447832064 00000100:00100000:3.0:1783952244.559438:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447832064 00000100:00100000:3.0:1783952244.559496:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1568 00000100:00100000:3.0:1783952244.559506:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+114:73717:x1870605447832064:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:3.0:1783952244.559564:0:66236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952244.559611:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499c600/0x22c73c7857bb6d3f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7c9 expref: 114 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.559629:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff97b176e45800) 00010000:00010000:3.0:1783952244.559634:0:66236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952244.559882:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.559907:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.559919:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952244.560627:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447831808 00000100:00100000:0.0:1783952244.560636:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447831808 00000100:00100000:0.0:1783952244.560694:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5001 00000100:00100000:0.0:1783952244.560703:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:73716:x1870605447831808:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.560720:0:26205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.560741:0:26205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb6da1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7ec expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783952244.560771:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78e:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:0.0:1783952244.560814:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78e:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:0.0:1783952244.560821:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783952244.560831:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb6da1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7ec expref: 30 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.560875:0:26205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb6da1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7ec expref: 30 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.560901:0:26205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644d600, rc 0) 00010000:00000080:0.0:1783952244.560910:0:26205:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049d71c00 x1870605447831808/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.561348:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d33551be-a709-4ba2-a74c-f4d7b53c6817+30:73716:x1870605447831808:12345-192.168.202.48@tcp:101:dd.0 Request processed in 644us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.561357:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5001 00000100:00100000:0.0:1783952244.563852:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.563901:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447832320 00000100:00100000:0.0:1783952244.563914:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447832320 00000100:00100000:0.0:1783952244.564447:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1569 00000100:00100000:0.0:1783952244.564461:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+114:73719:x1870605447832320:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.564500:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.564529:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6da8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7f3 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.564737:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.564756:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.564770:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783952244.565157:0:66236:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051703 00000004:00010000:3.0:1783952244.565227:0:66236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f716dea reply state 000000004551e4fb transno 124554051704 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.565246:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.565255:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff97b176e45800) 00010000:00010000:3.0:1783952244.565267:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952244.565273:0:66236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952244.565431:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+117:73717:x1870605447832064:12345-192.168.202.48@tcp:36:dd.0 Request processed in 5923us (6029us total) trans 124554051704 rc 0/0 00000100:00100000:3.0:1783952244.565440:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1568 00000020:00080000:3.0:1783952244.565447:0:66236:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783952244.567223:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6db6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567240:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6db6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567253:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6db6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567361:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb6dbd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567372:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb6dbd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567379:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb6dbd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952244.567393:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x15:0x0]: returning size 0 00010000:00010000:0.0:1783952244.567521:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567530:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567537:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567544:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567550:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644ca00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952244.567570:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567580:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567627:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952244.567631:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952244.567637:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567644:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6daf lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567660:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6db6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567667:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6db6 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567675:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6db6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567680:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952244.567682:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6db6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567688:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6db6 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567695:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff97b1512a2d00) 00010000:00010000:0.0:1783952244.567698:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952244.567707:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6db6 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567713:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6db6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567776:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6da8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7f3 expref: 118 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567811:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb6dbd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7f3 expref: 117 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.567821:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff97b158d55e00) 00010000:00010000:0.0:1783952244.567824:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952244.567827:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644d800, rc 0) 00000100:00100000:0.0:1783952244.567927:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+117:73719:x1870605447832320:12345-192.168.202.48@tcp:101:dd.0 Request processed in 3468us (4086us total) trans 124554051705 rc 0/0 00000100:00100000:0.0:1783952244.567945:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1569 00000100:00100000:2.0:1783952244.569977:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.570221:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447832576 00000100:00100000:3.0:1783952244.570236:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447832576 00000100:00100000:3.0:1783952244.570313:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1570 00000100:00100000:3.0:1783952244.570326:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+117:73718:x1870605447832576:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:3.0:1783952244.570412:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952244.570449:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6d7e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7de expref: 117 pid: 67035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.570475:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff97b158d55800) 00010000:00010000:3.0:1783952244.570481:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952244.570863:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.570880:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.571119:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783952244.571186:0:68591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051706 00000004:00010000:3.0:1783952244.571214:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000855bf27d reply state 000000008099048c transno 124554051707 ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.571227:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.571247:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff97b158d55800) 00010000:00010000:3.0:1783952244.571249:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952244.571253:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952244.571384:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+119:73718:x1870605447832576:12345-192.168.202.48@tcp:36:dd.0 Request processed in 1058us (1417us total) trans 124554051707 rc 0/0 00000100:00100000:3.0:1783952244.571393:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1570 00000020:00080000:3.0:1783952244.571400:0:68591:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783952244.574314:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.574410:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447832960 00000100:00100000:3.0:1783952244.574427:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447832960 00000100:00100000:3.0:1783952244.574516:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 277 00000100:00100000:3.0:1783952244.574530:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+119:73715:x1870605447832960:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:3.0:1783952244.575366:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+120:73715:x1870605447832960:12345-192.168.202.48@tcp:35:dd.0 Request processed in 834us (1063us total) trans 124554051708 rc 0/0 00000100:00100000:3.0:1783952244.575378:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 277 00000100:00100000:2.0:1783952244.578474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.579320:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447832704 00000100:00100000:3.0:1783952244.579336:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447832704 00002000:00010000:3.0:1783952244.579395:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1934 (0->18446744073709551615) 00002000:00100000:3.0:1783952244.579402:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049dedf80 with x1870605447832704 ext(0->18446744073709551615) 00002000:00010000:3.0:1783952244.579419:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049dedf80. 00000100:00100000:3.0:1783952244.579517:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1020 00000100:00100000:3.0:1783952244.579530:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+30:2401:x1870605447832704:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:3.0:1783952244.579786:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783952244.579803:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:3.0:1783952244.579806:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:3.0:1783952244.579808:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:3.0:1783952244.579829:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783952244.579842:0:8441:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dedf80 x1870605447832704/t4294968991(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.580008:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:2401:x1870605447832704:12345-192.168.202.48@tcp:10:dd.0 Request processed in 480us (1548us total) trans 4294968991 rc 0/0 00000100:00100000:3.0:1783952244.580018:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1020 00002000:00010000:3.0:1783952244.580023:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1934 (0->18446744073709551615) 00002000:00100000:3.0:1783952244.580027:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049dedf80 with x1870605447832704 ext(0->18446744073709551615) 00002000:00010000:3.0:1783952244.580032:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049dedf80. 00000100:00100000:2.0:1783952244.599739:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.599825:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.599856:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.599902:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.600636:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447833216 00000100:00100000:3.0:1783952244.600652:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447833216 00000100:00100000:3.0:1783952244.600715:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447833472 00000100:00100000:3.0:1783952244.600718:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447833472 00000100:00100000:3.0:1783952244.600744:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1571 00000100:00100000:3.0:1783952244.600755:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+121:73719:x1870605447833216:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.600800:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.600831:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6dd2 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a801 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.600879:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb6dd9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.600898:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb6dd9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.600913:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb6dd9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952244.601050:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447833088 00000100:00100000:1.0:1783952244.601055:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447833088 00000100:00100000:2.0:1783952244.601133:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447833600 00000100:00100000:2.0:1783952244.601138:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447833600 00010000:00010000:3.0:1783952244.601316:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23200/0x22c73c7857bb6dd2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a801 expref: 123 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601350:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22400/0x22c73c7857bb6dd9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a801 expref: 122 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601362:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff97b158d55e00) 00010000:00010000:3.0:1783952244.601366:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783952244.601370:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22400, rc 0) 00000100:00100000:3.0:1783952244.601457:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+122:73719:x1870605447833216:12345-192.168.202.48@tcp:101:dd.0 Request processed in 703us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.601464:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1571 00000100:00100000:3.0:1783952244.601498:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1572 00000100:00100000:3.0:1783952244.601507:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+121:73720:x1870605447833472:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.601519:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.601530:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6de0 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a808 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601705:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601716:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601726:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601744:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6dee lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601761:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6dee lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601768:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6dee lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601831:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb6df5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601842:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb6df5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601850:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb6df5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952244.601861:0:66236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x16:0x0]: returning size 0 00010000:00010000:3.0:1783952244.601986:0:66236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.601994:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602001:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602008:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602016:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952244.602021:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602042:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602054:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:3.0:1783952244.602057:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952244.602063:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602070:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22200/0x22c73c7857bb6de7 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602082:0:66236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6dee lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602088:0:66236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6dee lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602093:0:66236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6dee lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602098:0:66236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952244.602101:0:66236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6dee lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602107:0:66236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6dee lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602113:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff97b155d9d000) 00010000:00010000:3.0:1783952244.602115:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952244.602117:0:66236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6dee lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602132:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22800/0x22c73c7857bb6dee lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602173:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23c00/0x22c73c7857bb6de0 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a808 expref: 124 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602185:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb6df5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a808 expref: 123 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.602193:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff97b15f403100) 00010000:00010000:3.0:1783952244.602195:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952244.602197:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22000, rc 0) 00000100:00100000:3.0:1783952244.602245:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+123:73720:x1870605447833472:12345-192.168.202.48@tcp:101:dd.0 Request processed in 740us (2421us total) trans 124554051709 rc 0/0 00000100:00100000:3.0:1783952244.602252:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1572 00000100:00100000:1.0:1783952244.607202:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5002 00000100:00100000:1.0:1783952244.607240:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+32:73718:x1870605447833088:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.607269:0:26199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.607303:0:26199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb6e03 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a7fa expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952244.607338:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x790:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:1.0:1783952244.607369:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x790:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:1.0:1783952244.607375:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x790:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952244.607386:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb6e03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7fa expref: 33 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.607406:0:26199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb6e03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7fa expref: 33 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.607447:0:26199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499d600, rc 0) 00010000:00000080:1.0:1783952244.607457:0:26199:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e5bb80 x1870605447833088/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.607539:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:73718:x1870605447833088:12345-192.168.202.48@tcp:101:dd.0 Request processed in 321us (7681us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.607546:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5002 00000100:00100000:3.0:1783952244.608436:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.608577:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447833856 00000100:00100000:0.0:1783952244.608617:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447833856 00000100:00100000:0.0:1783952244.608680:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 278 00000100:00100000:0.0:1783952244.608690:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+123:73716:x1870605447833856:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:0.0:1783952244.609084:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+124:73716:x1870605447833856:12345-192.168.202.48@tcp:35:dd.0 Request processed in 392us (650us total) trans 124554051710 rc 0/0 00000100:00100000:0.0:1783952244.609093:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 278 00000100:00100000:3.0:1783952244.610570:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.610834:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447834112 00000100:00100000:0.0:1783952244.610846:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447834112 00000100:00100000:0.0:1783952244.610921:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1573 00000100:00100000:0.0:1783952244.611150:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+124:73719:x1870605447834112:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:0.0:1783952244.611223:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952244.611260:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb6dbd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7f3 expref: 124 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.611282:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff97b158d55e00) 00010000:00010000:0.0:1783952244.611289:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952244.611650:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.611670:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.611682:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783952244.611740:0:68591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051711 00000004:00010000:0.0:1783952244.611767:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce94fd00 reply state 0000000028960358 transno 124554051712 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.611782:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.611861:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff97b158d55e00) 00010000:00010000:0.0:1783952244.611865:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952244.611868:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952244.612129:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+126:73719:x1870605447834112:12345-192.168.202.48@tcp:36:dd.0 Request processed in 979us (1566us total) trans 124554051712 rc 0/0 00000100:00100000:0.0:1783952244.612138:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1573 00000020:00080000:0.0:1783952244.612146:0:68591:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783952244.613777:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5003 00000100:00100000:2.0:1783952244.613876:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:73717:x1870605447833600:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.614149:0:26198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.614180:0:26198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c972c762/0x22c73c7857bb6e11 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a80f expref: -99 pid: 26198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952244.614216:0:26198:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78f:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:2.0:1783952244.614247:0:26198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78f:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:2.0:1783952244.614252:0:26198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952244.614262:0:26198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c972c762/0x22c73c7857bb6e11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a80f expref: 33 pid: 26198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.614281:0:26198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c972c762/0x22c73c7857bb6e11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a80f expref: 33 pid: 26198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.614299:0:26198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1820cd200, rc 0) 00010000:00000080:2.0:1783952244.614309:0:26198:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b164e3e680 x1870605447833600/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.615394:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:73717:x1870605447833600:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1587us (15472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.615406:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5003 00000100:00100000:0.0:1783952244.615617:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.616145:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447834240 00000100:00100000:2.0:1783952244.616158:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447834240 00000100:00100000:2.0:1783952244.616218:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1574 00000100:00100000:2.0:1783952244.616227:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+126:73720:x1870605447834240:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.616258:0:66236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.616287:0:66236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6e18 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a816 expref: -99 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.616332:0:66236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb6e1f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.616350:0:66236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb6e1f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.616364:0:66236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb6e1f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.616695:0:66236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cd400/0x22c73c7857bb6e18 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a816 expref: 128 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.616723:0:66236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1820cda00/0x22c73c7857bb6e1f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a816 expref: 127 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.616733:0:66236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff97b15f403100) 00010000:00010000:2.0:1783952244.616745:0:66236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783952244.616750:0:66236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1820cda00, rc 0) 00000100:00100000:2.0:1783952244.616820:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+127:73720:x1870605447834240:12345-192.168.202.48@tcp:101:dd.0 Request processed in 593us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.616828:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1574 00000100:00100000:0.0:1783952244.621779:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.622031:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447834496 00000100:00100000:2.0:1783952244.622047:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447834496 00000100:00100000:2.0:1783952244.622133:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1575 00000100:00100000:2.0:1783952244.622145:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+127:73721:x1870605447834496:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.622175:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.622205:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6e26 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a81d expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.622381:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.622401:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.622416:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.622436:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3a00/0x22c73c7857bb6e34 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.622444:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3a00/0x22c73c7857bb6e34 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.622451:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3a00/0x22c73c7857bb6e34 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.622565:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3400/0x22c73c7857bb6e3b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.622574:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3400/0x22c73c7857bb6e3b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.622581:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3400/0x22c73c7857bb6e3b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952244.622747:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00200000:2.0:1783952244.623057:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x17:0x0]: returning size 0 00010000:00010000:2.0:1783952244.623180:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623189:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623196:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623203:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623211:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1414a3800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.623216:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623224:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623241:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:2.0:1783952244.623244:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.623261:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623269:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3800/0x22c73c7857bb6e2d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623288:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3a00/0x22c73c7857bb6e34 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623294:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3a00/0x22c73c7857bb6e34 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623299:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3a00/0x22c73c7857bb6e34 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623305:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1414a3a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:2.0:1783952244.623308:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3a00/0x22c73c7857bb6e34 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623314:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3a00/0x22c73c7857bb6e34 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623323:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff97b16048ba00) 00010000:00010000:2.0:1783952244.623325:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783952244.623328:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3a00/0x22c73c7857bb6e34 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623334:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3a00/0x22c73c7857bb6e34 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623387:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a600/0x22c73c7857bb6e26 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a81d expref: 130 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623416:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3400/0x22c73c7857bb6e3b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a81d expref: 129 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.623424:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff97b176e45b00) 00010000:00010000:2.0:1783952244.623426:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783952244.623428:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1414a3400, rc 0) 00000100:00100000:2.0:1783952244.623518:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+129:73721:x1870605447834496:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1375us (1755us total) trans 124554051713 rc 0/0 00000100:00100000:2.0:1783952244.623528:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1575 00000100:00100000:1.0:1783952244.624517:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447834624 00000100:00100000:1.0:1783952244.624530:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447834624 00002000:00010000:0.0:1783952244.624687:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1936 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.624694:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b1756e0700 with x1870605447834624 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.624707:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b1756e0700. 00000100:00100000:0.0:1783952244.624746:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1021 00000100:00100000:0.0:1783952244.624756:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:2398:x1870605447834624:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:0.0:1783952244.625115:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783952244.625120:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.625122:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:0.0:1783952244.625125:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.625127:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x790:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783952244.625137:0:8439:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e0700 x1870605447834624/t4294968992(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.625209:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:2398:x1870605447834624:12345-192.168.202.48@tcp:10:dd.0 Request processed in 455us (3273us total) trans 4294968992 rc 0/0 00000100:00100000:0.0:1783952244.625217:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1021 00002000:00010000:0.0:1783952244.625221:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1936 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.625224:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b1756e0700 with x1870605447834624 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.625229:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b1756e0700. 00000100:00100000:0.0:1783952244.626257:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.626297:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.626391:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447834880 00000100:00100000:1.0:1783952244.626400:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447834880 00000100:00100000:1.0:1783952244.626453:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5004 00000100:00100000:1.0:1783952244.626464:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:73719:x1870605447834880:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.626484:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.626519:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb6e49 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a824 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952244.626545:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x791:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:1.0:1783952244.626570:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x791:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:1.0:1783952244.626576:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x791:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952244.626628:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb6e49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a824 expref: 35 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.626649:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb6e49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a824 expref: 35 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.626691:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499da00, rc 0) 00010000:00000080:1.0:1783952244.626700:0:8435:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e0380 x1870605447834880/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.626756:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+35:73719:x1870605447834880:12345-192.168.202.48@tcp:101:dd.0 Request processed in 295us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.626764:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5004 00000100:00100000:2.0:1783952244.626931:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447834752 00000100:00100000:2.0:1783952244.626946:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447834752 00002000:00010000:2.0:1783952244.626980:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1935 (0->18446744073709551615) 00002000:00100000:2.0:1783952244.626985:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b1756e3100 with x1870605447834752 ext(0->18446744073709551615) 00002000:00010000:2.0:1783952244.626994:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b1756e3100. 00000100:00100000:2.0:1783952244.627022:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1022 00000100:00100000:2.0:1783952244.627029:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+35:2400:x1870605447834752:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:2.0:1783952244.627198:0:24869:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783952244.627201:0:24869:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:2.0:1783952244.627204:0:24869:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:2.0:1783952244.627207:0:24869:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:2.0:1783952244.627209:0:24869:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783952244.627215:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e3100 x1870605447834752/t4294968993(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.627246:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+36:2400:x1870605447834752:12345-192.168.202.48@tcp:10:dd.0 Request processed in 217us (997us total) trans 4294968993 rc 0/0 00000100:00100000:2.0:1783952244.627263:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1022 00002000:00010000:2.0:1783952244.627266:0:24869:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1935 (0->18446744073709551615) 00002000:00100000:2.0:1783952244.627269:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b1756e3100 with x1870605447834752 ext(0->18446744073709551615) 00002000:00010000:2.0:1783952244.627274:0:24869:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b1756e3100. 00000100:00100000:3.0:1783952244.632097:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.632229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.632775:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447835136 00000100:00100000:1.0:1783952244.632803:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447835136 00000100:00100000:1.0:1783952244.632894:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447835264 00000100:00100000:1.0:1783952244.632899:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447835264 00000100:00100000:1.0:1783952244.633071:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1576 00000100:00100000:1.0:1783952244.633086:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+130:73720:x1870605447835136:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:1.0:1783952244.633181:0:67035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952244.633222:0:67035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22000/0x22c73c7857bb6df5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a808 expref: 130 pid: 66236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.633249:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff97b15f403100) 00010000:00010000:1.0:1783952244.633256:0:67035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783952244.633519:0:67035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.633538:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.633550:0:67035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783952244.633662:0:67035:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051714 00000004:00010000:1.0:1783952244.633691:0:67035:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002dda01cd reply state 00000000f3661726 transno 124554051715 ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.633706:0:67035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.633713:0:67035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff97b15f403100) 00010000:00010000:1.0:1783952244.633716:0:67035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783952244.633719:0:67035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783952244.633856:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+132:73720:x1870605447835136:12345-192.168.202.48@tcp:36:dd.0 Request processed in 772us (1784us total) trans 124554051715 rc 0/0 00000100:00100000:0.0:1783952244.634315:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1577 00000100:00100000:0.0:1783952244.634331:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+132:73721:x1870605447835264:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.634364:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.634382:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6e57 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a82b expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.634415:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb6e5e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.634427:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb6e5e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.634437:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb6e5e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.634630:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6e57 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a82b expref: 134 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.634650:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d800/0x22c73c7857bb6e5e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a82b expref: 133 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.634660:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff97b176e45b00) 00010000:00010000:0.0:1783952244.634662:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783952244.634666:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17644d800, rc 0) 00000100:00100000:0.0:1783952244.634718:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+133:73721:x1870605447835264:12345-192.168.202.48@tcp:101:dd.0 Request processed in 394us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.634726:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1577 00000100:00100000:1.0:1783952244.635840:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1576 00000020:00080000:1.0:1783952244.635849:0:67035:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783952244.646308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.646363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.646419:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.646450:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.646478:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.646531:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447835904 00000100:00100000:3.0:1783952244.646543:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447835904 00000100:00100000:3.0:1783952244.646645:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447836160 00000100:00100000:3.0:1783952244.646668:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447836160 00000100:00100000:3.0:1783952244.646699:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1578 00000100:00100000:3.0:1783952244.646710:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+133:73722:x1870605447835904:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.646743:0:66238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.646772:0:66238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6e65 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a832 expref: -99 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.646977:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.646999:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647014:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647034:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e73 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647042:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e73 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647049:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e73 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647134:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6e7a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647144:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6e7a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647153:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6e7a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783952244.647173:0:66238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x18:0x0]: returning size 0 00010000:00010000:3.0:1783952244.647280:0:66238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647289:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647296:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647302:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647309:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952244.647315:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647322:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647337:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:3.0:1783952244.647340:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952244.647346:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647354:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031600/0x22c73c7857bb6e6c lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647371:0:66238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e73 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647388:0:66238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e73 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647394:0:66238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e73 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647400:0:66238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952244.647403:0:66238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e73 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647410:0:66238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e73 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647419:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff97b155d9d000) 00010000:00010000:3.0:1783952244.647421:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952244.647424:0:66238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e73 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647429:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e73 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647486:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6e65 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a832 expref: 136 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647502:0:66238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6e7a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a832 expref: 135 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647510:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff97b1584d4700) 00010000:00010000:3.0:1783952244.647512:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783952244.647521:0:66238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140030400, rc 0) 00000100:00100000:3.0:1783952244.647667:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+135:73722:x1870605447835904:12345-192.168.202.48@tcp:101:dd.0 Request processed in 957us (1245us total) trans 124554051716 rc 0/0 00000100:00100000:3.0:1783952244.647676:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1578 00000100:00100000:3.0:1783952244.647710:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1579 00000100:00100000:3.0:1783952244.647719:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+134:73721:x1870605447836160:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:3.0:1783952244.647755:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952244.647770:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1414a3400/0x22c73c7857bb6e3b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a81d expref: 134 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647782:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff97b176e45b00) 00010000:00010000:3.0:1783952244.647786:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952244.647943:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647953:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.647962:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783952244.648016:0:66238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051717 00000004:00010000:3.0:1783952244.648035:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007027b6bb reply state 00000000b172babd transno 124554051718 ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.648048:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.648055:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff97b176e45b00) 00010000:00010000:3.0:1783952244.648057:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952244.648067:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952244.648118:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+136:73721:x1870605447836160:12345-192.168.202.48@tcp:36:dd.0 Request processed in 401us (1638us total) trans 124554051718 rc 0/0 00000100:00100000:3.0:1783952244.648125:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1579 00000020:00080000:3.0:1783952244.648129:0:66238:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783952244.648387:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447835648 00000100:00100000:2.0:1783952244.648397:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447835648 00000100:00100000:2.0:1783952244.648442:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447836416 00000100:00100000:2.0:1783952244.648445:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447836416 00000100:00100000:2.0:1783952244.648459:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 279 00000100:00100000:2.0:1783952244.648466:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+137:73717:x1870605447835648:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:2.0:1783952244.648658:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+138:73717:x1870605447835648:12345-192.168.202.48@tcp:35:dd.0 Request processed in 192us (2293us total) trans 124554051719 rc 0/0 00000100:00100000:2.0:1783952244.648665:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 279 00000100:00100000:2.0:1783952244.648679:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 280 00000100:00100000:2.0:1783952244.648684:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+137:73718:x1870605447836416:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:2.0:1783952244.648767:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+138:73718:x1870605447836416:12345-192.168.202.48@tcp:35:dd.0 Request processed in 83us (2316us total) trans 124554051720 rc 0/0 00000100:00100000:2.0:1783952244.648774:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 280 00000100:00100000:1.0:1783952244.649839:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447835392 00000100:00100000:1.0:1783952244.649850:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447835392 00002000:00010000:1.0:1783952244.649888:0:24879:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1937 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.649894:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b166fb2a00 with x1870605447835392 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.649907:0:24879:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b166fb2a00. 00000100:00100000:1.0:1783952244.649930:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1023 00000100:00100000:1.0:1783952244.649948:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+36:2401:x1870605447835392:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:1.0:1783952244.650111:0:24879:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783952244.650115:0:24879:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.650118:0:24879:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:1.0:1783952244.650121:0:24879:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.650123:0:24879:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783952244.650132:0:24879:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b166fb2a00 x1870605447835392/t4294968994(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.650221:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+37:2401:x1870605447835392:12345-192.168.202.48@tcp:10:dd.0 Request processed in 274us (3930us total) trans 4294968994 rc 0/0 00000100:00100000:1.0:1783952244.650229:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1023 00002000:00010000:1.0:1783952244.650232:0:24879:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1937 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.650235:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b166fb2a00 with x1870605447835392 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.650247:0:24879:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b166fb2a00. 00000100:00100000:3.0:1783952244.655365:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.655663:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.655760:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.655950:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447836800 00000100:00100000:3.0:1783952244.655964:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447836800 00000100:00100000:3.0:1783952244.656035:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1580 00000100:00100000:3.0:1783952244.656048:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+138:73722:x1870605447836800:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.656086:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.656114:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6e8f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a847 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.656163:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e96 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.656180:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e96 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.656195:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e96 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.656353:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6e8f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a847 expref: 140 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.656376:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140031200/0x22c73c7857bb6e96 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a847 expref: 139 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.656387:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff97b1584d4700) 00010000:00010000:3.0:1783952244.656398:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783952244.656403:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031200, rc 0) 00000100:00100000:3.0:1783952244.656479:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+139:73722:x1870605447836800:12345-192.168.202.48@tcp:101:dd.0 Request processed in 433us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.656487:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1580 00000100:00100000:1.0:1783952244.657144:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447836544 00000100:00100000:1.0:1783952244.657154:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447836544 00000100:00100000:1.0:1783952244.657203:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447836672 00000100:00100000:1.0:1783952244.657206:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447836672 00000100:00100000:1.0:1783952244.657237:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5005 00000100:00100000:1.0:1783952244.657245:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+38:73720:x1870605447836544:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.657261:0:8494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.657282:0:8494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb6e9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a839 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952244.657311:0:8494:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x792:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:1.0:1783952244.657333:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x792:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:1.0:1783952244.657339:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x792:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952244.657348:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb6e9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a839 expref: 39 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.657367:0:8494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb6e9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a839 expref: 39 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.657397:0:8494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499c000, rc 0) 00010000:00000080:1.0:1783952244.657407:0:8494:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b04aa4aa00 x1870605447836544/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.657455:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04aa4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+39:73720:x1870605447836544:12345-192.168.202.48@tcp:101:dd.0 Request processed in 212us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.657462:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5005 00000100:00100000:1.0:1783952244.657479:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5006 00000100:00100000:1.0:1783952244.657485:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+38:73721:x1870605447836672:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:1.0:1783952244.657498:0:8494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783952244.657508:0:8494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb6ea4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a840 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783952244.657520:0:8494:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x793:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:1.0:1783952244.657529:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x793:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:1.0:1783952244.657532:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x793:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783952244.657538:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb6ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a840 expref: 39 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.657548:0:8494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb6ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a840 expref: 39 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952244.657557:0:8494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b17499ca00, rc 0) 00010000:00000080:1.0:1783952244.657561:0:8494:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b164e3d180 x1870605447836672/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.657625:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+39:73721:x1870605447836672:12345-192.168.202.48@tcp:101:dd.0 Request processed in 140us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.657631:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5006 00000100:00100000:3.0:1783952244.658762:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.658891:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447837056 00000100:00100000:0.0:1783952244.658901:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447837056 00000100:00100000:0.0:1783952244.658971:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1581 00000100:00100000:0.0:1783952244.658982:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+139:73723:x1870605447837056:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.659017:0:83761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.659041:0:83761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6eab lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a84e expref: -99 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659197:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659213:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659225:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659242:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6eb9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659249:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6eb9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659255:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6eb9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659328:0:83761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb6ec0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659338:0:83761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb6ec0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659345:0:83761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb6ec0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783952244.659357:0:83761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x19:0x0]: returning size 0 00010000:00010000:0.0:1783952244.659545:0:83761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659554:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659560:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659567:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659575:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644dc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952244.659580:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659618:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659634:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff97b176e45e00) 00010000:00010000:0.0:1783952244.659637:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952244.659642:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659650:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644dc00/0x22c73c7857bb6eb2 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659666:0:83761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6eb9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659672:0:83761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6eb9 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659678:0:83761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6eb9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659691:0:83761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:0.0:1783952244.659695:0:83761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6eb9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659700:0:83761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6eb9 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659709:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff97b1512a2d00) 00010000:00010000:0.0:1783952244.659712:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783952244.659714:0:83761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6eb9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659721:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c600/0x22c73c7857bb6eb9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.659776:0:83761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644ca00/0x22c73c7857bb6eab lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a84e expref: 142 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.660157:0:83761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb6ec0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a84e expref: 141 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.660167:0:83761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:0.0:1783952244.660170:0:83761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783952244.660172:0:83761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbcc00, rc 0) 00000100:00100000:0.0:1783952244.660270:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+141:73723:x1870605447837056:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1288us (1512us total) trans 124554051721 rc 0/0 00000100:00100000:0.0:1783952244.660279:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1581 00000100:00100000:3.0:1783952244.665090:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.665182:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.665457:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447837184 00000100:00100000:1.0:1783952244.665472:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447837184 00002000:00010000:1.0:1783952244.665531:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1938 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.665538:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b047acc000 with x1870605447837184 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.665556:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b047acc000. 00000100:00100000:1.0:1783952244.665639:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1024 00000100:00100000:1.0:1783952244.665650:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+39:2398:x1870605447837184:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:1.0:1783952244.665923:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783952244.665927:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.665931:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:1.0:1783952244.665946:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:1.0:1783952244.665949:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x792:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783952244.665962:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b047acc000 x1870605447837184/t4294968995(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.666069:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+40:2398:x1870605447837184:12345-192.168.202.48@tcp:10:dd.0 Request processed in 421us (886us total) trans 4294968995 rc 0/0 00000100:00100000:1.0:1783952244.666079:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1024 00002000:00010000:1.0:1783952244.666083:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1938 (0->18446744073709551615) 00002000:00100000:1.0:1783952244.666086:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b047acc000 with x1870605447837184 ext(0->18446744073709551615) 00002000:00010000:1.0:1783952244.666091:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b047acc000. 00000100:00100000:3.0:1783952244.668245:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.668351:0:24880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447837568 00000100:00100000:2.0:1783952244.668364:0:24880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447837568 00002000:00010000:2.0:1783952244.668419:0:24880:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1939 (0->18446744073709551615) 00002000:00100000:2.0:1783952244.668425:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b14dee2680 with x1870605447837568 ext(0->18446744073709551615) 00002000:00010000:2.0:1783952244.668443:0:24880:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b14dee2680. 00000100:00100000:2.0:1783952244.668511:0:24880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1025 00000100:00100000:2.0:1783952244.668523:0:24880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+40:2399:x1870605447837568:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:2.0:1783952244.668797:0:24880:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783952244.668802:0:24880:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:2.0:1783952244.668805:0:24880:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:2.0:1783952244.668808:0:24880:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:2.0:1783952244.668810:0:24880:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783952244.668822:0:24880:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14dee2680 x1870605447837568/t4294968996(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.668918:0:24880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+41:2399:x1870605447837568:12345-192.168.202.48@tcp:10:dd.0 Request processed in 396us (688us total) trans 4294968996 rc 0/0 00000100:00100000:2.0:1783952244.668927:0:24880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1025 00002000:00010000:2.0:1783952244.669142:0:24880:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1939 (0->18446744073709551615) 00002000:00100000:2.0:1783952244.669146:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b14dee2680 with x1870605447837568 ext(0->18446744073709551615) 00002000:00010000:2.0:1783952244.669152:0:24880:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b14dee2680. 00000100:00100000:0.0:1783952244.670713:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447837440 00000100:00100000:0.0:1783952244.670746:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447837440 00000100:00100000:0.0:1783952244.670819:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1582 00000100:00100000:0.0:1783952244.670831:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+141:73722:x1870605447837440:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:0.0:1783952244.671100:0:68591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952244.671139:0:68591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030400/0x22c73c7857bb6e7a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a832 expref: 141 pid: 66238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.671161:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff97b1584d4700) 00010000:00010000:0.0:1783952244.671167:0:68591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783952244.671398:0:68591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.671417:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.671430:0:68591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783952244.671484:0:68591:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051722 00000004:00010000:0.0:1783952244.671524:0:68591:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000815482f6 reply state 000000000a84c0d4 transno 124554051723 ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.671537:0:68591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.671544:0:68591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff97b1584d4700) 00010000:00010000:0.0:1783952244.671546:0:68591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783952244.671549:0:68591:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783952244.671709:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+143:73722:x1870605447837440:12345-192.168.202.48@tcp:36:dd.0 Request processed in 880us (6632us total) trans 124554051723 rc 0/0 00000100:00100000:0.0:1783952244.671718:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1582 00000020:00080000:0.0:1783952244.671733:0:68591:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783952244.675859:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.676052:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.676151:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447837952 00000100:00100000:0.0:1783952244.676164:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447837952 00000100:00100000:0.0:1783952244.676246:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1583 00000100:00100000:0.0:1783952244.676259:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+143:73723:x1870605447837952:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:0.0:1783952244.676296:0:66237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783952244.676323:0:66237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb6ed5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a855 expref: -99 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.676368:0:66237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6edc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.676386:0:66237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6edc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.676401:0:66237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6edc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.676545:0:66237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd800/0x22c73c7857bb6ed5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a855 expref: 145 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.676568:0:66237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbd400/0x22c73c7857bb6edc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a855 expref: 144 pid: 66237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952244.676578:0:66237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:0.0:1783952244.676582:0:66237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783952244.676627:0:66237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbd400, rc 0) 00000100:00100000:0.0:1783952244.676708:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+144:73723:x1870605447837952:12345-192.168.202.48@tcp:101:dd.0 Request processed in 452us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.676728:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1583 00000100:00100000:2.0:1783952244.678179:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447838208 00000100:00100000:2.0:1783952244.678196:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447838208 00000100:00100000:2.0:1783952244.678519:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 281 00000100:00100000:2.0:1783952244.678533:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+144:73720:x1870605447838208:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:1.0:1783952244.679762:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.679896:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.680215:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447838336 00000100:00100000:3.0:1783952244.680226:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447838336 00000100:00100000:3.0:1783952244.680617:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5007 00000100:00100000:3.0:1783952244.680630:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+41:73722:x1870605447838336:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:3.0:1783952244.680658:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783952244.680689:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78fc5d5/0x22c73c7857bb6ee3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a85c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952244.680785:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x794:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:3.0:1783952244.680825:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x794:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:3.0:1783952244.680830:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x794:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783952244.680841:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78fc5d5/0x22c73c7857bb6ee3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a85c expref: 42 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.680862:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a78fc5d5/0x22c73c7857bb6ee3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a85c expref: 42 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.680897:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b140031600, rc 0) 00010000:00000080:3.0:1783952244.680908:0:8433:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b146b4fb80 x1870605447838336/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.681361:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447837824 00000100:00100000:0.0:1783952244.681370:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447837824 00000100:00100000:0.0:1783952244.681407:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 282 00000100:00100000:0.0:1783952244.681415:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b15f3b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+146:73719:x1870605447837824:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:0.0:1783952244.681749:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b15f3b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+147:73719:x1870605447837824:12345-192.168.202.48@tcp:35:dd.0 Request processed in 333us (1851us total) trans 124554051725 rc 0/0 00000100:00100000:0.0:1783952244.681757:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 282 00000100:00100000:2.0:1783952244.681902:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+146:73720:x1870605447838208:12345-192.168.202.48@tcp:35:dd.0 Request processed in 3372us (6057us total) trans 124554051724 rc 0/0 00000100:00100000:2.0:1783952244.681912:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 281 00000100:00100000:3.0:1783952244.682175:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+42:73722:x1870605447838336:12345-192.168.202.48@tcp:101:dd.0 Request processed in 1545us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.682184:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5007 00000100:00100000:1.0:1783952244.682490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.683148:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447838592 00000100:00100000:0.0:1783952244.683159:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447838592 00000100:00100000:0.0:1783952244.683209:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 283 00000100:00100000:0.0:1783952244.683218:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+146:73721:x1870605447838592:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:1.0:1783952244.684306:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.684767:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+147:73721:x1870605447838592:12345-192.168.202.48@tcp:35:dd.0 Request processed in 1547us (2275us total) trans 124554051726 rc 0/0 00000100:00100000:0.0:1783952244.684779:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 283 00000100:00100000:3.0:1783952244.684882:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447838848 00000100:00100000:3.0:1783952244.684891:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447838848 00000100:00100000:3.0:1783952244.685297:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1584 00000100:00100000:3.0:1783952244.685312:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+147:73723:x1870605447838848:12345-192.168.202.48@tcp:36:dd.0 00010000:00010000:3.0:1783952244.685379:0:66238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783952244.685418:0:66238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbcc00/0x22c73c7857bb6ec0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a84e expref: 147 pid: 83761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.685443:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:3.0:1783952244.685451:0:66238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783952244.685667:0:66238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.685688:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.685701:0:66238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783952244.685753:0:66238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051727 00000004:00010000:3.0:1783952244.685811:0:66238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee00b297 reply state 0000000050339650 transno 124554051728 ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.685827:0:66238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952244.685834:0:66238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:3.0:1783952244.685837:0:66238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783952244.685841:0:66238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783952244.685925:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+149:73723:x1870605447838848:12345-192.168.202.48@tcp:36:dd.0 Request processed in 616us (1689us total) trans 124554051728 rc 0/0 00000100:00100000:3.0:1783952244.685932:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1584 00000020:00080000:3.0:1783952244.685937:0:66238:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783952244.693078:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.693520:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447838976 00000100:00100000:0.0:1783952244.693536:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447838976 00002000:00010000:0.0:1783952244.693625:0:24878:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1940 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.693632:0:24878:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16dd4e300 with x1870605447838976 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.693649:0:24878:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16dd4e300. 00000100:00100000:0.0:1783952244.693699:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1026 00000100:00100000:0.0:1783952244.693710:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+42:2400:x1870605447838976:12345-192.168.202.48@tcp:10:dd.0 00002000:00010000:0.0:1783952244.694081:0:24878:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783952244.694086:0:24878:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.694109:0:24878:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:0.0:1783952244.694111:0:24878:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.694114:0:24878:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783952244.694127:0:24878:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd4e300 x1870605447838976/t4294968997(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.694211:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+43:2400:x1870605447838976:12345-192.168.202.48@tcp:10:dd.0 Request processed in 503us (1156us total) trans 4294968997 rc 0/0 00000100:00100000:0.0:1783952244.694219:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1026 00002000:00010000:0.0:1783952244.694224:0:24878:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1940 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.694226:0:24878:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16dd4e300 with x1870605447838976 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.694338:0:24878:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16dd4e300. 00000100:00100000:1.0:1783952244.697091:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.697280:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447839104 00000100:00100000:2.0:1783952244.697294:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447839104 00000100:00100000:2.0:1783952244.697421:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5008 00000100:00100000:2.0:1783952244.697453:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+43:73723:x1870605447839104:12345-192.168.202.48@tcp:101:dd.0 00010000:00010000:2.0:1783952244.697480:0:26202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783952244.697507:0:26202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073b0deaa/0x22c73c7857bb6ef1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a863 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783952244.697543:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x795:0x0] initial LVB size: 0, mtime: 0x6a54f36b, atime: 0x6a54f36b, ctime: 0x6a54f36b, blocks: 0x0 00010000:00010000:2.0:1783952244.697574:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x795:0x0].0x0 since=3959s v=(0 0) 00010000:00010000:2.0:1783952244.697580:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x795:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783952244.697633:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073b0deaa/0x22c73c7857bb6ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a863 expref: 44 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.697659:0:26202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073b0deaa/0x22c73c7857bb6ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a863 expref: 44 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952244.697675:0:26202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1414a2600, rc 0) 00010000:00000080:2.0:1783952244.697684:0:26202:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16dd4c000 x1870605447839104/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 328/400 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.697751:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+44:73723:x1870605447839104:12345-192.168.202.48@tcp:101:dd.0 Request processed in 302us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.697759:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5008 00000100:00100000:1.0:1783952244.703439:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.703624:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.703947:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447839488 00000100:00100000:0.0:1783952244.704041:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447839488 00002000:00010000:0.0:1783952244.704106:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1941 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.704113:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b14de1f480 with x1870605447839488 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.704132:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b14de1f480. 00000100:00100000:0.0:1783952244.704166:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1027 00000100:00100000:0.0:1783952244.704178:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+44:2400:x1870605447839488:12345-192.168.202.48@tcp:10:dd.0 00000100:00100000:2.0:1783952244.705533:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447839360 00000100:00100000:2.0:1783952244.705548:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447839360 00000100:00100000:2.0:1783952244.705624:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 284 00000100:00100000:2.0:1783952244.705635:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+149:73722:x1870605447839360:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:2.0:1783952244.707642:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+150:73722:x1870605447839360:12345-192.168.202.48@tcp:35:dd.0 Request processed in 1994us (4205us total) trans 124554051729 rc 0/0 00000100:00100000:2.0:1783952244.707684:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 284 00002000:00010000:0.0:1783952244.707813:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783952244.707819:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb mtime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.707822:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb atime from disk: 1783952235 -> 1783952235 00002000:00010000:0.0:1783952244.707825:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb ctime from disk: 1783952235 -> 1783952245 00002000:00010000:0.0:1783952244.707828:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783952244.707845:0:8439:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14de1f480 x1870605447839488/t4294968998(0) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.707942:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+45:2400:x1870605447839488:12345-192.168.202.48@tcp:10:dd.0 Request processed in 3766us (4317us total) trans 4294968998 rc 0/0 00000100:00100000:0.0:1783952244.707951:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1027 00002000:00010000:0.0:1783952244.709171:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1941 (0->18446744073709551615) 00002000:00100000:0.0:1783952244.709183:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b14de1f480 with x1870605447839488 ext(0->18446744073709551615) 00002000:00010000:0.0:1783952244.709197:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b14de1f480. 00000100:00100000:1.0:1783952244.715013:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.715919:0:81182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447839744 00000100:00100000:0.0:1783952244.715938:0:81182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447839744 00000100:00100000:1.0:1783952244.716111:0:81182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 285 00000100:00100000:1.0:1783952244.716129:0:81182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+150:73723:x1870605447839744:12345-192.168.202.48@tcp:35:dd.0 00000100:00100000:1.0:1783952244.716452:0:81182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+151:73723:x1870605447839744:12345-192.168.202.48@tcp:35:dd.0 Request processed in 329us (1565us total) trans 124554051730 rc 0/0 00000100:00100000:1.0:1783952244.716460:0:81182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 285 00000100:00100000:3.0:1783952244.719142:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.719560:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447839872 00000100:00100000:2.0:1783952244.719578:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447839872 00002000:00100000:3.0:1783952244.721367:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x782:0x0] (0->1023) req@ffff97b16e9b5c00 x1870605447839872/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.721383:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16e9b5c00 with x1870605447839872 ext(0->1023) 00002000:00010000:3.0:1783952244.721390:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16e9b5c00 00000100:00100000:3.0:1783952244.721442:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1028 00000100:00100000:3.0:1783952244.721454:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+45:2401:x1870605447839872:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:3.0:1783952244.722099:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16e9b5c00 x1870605447839872/t4294968999(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.722181:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+47:2401:x1870605447839872:12345-192.168.202.48@tcp:4:dd.0 Request processed in 729us (3048us total) trans 4294968999 rc 0/0 00000100:00100000:3.0:1783952244.722190:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1028 00002000:00100000:3.0:1783952244.722197:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x782:0x0] (0->1023) req@ffff97b16e9b5c00 x1870605447839872/t4294968999(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.722218:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16e9b5c00 with x1870605447839872 ext(0->1023) 00002000:00010000:3.0:1783952244.722222:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16e9b5c00 00000100:00100000:0.0:1783952244.724982:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.725159:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840000 00000100:00100000:2.0:1783952244.725174:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840000 00000100:00100000:2.0:1783952244.725359:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5009 00000100:00100000:2.0:1783952244.725372:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+47:2401:x1870605447840000:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:1.0:1783952244.726316:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968999 is committed 00010000:00000080:2.0:1783952244.726517:0:26197:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e2d80 x1870605447840000/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.727880:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2401:x1870605447840000:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 2500us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.727906:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5009 00000100:00100000:2.0:1783952244.750913:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.750914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.751014:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840128 00000100:00100000:1.0:1783952244.751025:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840128 00002000:00100000:1.0:1783952244.751072:0:24879:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x783:0x0] (0->1023) req@ffff97b049ded880 x1870605447840128/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952244.751084:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049ded880 with x1870605447840128 ext(0->1023) 00002000:00010000:1.0:1783952244.751090:0:24879:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049ded880 00000100:00100000:1.0:1783952244.751123:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1029 00000100:00100000:1.0:1783952244.751132:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447840128:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:1.0:1783952244.751508:0:24879:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049ded880 x1870605447840128/t4294969000(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.755295:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840256 00000100:00100000:0.0:1783952244.755310:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840256 00000100:00100000:0.0:1783952244.755374:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5010 00000100:00100000:0.0:1783952244.755385:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d33551be-a709-4ba2-a74c-f4d7b53c6817+28:2400:x1870605447840256:12345-192.168.202.48@tcp:16:kworker.0 00000100:00100000:1.0:1783952244.755630:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+28:2400:x1870605447840128:12345-192.168.202.48@tcp:4:dd.0 Request processed in 4356us (4595us total) trans 4294969000 rc 0/0 00000100:00100000:1.0:1783952244.755653:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1029 00002000:00100000:1.0:1783952244.755665:0:24879:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x783:0x0] (0->1023) req@ffff97b049ded880 x1870605447840128/t4294969000(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952244.755676:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049ded880 with x1870605447840128 ext(0->1023) 00002000:00010000:1.0:1783952244.755683:0:24879:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049ded880 00000001:00080000:1.0:1783952244.756056:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969000 is committed 00010000:00000080:0.0:1783952244.760710:0:26206:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e0000 x1870605447840256/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.760779:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447840256:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 5396us (9880us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.760802:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5010 00000100:00100000:0.0:1783952244.768747:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.768916:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840512 00000100:00100000:1.0:1783952244.768927:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840512 00000100:00100000:1.0:1783952244.768987:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5011 00000100:00100000:1.0:1783952244.768998:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447840512:12345-192.168.202.48@tcp:16:kworker.0 00010000:00000080:1.0:1783952244.769056:0:26207:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1756e1f80 x1870605447840512/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.769115:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447840512:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 117us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.769123:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5011 00000100:00100000:0.0:1783952244.769239:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.769416:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840384 00000100:00100000:1.0:1783952244.769420:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840384 00002000:00100000:1.0:1783952244.769453:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x784:0x0] (0->1023) req@ffff97b049e74000 x1870605447840384/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952244.769465:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049e74000 with x1870605447840384 ext(0->1023) 00002000:00010000:1.0:1783952244.769471:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049e74000 00000100:00100000:1.0:1783952244.769497:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1030 00000100:00100000:1.0:1783952244.769505:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447840384:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:1.0:1783952244.770303:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049e74000 x1870605447840384/t4294969001(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.770348:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2400:x1870605447840384:12345-192.168.202.48@tcp:4:dd.0 Request processed in 844us (1109us total) trans 4294969001 rc 0/0 00000100:00100000:1.0:1783952244.770357:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1030 00002000:00100000:1.0:1783952244.770363:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x784:0x0] (0->1023) req@ffff97b049e74000 x1870605447840384/t4294969001(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952244.770373:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049e74000 with x1870605447840384 ext(0->1023) 00002000:00010000:1.0:1783952244.770377:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049e74000 00000100:00100000:0.0:1783952244.774363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.774409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.774435:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840768 00000100:00100000:0.0:1783952244.774445:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840768 00000100:00100000:0.0:1783952244.774519:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5012 00000100:00100000:0.0:1783952244.774530:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2401:x1870605447840768:12345-192.168.202.48@tcp:16:kworker.0 00010000:00000080:0.0:1783952244.774624:0:26200:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14de8f800 x1870605447840768/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.774677:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2401:x1870605447840768:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 149us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.774684:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5012 00000100:00100000:3.0:1783952244.774781:0:24880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840640 00000100:00100000:3.0:1783952244.774798:0:24880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840640 00002000:00100000:3.0:1783952244.774824:0:24880:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x785:0x0] (0->1023) req@ffff97b177316a00 x1870605447840640/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.774834:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b177316a00 with x1870605447840640 ext(0->1023) 00002000:00010000:3.0:1783952244.774839:0:24880:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b177316a00 00000100:00100000:3.0:1783952244.774865:0:24880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1031 00000100:00100000:3.0:1783952244.774872:0:24880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2401:x1870605447840640:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:3.0:1783952244.775201:0:24880:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b177316a00 x1870605447840640/t4294969002(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.775229:0:24880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2401:x1870605447840640:12345-192.168.202.48@tcp:4:dd.0 Request processed in 358us (878us total) trans 4294969002 rc 0/0 00000100:00100000:3.0:1783952244.775237:0:24880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1031 00002000:00100000:3.0:1783952244.775242:0:24880:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x785:0x0] (0->1023) req@ffff97b177316a00 x1870605447840640/t4294969002(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.775251:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b177316a00 with x1870605447840640 ext(0->1023) 00002000:00010000:3.0:1783952244.775254:0:24880:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b177316a00 00000100:00100000:0.0:1783952244.796995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.797944:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840896 00000100:00100000:2.0:1783952244.797960:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840896 00002000:00100000:2.0:1783952244.798036:0:24878:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x786:0x0] (0->1023) req@ffff97b147742d80 x1870605447840896/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952244.798048:0:24878:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147742d80 with x1870605447840896 ext(0->1023) 00002000:00010000:2.0:1783952244.798055:0:24878:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b147742d80 00000100:00100000:2.0:1783952244.798101:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1032 00000100:00100000:2.0:1783952244.798111:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2399:x1870605447840896:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:2.0:1783952244.798488:0:24878:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147742d80 x1870605447840896/t4294969003(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.798562:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:2399:x1870605447840896:12345-192.168.202.48@tcp:4:dd.0 Request processed in 452us (1581us total) trans 4294969003 rc 0/0 00000100:00100000:2.0:1783952244.798576:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1032 00002000:00100000:2.0:1783952244.798583:0:24878:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x786:0x0] (0->1023) req@ffff97b147742d80 x1870605447840896/t4294969003(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952244.798631:0:24878:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147742d80 with x1870605447840896 ext(0->1023) 00002000:00010000:2.0:1783952244.798636:0:24878:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b147742d80 00000100:00100000:1.0:1783952244.801170:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.801305:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841024 00000100:00100000:2.0:1783952244.801315:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841024 00000100:00100000:2.0:1783952244.801370:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5013 00000100:00100000:2.0:1783952244.801379:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:2398:x1870605447841024:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:3.0:1783952244.801740:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969003 is committed 00010000:00000080:2.0:1783952244.801984:0:26198:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14de1dc00 x1870605447841024/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.802114:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447841024:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 735us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.802122:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5013 00000100:00100000:0.0:1783952244.813198:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.813331:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.813332:0:24877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841152 00000100:00100000:2.0:1783952244.813345:0:24877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841152 00002000:00100000:2.0:1783952244.813414:0:24877:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x787:0x0] (0->1023) req@ffff97b147740e00 x1870605447841152/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952244.813426:0:24877:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147740e00 with x1870605447841152 ext(0->1023) 00002000:00010000:2.0:1783952244.813432:0:24877:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b147740e00 00000100:00100000:2.0:1783952244.813465:0:24877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1033 00000100:00100000:2.0:1783952244.813474:0:24877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447841152:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:3.0:1783952244.814919:0:24877:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147740e00 x1870605447841152/t4294969004(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.815160:0:24877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447841152:12345-192.168.202.48@tcp:4:dd.0 Request processed in 1684us (1972us total) trans 4294969004 rc 0/0 00000100:00100000:3.0:1783952244.815190:0:24877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1033 00002000:00100000:3.0:1783952244.815214:0:24877:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x787:0x0] (0->1023) req@ffff97b147740e00 x1870605447841152/t4294969004(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.815226:0:24877:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147740e00 with x1870605447841152 ext(0->1023) 00002000:00010000:3.0:1783952244.815233:0:24877:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b147740e00 00000100:00100000:0.0:1783952244.817889:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841280 00000100:00100000:0.0:1783952244.817903:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841280 00000100:00100000:0.0:1783952244.817983:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5014 00000100:00100000:0.0:1783952244.817994:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447841280:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:3.0:1783952244.818562:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969004 is committed 00010000:00000080:0.0:1783952244.818853:0:26196:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b146f02d80 x1870605447841280/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.818926:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447841280:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 933us (5603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.818935:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5014 00000100:00100000:0.0:1783952244.826979:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.827066:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841408 00000100:00100000:3.0:1783952244.827076:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841408 00002000:00100000:3.0:1783952244.827126:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x788:0x0] (0->1023) req@ffff97b147741180 x1870605447841408/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.827139:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147741180 with x1870605447841408 ext(0->1023) 00002000:00010000:3.0:1783952244.827145:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b147741180 00000100:00100000:3.0:1783952244.827190:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1034 00000100:00100000:3.0:1783952244.827200:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2401:x1870605447841408:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:3.0:1783952244.827577:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147741180 x1870605447841408/t4294969005(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.827691:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2401:x1870605447841408:12345-192.168.202.48@tcp:4:dd.0 Request processed in 492us (721us total) trans 4294969005 rc 0/0 00000100:00100000:3.0:1783952244.827699:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1034 00002000:00100000:3.0:1783952244.827707:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x788:0x0] (0->1023) req@ffff97b147741180 x1870605447841408/t4294969005(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.827715:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147741180 with x1870605447841408 ext(0->1023) 00002000:00010000:3.0:1783952244.827719:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b147741180 00000100:00100000:1.0:1783952244.831742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.831990:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841536 00000100:00100000:2.0:1783952244.832014:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841536 00000100:00100000:2.0:1783952244.832075:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5015 00000100:00100000:2.0:1783952244.832086:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2401:x1870605447841536:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:3.0:1783952244.832363:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969005 is committed 00010000:00000080:2.0:1783952244.832639:0:11961:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b146f00000 x1870605447841536/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.832699:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2401:x1870605447841536:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 615us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.832707:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5015 00000100:00100000:2.0:1783952244.836984:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.837200:0:24881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841664 00000100:00100000:3.0:1783952244.837211:0:24881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841664 00002000:00100000:3.0:1783952244.837256:0:24881:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x789:0x0] (0->1023) req@ffff97b177349050 x1870605447841664/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.837268:0:24881:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b177349050 with x1870605447841664 ext(0->1023) 00002000:00010000:3.0:1783952244.837273:0:24881:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b177349050 00000100:00100000:3.0:1783952244.837307:0:24881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1035 00000100:00100000:3.0:1783952244.837316:0:24881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2399:x1870605447841664:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:3.0:1783952244.837771:0:24881:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b177349050 x1870605447841664/t4294969006(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.837903:0:24881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2399:x1870605447841664:12345-192.168.202.48@tcp:4:dd.0 Request processed in 587us (928us total) trans 4294969006 rc 0/0 00000100:00100000:3.0:1783952244.837911:0:24881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1035 00002000:00100000:3.0:1783952244.837918:0:24881:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x789:0x0] (0->1023) req@ffff97b177349050 x1870605447841664/t4294969006(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.837926:0:24881:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b177349050 with x1870605447841664 ext(0->1023) 00002000:00010000:3.0:1783952244.837930:0:24881:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b177349050 00000100:00100000:0.0:1783952244.842449:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.842547:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841792 00000100:00100000:3.0:1783952244.842557:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841792 00000100:00100000:3.0:1783952244.842641:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5016 00000100:00100000:3.0:1783952244.842652:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447841792:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:1.0:1783952244.842984:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969006 is committed 00010000:00000080:3.0:1783952244.843148:0:26203:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147742680 x1870605447841792/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.843228:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447841792:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 578us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.843236:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5016 00000100:00100000:0.0:1783952244.847690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.847799:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842048 00000100:00100000:2.0:1783952244.847808:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842048 00000100:00100000:2.0:1783952244.847864:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5017 00000100:00100000:2.0:1783952244.847874:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447842048:12345-192.168.202.48@tcp:16:kworker.0 00010000:00000080:2.0:1783952244.847930:0:15187:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147740700 x1870605447842048/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.847998:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447842048:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 126us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.848006:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5017 00000100:00100000:2.0:1783952244.849232:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.849307:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841920 00000100:00100000:1.0:1783952244.849314:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841920 00002000:00100000:1.0:1783952244.849350:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x78a:0x0] (0->1023) req@ffff97b049ded180 x1870605447841920/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952244.849360:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049ded180 with x1870605447841920 ext(0->1023) 00002000:00010000:1.0:1783952244.849366:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049ded180 00000100:00100000:1.0:1783952244.849392:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1036 00000100:00100000:1.0:1783952244.849400:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2401:x1870605447841920:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:1.0:1783952244.849780:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049ded180 x1870605447841920/t4294969007(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.849845:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2401:x1870605447841920:12345-192.168.202.48@tcp:4:dd.0 Request processed in 446us (617us total) trans 4294969007 rc 0/0 00000100:00100000:1.0:1783952244.849853:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1036 00002000:00100000:1.0:1783952244.849868:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x78a:0x0] (0->1023) req@ffff97b049ded180 x1870605447841920/t4294969007(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952244.849876:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049ded180 with x1870605447841920 ext(0->1023) 00002000:00010000:1.0:1783952244.849879:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049ded180 00000100:00100000:2.0:1783952244.853668:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.853707:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.853806:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842304 00000100:00100000:0.0:1783952244.853816:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842304 00000100:00100000:0.0:1783952244.853872:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5018 00000100:00100000:0.0:1783952244.853883:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447842304:12345-192.168.202.48@tcp:16:kworker.0 00010000:00000080:0.0:1783952244.853961:0:26202:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dee300 x1870605447842304/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.854010:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447842304:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 130us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.854017:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5018 00000100:00100000:3.0:1783952244.854089:0:24880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842176 00000100:00100000:3.0:1783952244.854094:0:24880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842176 00002000:00100000:3.0:1783952244.854120:0:24880:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x78b:0x0] (0->1023) req@ffff97b049dec000 x1870605447842176/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.854129:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049dec000 with x1870605447842176 ext(0->1023) 00002000:00010000:3.0:1783952244.854135:0:24880:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049dec000 00000100:00100000:3.0:1783952244.854160:0:24880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1037 00000100:00100000:3.0:1783952244.854167:0:24880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2399:x1870605447842176:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:3.0:1783952244.854511:0:24880:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dec000 x1870605447842176/t4294969008(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.854539:0:24880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2399:x1870605447842176:12345-192.168.202.48@tcp:4:dd.0 Request processed in 373us (882us total) trans 4294969008 rc 0/0 00000100:00100000:3.0:1783952244.854546:0:24880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1037 00002000:00100000:3.0:1783952244.854552:0:24880:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x78b:0x0] (0->1023) req@ffff97b049dec000 x1870605447842176/t4294969008(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.854560:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049dec000 with x1870605447842176 ext(0->1023) 00002000:00010000:3.0:1783952244.854563:0:24880:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049dec000 00000100:00100000:2.0:1783952244.859434:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.859548:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.859761:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842560 00000100:00100000:1.0:1783952244.859772:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842560 00000100:00100000:1.0:1783952244.859842:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5019 00000100:00100000:1.0:1783952244.859853:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2401:x1870605447842560:12345-192.168.202.48@tcp:16:kworker.0 00010000:00000080:1.0:1783952244.859923:0:26197:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dedf80 x1870605447842560/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.859987:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2401:x1870605447842560:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 136us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.859994:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5019 00000100:00100000:0.0:1783952244.861207:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842432 00000100:00100000:0.0:1783952244.861217:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842432 00002000:00100000:0.0:1783952244.861258:0:24878:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x78c:0x0] (0->1023) req@ffff97b049dece00 x1870605447842432/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952244.861269:0:24878:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049dece00 with x1870605447842432 ext(0->1023) 00002000:00010000:0.0:1783952244.861274:0:24878:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049dece00 00000100:00100000:0.0:1783952244.861345:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1038 00000100:00100000:0.0:1783952244.861353:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2400:x1870605447842432:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:0.0:1783952244.863049:0:24878:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049dece00 x1870605447842432/t4294969009(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.863184:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:2400:x1870605447842432:12345-192.168.202.48@tcp:4:dd.0 Request processed in 1831us (3759us total) trans 4294969009 rc 0/0 00000100:00100000:0.0:1783952244.863194:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1038 00002000:00100000:0.0:1783952244.863203:0:24878:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x78c:0x0] (0->1023) req@ffff97b049dece00 x1870605447842432/t4294969009(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952244.863211:0:24878:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049dece00 with x1870605447842432 ext(0->1023) 00002000:00010000:0.0:1783952244.863216:0:24878:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049dece00 00000100:00100000:2.0:1783952244.869341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.869706:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842688 00000100:00100000:0.0:1783952244.869719:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842688 00002000:00100000:0.0:1783952244.869803:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x78d:0x0] (0->1023) req@ffff97b049ded880 x1870605447842688/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952244.869814:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049ded880 with x1870605447842688 ext(0->1023) 00002000:00010000:0.0:1783952244.869820:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049ded880 00000100:00100000:0.0:1783952244.869852:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1039 00000100:00100000:0.0:1783952244.869861:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:2401:x1870605447842688:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:0.0:1783952244.870234:0:8439:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049ded880 x1870605447842688/t4294969010(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.870279:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:2401:x1870605447842688:12345-192.168.202.48@tcp:4:dd.0 Request processed in 420us (959us total) trans 4294969010 rc 0/0 00000100:00100000:0.0:1783952244.870286:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1039 00002000:00100000:0.0:1783952244.870293:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x78d:0x0] (0->1023) req@ffff97b049ded880 x1870605447842688/t4294969010(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952244.870301:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049ded880 with x1870605447842688 ext(0->1023) 00002000:00010000:0.0:1783952244.870304:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049ded880 00000100:00100000:3.0:1783952244.873024:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.873305:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842816 00000100:00100000:0.0:1783952244.873316:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842816 00000100:00100000:0.0:1783952244.873383:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5020 00000100:00100000:0.0:1783952244.873393:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:2400:x1870605447842816:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:3.0:1783952244.876129:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969010 is committed 00010000:00000080:2.0:1783952244.876293:0:26206:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16e9b4380 x1870605447842816/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.876393:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447842816:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 3001us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.876403:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5020 00000100:00100000:2.0:1783952244.885754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.886308:0:24869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842944 00000100:00100000:3.0:1783952244.886319:0:24869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842944 00002000:00100000:3.0:1783952244.886390:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x78e:0x0] (0->1023) req@ffff97b049d70000 x1870605447842944/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.886402:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049d70000 with x1870605447842944 ext(0->1023) 00002000:00010000:3.0:1783952244.886407:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049d70000 00000100:00100000:3.0:1783952244.886441:0:24869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1040 00000100:00100000:3.0:1783952244.886450:0:24869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447842944:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:3.0:1783952244.887144:0:24869:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049d70000 x1870605447842944/t4294969011(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.887254:0:24869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447842944:12345-192.168.202.48@tcp:4:dd.0 Request processed in 804us (1510us total) trans 4294969011 rc 0/0 00000100:00100000:3.0:1783952244.887264:0:24869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1040 00002000:00100000:3.0:1783952244.887272:0:24869:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x78e:0x0] (0->1023) req@ffff97b049d70000 x1870605447842944/t4294969011(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.887281:0:24869:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049d70000 with x1870605447842944 ext(0->1023) 00002000:00010000:3.0:1783952244.887285:0:24869:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049d70000 00000100:00100000:1.0:1783952244.894600:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.898620:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843072 00000100:00100000:2.0:1783952244.898638:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843072 00000100:00100000:2.0:1783952244.898712:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5021 00000100:00100000:2.0:1783952244.898722:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2399:x1870605447843072:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:2.0:1783952244.898997:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969011 is committed 00010000:00000080:2.0:1783952244.899043:0:26201:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b146f01500 x1870605447843072/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.899114:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2399:x1870605447843072:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 394us (4539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.899123:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5021 00000100:00100000:3.0:1783952244.904477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.904521:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.904626:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843200 00000100:00100000:1.0:1783952244.904638:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843200 00002000:00100000:1.0:1783952244.904694:0:24879:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x78f:0x0] (0->1023) req@ffff97b16e9b5c00 x1870605447843200/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952244.904705:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16e9b5c00 with x1870605447843200 ext(0->1023) 00002000:00010000:1.0:1783952244.904711:0:24879:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16e9b5c00 00000100:00100000:1.0:1783952244.904744:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1041 00000100:00100000:1.0:1783952244.904754:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447843200:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:1.0:1783952244.905144:0:24879:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16e9b5c00 x1870605447843200/t4294969012(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.905218:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447843200:12345-192.168.202.48@tcp:4:dd.0 Request processed in 465us (754us total) trans 4294969012 rc 0/0 00000100:00100000:1.0:1783952244.905227:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1041 00002000:00100000:1.0:1783952244.905234:0:24879:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x78f:0x0] (0->1023) req@ffff97b16e9b5c00 x1870605447843200/t4294969012(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952244.905243:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16e9b5c00 with x1870605447843200 ext(0->1023) 00002000:00010000:1.0:1783952244.905247:0:24879:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16e9b5c00 00000100:00100000:0.0:1783952244.905749:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843328 00000100:00100000:0.0:1783952244.905756:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843328 00000100:00100000:0.0:1783952244.905859:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5022 00000100:00100000:0.0:1783952244.905870:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447843328:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:3.0:1783952244.906265:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969012 is committed 00010000:00000080:0.0:1783952244.909746:0:26199:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16e9b6300 x1870605447843328/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.909976:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447843328:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 4107us (5453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952244.909988:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5022 00000100:00100000:0.0:1783952244.920715:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952244.920763:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.920847:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843456 00000100:00100000:2.0:1783952244.920857:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843456 00002000:00100000:2.0:1783952244.920906:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x790:0x0] (0->1023) req@ffff97b147743800 x1870605447843456/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952244.920917:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147743800 with x1870605447843456 ext(0->1023) 00002000:00010000:2.0:1783952244.920923:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b147743800 00000100:00100000:2.0:1783952244.920954:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1042 00000100:00100000:2.0:1783952244.920963:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447843456:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:2.0:1783952244.921321:0:8440:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147743800 x1870605447843456/t4294969013(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.921395:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447843456:12345-192.168.202.48@tcp:4:dd.0 Request processed in 432us (691us total) trans 4294969013 rc 0/0 00000100:00100000:2.0:1783952244.921403:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1042 00002000:00100000:2.0:1783952244.921410:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x790:0x0] (0->1023) req@ffff97b147743800 x1870605447843456/t4294969013(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952244.921418:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b147743800 with x1870605447843456 ext(0->1023) 00002000:00010000:2.0:1783952244.921422:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b147743800 00000100:00100000:3.0:1783952244.923291:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843584 00000100:00100000:3.0:1783952244.923307:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843584 00000100:00100000:3.0:1783952244.923470:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5023 00000100:00100000:3.0:1783952244.923480:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447843584:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:2.0:1783952244.923819:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969013 is committed 00010000:00000080:3.0:1783952244.924025:0:26198:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147742300 x1870605447843584/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.924106:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447843584:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 627us (3341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.924113:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5023 00000100:00100000:1.0:1783952244.928016:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.928410:0:24880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843712 00000100:00100000:3.0:1783952244.928422:0:24880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843712 00002000:00100000:3.0:1783952244.928471:0:24880:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x791:0x0] (0->1023) req@ffff97b146f02a00 x1870605447843712/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.928482:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b146f02a00 with x1870605447843712 ext(0->1023) 00002000:00010000:3.0:1783952244.928500:0:24880:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b146f02a00 00000100:00100000:3.0:1783952244.928536:0:24880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1043 00000100:00100000:3.0:1783952244.928545:0:24880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2399:x1870605447843712:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:3.0:1783952244.928983:0:24880:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b146f02a00 x1870605447843712/t4294969014(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.929037:0:24880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2399:x1870605447843712:12345-192.168.202.48@tcp:4:dd.0 Request processed in 493us (1032us total) trans 4294969014 rc 0/0 00000100:00100000:3.0:1783952244.929045:0:24880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1043 00002000:00100000:3.0:1783952244.929052:0:24880:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x791:0x0] (0->1023) req@ffff97b146f02a00 x1870605447843712/t4294969014(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.929059:0:24880:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b146f02a00 with x1870605447843712 ext(0->1023) 00002000:00010000:3.0:1783952244.929063:0:24880:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b146f02a00 00000100:00100000:0.0:1783952244.929177:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.930243:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843840 00000100:00100000:3.0:1783952244.930253:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843840 00000100:00100000:3.0:1783952244.930306:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5024 00000100:00100000:3.0:1783952244.930314:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447843840:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:1.0:1783952244.930668:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969014 is committed 00010000:00000080:3.0:1783952244.930752:0:8494:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b147742d80 x1870605447843840/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.930825:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447843840:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 511us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952244.930832:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5024 00000100:00100000:3.0:1783952244.938492:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.938574:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843968 00000100:00100000:2.0:1783952244.938585:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843968 00002000:00100000:2.0:1783952244.938661:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x792:0x0] (0->1023) req@ffff97b16e9b6a00 x1870605447843968/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952244.938673:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16e9b6a00 with x1870605447843968 ext(0->1023) 00002000:00010000:2.0:1783952244.938679:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16e9b6a00 00000100:00100000:2.0:1783952244.938712:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1044 00000100:00100000:2.0:1783952244.938721:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447843968:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:2.0:1783952244.939125:0:8441:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b16e9b6a00 x1870605447843968/t4294969015(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.939183:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2400:x1870605447843968:12345-192.168.202.48@tcp:4:dd.0 Request processed in 462us (699us total) trans 4294969015 rc 0/0 00000100:00100000:2.0:1783952244.939191:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1044 00002000:00100000:2.0:1783952244.939197:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x792:0x0] (0->1023) req@ffff97b16e9b6a00 x1870605447843968/t4294969015(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783952244.939219:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b16e9b6a00 with x1870605447843968 ext(0->1023) 00002000:00010000:2.0:1783952244.939223:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b16e9b6a00 00000100:00100000:3.0:1783952244.949467:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.949754:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844096 00000100:00100000:2.0:1783952244.949765:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844096 00000100:00100000:2.0:1783952244.950468:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5025 00000100:00100000:2.0:1783952244.950480:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2400:x1870605447844096:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:1.0:1783952244.950809:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969015 is committed 00010000:00000080:2.0:1783952244.953153:0:11961:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14debb480 x1870605447844096/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.953236:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2400:x1870605447844096:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 2758us (3777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.953246:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5025 00000100:00100000:2.0:1783952244.963058:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.963935:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.967402:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844352 00000100:00100000:1.0:1783952244.967417:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844352 00000100:00100000:1.0:1783952244.967521:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5026 00000100:00100000:1.0:1783952244.967532:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447844352:12345-192.168.202.48@tcp:16:kworker.0 00010000:00000080:1.0:1783952244.967616:0:8433:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049d73b80 x1870605447844352/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.967683:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447844352:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 153us (3751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.967691:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5026 00000100:00100000:0.0:1783952244.968623:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844224 00000100:00100000:0.0:1783952244.968632:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844224 00002000:00100000:0.0:1783952244.968664:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x793:0x0] (0->1023) req@ffff97b049d71180 x1870605447844224/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952244.968675:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049d71180 with x1870605447844224 ext(0->1023) 00002000:00010000:0.0:1783952244.968680:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049d71180 00000100:00100000:0.0:1783952244.968703:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1045 00000100:00100000:0.0:1783952244.968711:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2398:x1870605447844224:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:0.0:1783952244.969244:0:8439:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049d71180 x1870605447844224/t4294969016(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952244.969301:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2398:x1870605447844224:12345-192.168.202.48@tcp:4:dd.0 Request processed in 591us (6252us total) trans 4294969016 rc 0/0 00000100:00100000:0.0:1783952244.969308:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1045 00002000:00100000:0.0:1783952244.969314:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x793:0x0] (0->1023) req@ffff97b049d71180 x1870605447844224/t4294969016(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783952244.969321:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b049d71180 with x1870605447844224 ext(0->1023) 00002000:00010000:0.0:1783952244.969325:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b049d71180 00000100:00100000:3.0:1783952244.971500:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.971533:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952244.971949:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844608 00000100:00100000:2.0:1783952244.971959:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844608 00000100:00100000:2.0:1783952244.972005:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5027 00000100:00100000:2.0:1783952244.972014:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2401:x1870605447844608:12345-192.168.202.48@tcp:16:kworker.0 00010000:00000080:2.0:1783952244.972070:0:15187:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14deb8a80 x1870605447844608/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952244.972120:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2401:x1870605447844608:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 108us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952244.972129:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5027 00000100:00100000:1.0:1783952244.973182:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844480 00000100:00100000:1.0:1783952244.973192:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844480 00002000:00100000:1.0:1783952244.973235:0:25538:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x794:0x0] (0->1023) req@ffff97b14deb9180 x1870605447844480/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952244.973247:0:25538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b14deb9180 with x1870605447844480 ext(0->1023) 00002000:00010000:1.0:1783952244.973263:0:25538:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b14deb9180 00000100:00100000:1.0:1783952244.973295:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1046 00000100:00100000:1.0:1783952244.973303:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2401:x1870605447844480:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:1.0:1783952244.973876:0:25538:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b14deb9180 x1870605447844480/t4294969017(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.973997:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2401:x1870605447844480:12345-192.168.202.48@tcp:4:dd.0 Request processed in 694us (2513us total) trans 4294969017 rc 0/0 00000100:00100000:1.0:1783952244.974004:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1046 00002000:00100000:1.0:1783952244.974011:0:25538:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x794:0x0] (0->1023) req@ffff97b14deb9180 x1870605447844480/t4294969017(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783952244.974019:0:25538:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b14deb9180 with x1870605447844480 ext(0->1023) 00002000:00010000:1.0:1783952244.974022:0:25538:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b14deb9180 00000100:00100000:1.0:1783952244.981822:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952244.981868:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952244.982936:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844736 00000100:00100000:3.0:1783952244.982949:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844736 00002000:00100000:3.0:1783952244.983002:0:24879:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x795:0x0] (0->1023) req@ffff97b146f00a80 x1870605447844736/t0(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/0 e 0 to 0 dl 1783952255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.983014:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b146f00a80 with x1870605447844736 ext(0->1023) 00002000:00010000:3.0:1783952244.983019:0:24879:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b146f00a80 00000100:00100000:3.0:1783952244.983060:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1047 00000100:00100000:3.0:1783952244.983070:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2398:x1870605447844736:12345-192.168.202.48@tcp:4:dd.0 00010000:00000080:3.0:1783952244.983423:0:24879:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b146f00a80 x1870605447844736/t4294969018(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952244.983482:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b146f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:2398:x1870605447844736:12345-192.168.202.48@tcp:4:dd.0 Request processed in 414us (1670us total) trans 4294969018 rc 0/0 00000100:00100000:3.0:1783952244.983497:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1047 00002000:00100000:3.0:1783952244.983504:0:24879:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x795:0x0] (0->1023) req@ffff97b146f00a80 x1870605447844736/t4294969018(0) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 1512/448 e 0 to 0 dl 1783952255 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783952244.983523:0:24879:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97b146f00a80 with x1870605447844736 ext(0->1023) 00002000:00010000:3.0:1783952244.983526:0:24879:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97b146f00a80 00000100:00100000:2.0:1783952244.984317:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844864 00000100:00100000:2.0:1783952244.984336:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844864 00000100:00100000:2.0:1783952244.984384:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5028 00000100:00100000:2.0:1783952244.984392:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:2399:x1870605447844864:12345-192.168.202.48@tcp:16:kworker.0 00000001:00080000:1.0:1783952244.984812:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969018 is committed 00010000:00000080:1.0:1783952244.984868:0:26208:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b1518e0a80 x1870605447844864/t0(0) o16->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:505/0 lens 440/432 e 0 to 0 dl 1783952255 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952244.984927:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2399:x1870605447844864:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 533us (3055us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952244.984937:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5028 00010000:00010000:3.0:1783952245.284082:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952245.345059:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465633024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952245.345136:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952245.345295:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465633152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783952245.345325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952245.345358:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465633024 00000100:00100000:2.0:1783952245.345365:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465633024 00000100:00100000:2.0:1783952245.345411:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465633152 00000100:00100000:2.0:1783952245.345414:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465633152 00000100:00100000:2.0:1783952245.345430:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:2.0:1783952245.345438:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465633024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783952245.345461:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783952245.345499:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465633024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952245.345506:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00100000:0.0:1783952245.345720:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465633024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952245.346115:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:3.0:1783952245.346127:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465633152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783952245.346142:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 176799168 pending 0 free 3923529728 avail 3691433984 00010000:00000080:3.0:1783952245.346154:0:8438:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff97b049d72a00 x1870605465633152/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:506/0 lens 224/368 e 0 to 0 dl 1783952256 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952245.346218:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465633152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952245.346225:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00000100:00100000:0.0:1783952245.346968:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465633152:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783952245.347865:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783952245.347873:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783952246.311414:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783952246.316906:0:96042:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1783952246.316971:0:96042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.316989:0:96042:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.316997:0:96042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.317004:0:96042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.317031:0:96042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783952246.317037:0:96042:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783952246.317063:0:96042:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783952246.317078:0:96042:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783952246.317083:0:96042:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783952246.317107:0:96042:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783952246.317161:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465633280:0@lo:39:umount.0 00000100:00100000:0.0:1783952246.317228:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783952246.319049:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783952246.319062:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952246.319073:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86bc00 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:1.0:1783952246.319090:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952246.319099:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783952246.319104:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783952246.319108:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783952246.319110:0:7459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783952246.319113:0:7459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783952246.319143:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952246.319147:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783952246.319174:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952246.319181:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b14d86bc00/0x22c73c7857bb6520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb6527 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783952246.319189:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465633408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952246.319193:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952246.319194:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952246.319196:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952246.319213:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465633280 00000100:00100000:1.0:1783952246.319218:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465633280 00000100:00100000:3.0:1783952246.319247:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952246.319275:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:1.0:1783952246.319284:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b147741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870605465633280:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783952246.319310:0:67035:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb614c 00000100:00080000:1.0:1783952246.319324:0:67035:0:(import.c:65:import_set_state_nolock()) ffff97b0497f1000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783952246.319324:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465633408 00000100:00100000:0.0:1783952246.319329:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465633408 00000100:00100000:0.0:1783952246.319363:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1783952246.319369:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465633408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952246.319378:0:26211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952246.319393:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b140030000/0x22c73c7857bb6527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb6520 expref: 24 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952246.319394:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b147741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3641:x1870605465633280:12345-0@lo:39:umount.0 Request processed in 112us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952246.319402:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00010000:00010000:0.0:1783952246.319406:0:26211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1783952246.319411:0:67035:0:(genops.c:906:class_export_put()) final put ffff97b0497f3000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:1.0:1783952246.319430:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783952246.319432:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3642:x1870605465633408:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952246.319437:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000020:00000080:1.0:1783952246.319463:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b0497f3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1783952246.319473:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1518e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465633408:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1783952246.319501:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b0497f1000 for lustre-MDT0000 00000100:00080000:0.0:1783952246.319510:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b1746ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783952246.319518:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465633280:0@lo:39:umount.0 00010000:00010000:3.0:1783952246.319572:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783952246.319582:0:96042:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783952246.319766:0:96042:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783952246.319784:0:96042:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783952246.322115:0:96042:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783952246.322122:0:96042:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783952246.322129:0:96042:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783952246.322150:0:96042:0:(import.c:65:import_set_state_nolock()) ffff97b176f0b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783952246.322211:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1870605465633536:0@lo:39:umount.0 00000100:00100000:0.0:1783952246.322285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952246.322378:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465633536 00000100:00100000:1.0:1783952246.322386:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465633536 00000100:00080000:3.0:1783952246.322446:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952246.322452:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:1.0:1783952246.322460:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870605465633536:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783952246.322483:0:66237:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bafeea 00000100:00080000:1.0:1783952246.322491:0:66237:0:(import.c:65:import_set_state_nolock()) ffff97b1514b9800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783952246.322526:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952246.322557:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3641:x1870605465633536:12345-0@lo:39:umount.0 Request processed in 98us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952246.322564:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000020:00000080:1.0:1783952246.322573:0:66237:0:(genops.c:906:class_export_put()) final put ffff97b1514bf800/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:0.0:1783952246.322796:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b176f0b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783952246.322820:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1870605465633536:0@lo:39:umount.0 00000020:00000080:3.0:1783952246.323075:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1514bf800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1783952246.323117:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1514b9800 for lustre-MDT0001 00000100:00080000:3.0:1783952246.323128:0:96042:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783952246.323131:0:96042:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783952246.323134:0:96042:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783952246.324411:0:96042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.324428:0:96042:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.324436:0:96042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.324456:0:96042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.324478:0:96042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783952246.324486:0:96042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.324493:0:96042:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.324499:0:96042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.324505:0:96042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.324518:0:96042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783952246.324522:0:96042:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1783952246.324567:0:96042:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1783952246.324571:0:96042:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:3.0:1783952246.324576:0:96042:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1783952246.324581:0:96042:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:2.0:1783952246.324607:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783952246.324614:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.324620:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140031000 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952246.324624:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.324633:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952246.324640:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952246.324653:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783952246.324655:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1783952246.324658:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1783952246.324690:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.324697:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783952246.324722:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.324729:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b140031000/0x22c73c7857bb652e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb6535 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.324742:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783952246.324746:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.324752:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b04db71200 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:2.0:1783952246.324755:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.324761:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783952246.324768:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952246.324791:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465633664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783952246.324852:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952246.324979:0:22092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465633664 00000100:00100000:0.0:1783952246.324985:0:22092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465633664 00000100:00100000:0.0:1783952246.325022:0:22092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1783952246.325030:0:22092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:3643:x1870605465633664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952246.325041:0:22092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783952246.325053:0:22092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b050cbda00/0x22c73c7857bb6535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb652e expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952246.325064:0:22092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783952246.325090:0:22092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3643:x1870605465633664:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952246.325097:0:22092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1783952246.325128:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465633664:0@lo:103:ldlm_bl.0 00002000:00000080:3.0:1783952246.327209:0:96042:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:3.0:1783952246.327264:0:96042:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:3.0:1783952246.327438:0:96042:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:3.0:1783952246.327449:0:96042:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff97b04e288000 d33551be-a709-4ba2-a74c-f4d7b53c6817 192.168.202.48@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294969018 stale:0 00000020:00080000:3.0:1783952246.327456:0:96042:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff97b04965e800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968974 stale:0 00000020:00080000:3.0:1783952246.327462:0:96042:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff97b174b00800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968956 stale:0 00000020:00080000:3.0:1783952246.327481:0:96042:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff97b167c14d40) has exports, disconnecting them 00000020:00080000:3.0:1783952246.327487:0:96042:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.202.48@tcp (ffff97b04e288000), last request at 1783952244 00000020:00000080:3.0:1783952246.327494:0:96042:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb6360 00000020:00010000:3.0:1783952246.327504:0:96042:0:(genops.c:1954:obd_stale_export_put()) Put export ffff97b04e288000: total 0 00000100:00080000:3.0:1783952246.327508:0:96042:0:(import.c:65:import_set_state_nolock()) ffff97b04e28d000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783952246.327538:0:96042:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.48@tcp (ffff97b04e288000): rc 0 00000020:00080000:3.0:1783952246.327542:0:96042:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff97b04965e800), last request at 1783952244 00000020:00000080:3.0:1783952246.327545:0:96042:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bb6011 00000100:00080000:3.0:1783952246.327549:0:96042:0:(import.c:65:import_set_state_nolock()) ffff97b04965f800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1783952246.327564:0:6506:0:(genops.c:1940:obd_stale_export_get()) Get export ffff97b04e288000: total 0 00010000:00010000:0.0:1783952246.327748:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952246.327850:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97b04e288000, canceled 0 locks, left on hash table 20. 00010000:00010000:1.0:1783952246.327879:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783952246.328200:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328204:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328228:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562f73b2/0x22c73c7857bb6ccf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7a6 expref: 21 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328257:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328260:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x791:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328267:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074b8cec9/0x22c73c7857bb6e49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a824 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328282:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328285:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x795:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328291:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073b0deaa/0x22c73c7857bb6ef1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a863 expref: 19 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328307:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328316:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x787:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328325:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d836cae2/0x22c73c7857bb6af3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a713 expref: 18 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328344:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328346:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x786:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328353:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f6b635/0x22c73c7857bb6bd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a752 expref: 17 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328366:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328369:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328375:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539633d7/0x22c73c7857bb6d4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7d0 expref: 16 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328388:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328390:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x793:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328396:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f580c46/0x22c73c7857bb6ea4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a840 expref: 15 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328409:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328411:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x785:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328417:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0d9601/0x22c73c7857bb6b78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a73d expref: 14 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328431:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328434:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328448:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c972c762/0x22c73c7857bb6e11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a80f expref: 13 pid: 26198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328465:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328467:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x788:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328474:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e9c8d92/0x22c73c7857bb6be1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a760 expref: 12 pid: 26196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328488:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328490:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328497:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000384ef6ea/0x22c73c7857bb6c97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a79f expref: 11 pid: 11961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328510:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328512:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x794:0x0] updating lvb blocks from disk: 0 -> 8 10000000:01000000:2.0:1783952246.328512:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783952246.328517:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1783952246.328519:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78fc5d5/0x22c73c7857bb6ee3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a85c expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952246.328520:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00002000:00010000:3.0:1783952246.328534:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328536:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783952246.328542:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068e976bc/0x22c73c7857bb6da1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7ec expref: 9 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783952246.328554:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1783952246.328556:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x783:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783952246.328560:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.328562:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c305c023/0x22c73c7857bb6ade lrc: 0/0,0 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6fe expref: 8 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.328567:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00002000:00010000:3.0:1783952246.328583:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb size from disk: 0 -> 1024 00010000:00010000:2.0:1783952246.328617:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.328625:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b04db71200/0x22c73c7857bb6106 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x22c73c7857bb610d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.328636:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952246.328638:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952246.328640:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952246.329024:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952246.329051:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465633792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783952246.329124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952246.329181:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465633792 00000100:00100000:1.0:1783952246.329188:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465633792 00000100:00100000:1.0:1783952246.329233:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1783952246.329241:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1518e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:3645:x1870605465633792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783952246.329253:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783952246.329266:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762af000/0x22c73c7857bb610d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22c73c7857bb6106 expref: 22 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952246.329291:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783952246.329323:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1518e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3645:x1870605465633792:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952246.329330:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1783952246.329372:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465633792:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1783952246.329960:0:96042:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b04965e800): rc 0 00000020:00000080:2.0:1783952246.329964:0:96042:0:(genops.c:906:class_export_put()) final put ffff97b04965e800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1783952246.329980:0:96042:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff97b174b00800), last request at 1783952245 00000020:00000080:2.0:1783952246.329987:0:96042:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857bafe50 00000100:00080000:2.0:1783952246.329996:0:96042:0:(import.c:65:import_set_state_nolock()) ffff97b176f08800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783952246.330006:0:96042:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b174b00800): rc 0 00000020:00000080:2.0:1783952246.330007:0:96042:0:(genops.c:906:class_export_put()) final put ffff97b174b00800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1783952246.330034:0:96042:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff97b167c14d40) has no exports 00010000:00010000:2.0:1783952246.330090:0:96042:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000a5527b89/0x22c73c7857bb6a98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6e9 expref: 7 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.330110:0:96042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5527b89/0x22c73c7857bb6a98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a6e9 expref: 7 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.330157:0:96042:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6b16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a71a expref: 6 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.330183:0:96042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7b6a7d4/0x22c73c7857bb6b16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a71a expref: 6 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.330261:0:96042:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000087caf4c3/0x22c73c7857bb6c5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a78a expref: 5 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.330273:0:96042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087caf4c3/0x22c73c7857bb6c5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a78a expref: 5 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783952246.330624:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04965e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783952246.330661:0:40998:0:(genops.c:865:class_export_destroy()) destroying export ffff97b174b00800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783952246.330678:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04965f800 for lustre-OST0000 00000020:00000080:1.0:1783952246.330682:0:40998:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b176f08800 for lustre-OST0000 00002000:00010000:3.0:1783952246.330965:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x78c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783952246.331005:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952246.332948:0:96042:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000b54b91cb/0x22c73c7857bb6d0e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7bb expref: 4 pid: 26197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.333046:0:96042:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb6e03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7fa expref: 4 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.333060:0:96042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000379f1d31/0x22c73c7857bb6e03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7fa expref: 4 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.333120:0:96042:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb6e9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a839 expref: 3 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952246.333131:0:96042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a3e279b/0x22c73c7857bb6e9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a839 expref: 3 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.333446:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b54b91cb/0x22c73c7857bb6d0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a7bb expref: 2 pid: 26197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952246.333469:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97b04e288000, canceled 15 locks, left on hash table 0. 00000020:00000080:3.0:1783952246.337899:0:6506:0:(genops.c:906:class_export_put()) final put ffff97b04e288000/d33551be-a709-4ba2-a74c-f4d7b53c6817 00010000:00010000:3.0:1783952246.337927:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952246.337930:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952246.337933:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783952246.338035:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b04e288000/d33551be-a709-4ba2-a74c-f4d7b53c6817 for lustre-OST0000 00000020:00000080:1.0:1783952246.338099:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b04e28d000 for lustre-OST0000 00000020:01000000:0.0:1783952246.338243:0:96042:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b047465780 - data ffff97b1655eb288/ffff97b0478b2800 00000020:01000000:0.0:1783952246.338377:0:96042:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97b14ef441e0 - data ffff97b165616510/ffff97b0459b3800 00100000:10000000:0.0:1783952246.357519:0:96042:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783952246.366320:0:96042:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857b6fcec 00000020:00000080:2.0:1783952246.366336:0:96042:0:(genops.c:906:class_export_put()) final put ffff97b1746cf000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1783952246.366361:0:96042:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b174849000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1783952246.366365:0:96042:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174849000 2 00000020:01000004:2.0:1783952246.366367:0:96042:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97b174849000 from lustre-OST0000 00000020:00000080:2.0:1783952246.366395:0:96042:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783952246.366408:0:96042:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1783952246.366411:0:96042:0:(genops.c:906:class_export_put()) final put ffff97b1746ce800/lustre-OST0000_UUID 00000020:00000080:2.0:1783952246.366414:0:96042:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1746ce800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1783952246.366420:0:96042:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:1.0:1783952246.366451:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b1746cf000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1783952246.367961:0:96042:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1783952246.367967:0:96042:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783952246.367971:0:96042:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783952246.367986:0:96042:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783952246.367993:0:96042:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97b176bcc000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783952246.368000:0:96042:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff97b174b38000) has exports, disconnecting them 00000020:00080000:2.0:1783952246.368005:0:96042:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97b176bcc000), last request at 1783948516 00000020:00000080:2.0:1783952246.368010:0:96042:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857b6fd16 00000020:00080000:2.0:1783952246.368150:0:96042:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b176bcc000): rc 0 00000020:00000080:2.0:1783952246.368156:0:96042:0:(genops.c:906:class_export_put()) final put ffff97b176bcc000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783952246.368227:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176bcc000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1783952246.372706:0:96042:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783952246.372715:0:96042:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783952246.372720:0:96042:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783952246.372728:0:96042:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783952246.372963:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b1746ca800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783952246.373020:0:96042:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783952246.373033:0:96042:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1783952246.373039:0:96042:0:(genops.c:906:class_export_put()) final put ffff97b176bc9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1783952246.373054:0:96042:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176bc9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1783952246.373066:0:96042:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1783952246.373156:0:96042:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783952246.373160:0:96042:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783952246.373167:0:96042:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783952246.373175:0:96042:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff97b15036a800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783952246.373181:0:96042:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff97b0465d19c0) has exports, disconnecting them 00000020:00080000:3.0:1783952246.373185:0:96042:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff97b15036a800), last request at 1783948516 00000020:00000080:3.0:1783952246.373189:0:96042:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857b6fd2b 00000020:00080000:3.0:1783952246.373212:0:96042:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97b15036a800): rc 0 00000020:00000080:3.0:1783952246.373218:0:96042:0:(genops.c:906:class_export_put()) final put ffff97b15036a800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783952246.373760:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b15036a800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1783952246.380825:0:96042:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783952246.380834:0:96042:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783952246.380839:0:96042:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783952246.380847:0:96042:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783952246.380989:0:96042:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783952246.381004:0:96042:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1783952246.381025:0:96042:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b174849000 1 00000020:00000080:0.0:1783952246.381032:0:96042:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22c73c7857b6fcb4 00000020:00000080:0.0:1783952246.381040:0:96042:0:(genops.c:906:class_export_put()) final put ffff97b176d54800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1783952246.381045:0:96042:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1783952246.381050:0:96042:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783952246.381055:0:96042:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783952246.381058:0:96042:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff97b174b43380) has no exports 00000020:00000080:1.0:1783952246.381810:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97b176f0b800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783952246.381818:0:8:0:(genops.c:906:class_export_put()) final put ffff97b176bc8000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1783952246.381821:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176bc8000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1783952246.381827:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1783952246.381916:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97b176d54800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783952246.409424:0:96042:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783952246.409441:0:96042:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783952246.409447:0:96042:0:(genops.c:906:class_export_put()) final put ffff97b17484b800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783952246.409452:0:96042:0:(genops.c:865:class_export_destroy()) destroying export ffff97b17484b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783952246.409464:0:96042:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783952246.409582:0:96042:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97b17484c000 00000020:02000400:3.0:1783952246.409671:0:96042:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1783952247.330567:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952248.353001:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952248.929012:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465634048:0@lo:400:kworker.0 00000100:00100000:1.0:1783952248.929093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952248.932315:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465634048 00000100:00100000:2.0:1783952248.932341:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465634048 00000100:00100000:2.0:1783952248.932410:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783952248.932420:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3645:x1870605465634048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952248.932516:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3645:x1870605465634048:12345-0@lo:400:kworker.0 Request processed in 98us (3423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952248.932541:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1783952248.938013:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465633920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952248.938873:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465634176:0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.938961:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952248.939441:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952248.940147:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465633920 00000100:00100000:3.0:1783952248.940285:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465633920 00000100:00100000:3.0:1783952248.940356:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:3.0:1783952248.940368:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465633920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952248.940423:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:0.0:1783952248.940469:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465634176 00000100:00100000:0.0:1783952248.940483:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465634176 00000100:00100000:3.0:1783952248.940501:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465633920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952248.940512:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:0.0:1783952248.940615:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:3.0:1783952248.940623:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465633920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952248.940632:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465634176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.940735:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465634176:12345-0@lo:400:kworker.0 Request processed in 108us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952248.940742:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1783952248.940810:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465634176:0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.940916:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465634304:0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.940967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952248.941022:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783952248.941028:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465634432:0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.941057:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952248.941083:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465634432 00000100:00100000:0.0:1783952248.941088:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465634432 00000100:00100000:0.0:1783952248.941122:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:0.0:1783952248.941129:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465634432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.941186:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465634432:12345-0@lo:400:kworker.0 Request processed in 56us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952248.941193:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:0.0:1783952248.941223:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465634432:0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.941264:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783952248.941272:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465634560:0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.941301:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952248.942531:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465634560 00000100:00100000:2.0:1783952248.942546:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465634560 00000100:00100000:2.0:1783952248.942627:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5029 00000100:00100000:2.0:1783952248.942636:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3643:x1870605465634560:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783952248.942647:0:26205:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783952248.942681:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465634304 00000100:00100000:1.0:1783952248.942691:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465634304 00000100:00100000:2.0:1783952248.942900:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3643:x1870605465634560:12345-0@lo:400:kworker.0 Request processed in 262us (1595us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783952248.942910:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5029 00000100:00080000:3.0:1783952248.943946:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952248.943955:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783952248.949604:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:1.0:1783952248.949626:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465634304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952248.949735:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465634304:12345-0@lo:400:kworker.0 Request processed in 118us (8768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952248.949743:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:1.0:1783952248.949814:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465634304:0@lo:400:kworker.0 00000100:00100000:1.0:1783952248.949852:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465634048:0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.954083:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465634688:0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.954176:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783952248.954238:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783952248.954243:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783952248.954247:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1783952248.955260:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465634688 00000100:00100000:3.0:1783952248.955278:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465634688 00000100:00100000:3.0:1783952248.955373:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:3.0:1783952248.955387:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465634688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952248.955492:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465634688:12345-0@lo:400:kworker.0 Request processed in 109us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952248.955522:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00080000:3.0:1783952248.955548:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952248.962427:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783952248.962451:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465634816:0@lo:400:kworker.0 00000100:00100000:1.0:1783952248.962521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952248.962570:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465634816 00000100:00100000:1.0:1783952248.962577:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465634816 00000100:00100000:1.0:1783952248.962644:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:1.0:1783952248.962652:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465634816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952248.962707:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465634816:12345-0@lo:400:kworker.0 Request processed in 55us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952248.962714:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:1.0:1783952248.962768:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465634816:0@lo:400:kworker.0 00000100:00100000:1.0:1783952248.962804:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465634944:0@lo:400:kworker.0 00000100:00100000:1.0:1783952248.962830:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952248.962857:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465634944 00000100:00100000:1.0:1783952248.962861:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465634944 00000100:00100000:1.0:1783952248.962884:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5030 00000100:00100000:1.0:1783952248.962888:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3645:x1870605465634944:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783952248.962894:0:26200:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783952248.962939:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3645:x1870605465634944:12345-0@lo:400:kworker.0 Request processed in 47us (106us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783952248.962946:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5030 00000100:00080000:1.0:1783952248.962972:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783952248.962977:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783952248.962981:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1783952248.962996:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1783952248.962998:0:3645:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952248.963133:0:3645:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3907 00000100:00080000:1.0:1783952248.963141:0:3645:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b143af6800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:1.0:1783952248.963171:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1447b2680 x1870605465635072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952248.963193:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465634944:0@lo:400:kworker.0 00000100:00100000:1.0:1783952248.963277:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465635072:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:1.0:1783952248.963303:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952248.963403:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465635072 00000100:00100000:1.0:1783952248.963408:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465635072 00000100:00100000:1.0:1783952248.963431:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5031 00000100:00100000:1.0:1783952248.963436:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3641:x1870605465635072:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:1.0:1783952248.963460:0:26199:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783952248.963492:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3641:x1870605465635072:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 55us (188us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783952248.963499:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5031 00000100:00080000:1.0:1783952248.963521:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783952248.963525:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783952248.963535:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465635072:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:3.0:1783952248.963678:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465635200:0@lo:400:kworker.0 00000100:00100000:3.0:1783952248.963712:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952248.963732:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783952248.963738:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465635328:0@lo:400:kworker.0 00000100:00100000:3.0:1783952248.963773:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952248.963799:0:26198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465635200 00000100:00100000:3.0:1783952248.963803:0:26198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465635200 00000100:00100000:3.0:1783952248.963841:0:26198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:3.0:1783952248.963848:0:26198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465635200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952248.963887:0:26198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465635200:12345-0@lo:400:kworker.0 Request processed in 39us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952248.963894:0:26198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00100000:3.0:1783952248.963912:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465635328 00000100:00100000:3.0:1783952248.963915:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465635328 00000100:00100000:3.0:1783952248.963938:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1783952248.963944:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465635328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952248.963975:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465635328:12345-0@lo:400:kworker.0 Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952248.963982:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00080000:3.0:1783952248.964000:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952248.964043:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465635328:0@lo:400:kworker.0 00000100:00100000:3.0:1783952248.964053:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465635200:0@lo:400:kworker.0 00000004:00080000:0.0:1783952248.985508:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1783952248.985522:0:3643:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952248.985536:0:3643:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3027 00000100:00080000:0.0:1783952248.985550:0:3643:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff97b15f80e000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952248.985629:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049c32a00 x1870605465635456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952248.985669:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465634560:0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.985770:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465634688:0@lo:400:kworker.0 00000100:00100000:0.0:1783952248.985809:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465635456:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:0.0:1783952248.985896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952248.985954:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465635456 00000100:00100000:0.0:1783952248.985976:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465635456 00000100:00100000:0.0:1783952248.986023:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5032 00000100:00100000:0.0:1783952248.986032:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1870605465635456:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:0.0:1783952248.986061:0:8436:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952248.986108:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1870605465635456:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 75us (212us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952248.986116:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5032 00000100:00080000:0.0:1783952248.986153:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783952248.986158:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783952248.986162:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465635456:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1783952249.326542:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952249.326629:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952249.326665:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952249.326700:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952249.326728:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952249.326775:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447845120 00000100:00100000:1.0:1783952249.326796:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447845120 00000100:00100000:1.0:1783952249.326883:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447845248 00000100:00100000:1.0:1783952249.326887:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447845248 00000100:00100000:1.0:1783952249.326915:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1479 00000100:00100000:1.0:1783952249.326927:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+151:2398:x1870605447845120:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952249.327036:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+151:2398:x1870605447845120:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 112us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952249.327045:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1479 00000100:00100000:1.0:1783952249.327065:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1480 00000100:00100000:1.0:1783952249.327071:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2398:x1870605447845248:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952249.327109:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2398:x1870605447845248:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 38us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952249.327115:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1480 00000100:00080000:1.0:1783952249.327133:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952249.327138:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952249.327451:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844992 00000100:00100000:3.0:1783952249.327472:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844992 00000100:00100000:3.0:1783952249.327515:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 183 00000100:00100000:3.0:1783952249.327523:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447844992:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952249.327555:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2398:x1870605447844992:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 34us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952249.327562:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 183 00000100:00100000:2.0:1783952249.328113:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447845376 00000100:00100000:2.0:1783952249.328119:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447845376 00000100:00100000:2.0:1783952249.328154:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447845504 00000100:00100000:2.0:1783952249.328157:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447845504 00000100:00100000:2.0:1783952249.328189:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2924 00000100:00100000:2.0:1783952249.328197:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447845504:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952249.328240:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2398:x1870605447845504:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 45us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952249.328247:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2924 00000100:00100000:2.0:1783952249.328273:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5033 00000100:00100000:2.0:1783952249.330034:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1870605447845376:12345-192.168.202.48@tcp:400:kworker.0 00000020:00080000:2.0:1783952249.330065:0:11961:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.48@tcp 00000100:00100000:2.0:1783952249.330157:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1870605447845376:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 1876us (3526us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783952249.330168:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5033 00000100:00080000:1.0:1783952249.332564:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952249.342051:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952249.345980:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447845632 00000100:00100000:3.0:1783952249.346004:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447845632 00000100:00100000:2.0:1783952249.346296:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5034 00000100:00100000:2.0:1783952249.346308:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2397:x1870605447845632:12345-192.168.202.48@tcp:8:ptlrpcd_00_00.0 00010000:00020000:2.0:1783952249.346348:0:26204:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952249.346439:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2397:x1870605447845632:12345-192.168.202.48@tcp:8:ptlrpcd_00_00.0 Request processed in 132us (4404us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952249.346446:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5034 00010000:00010000:1.0:1783952249.377384:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952249.441245:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465635584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952249.441353:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952249.441434:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465635584 00000100:00100000:1.0:1783952249.441445:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465635584 00000100:00100000:1.0:1783952249.441509:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283 00000100:00100000:1.0:1783952249.441520:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465635584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952249.441564:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952249.441651:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465635584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952249.441660:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283 00000100:00100000:1.0:1783952249.441724:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465635584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952249.442464:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465635712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952249.442517:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952249.442623:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465635712 00000100:00100000:2.0:1783952249.442629:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465635712 00000100:00100000:2.0:1783952249.442674:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:2.0:1783952249.442684:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465635712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952249.442721:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:2.0:1783952249.442780:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465635712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952249.442797:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:0.0:1783952249.442955:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465635712:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1783952249.955067:0:94405:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051730 is committed 00010000:00010000:3.0:1783952249.955247:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955259:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955267:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955273:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b1742c3600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.955278:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955286:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955303:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff97b158d55300) 00010000:00010000:3.0:1783952249.955307:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.955311:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955318:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b1742c3600/0x22c73c7857bb6a60 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955350:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955356:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955362:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955378:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2d600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.955382:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955388:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955396:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff97b158d55700) 00010000:00010000:3.0:1783952249.955398:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.955401:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955406:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b047b2d600/0x22c73c7857bb6ac2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955418:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955425:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955431:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955442:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86ba00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.955445:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955451:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955460:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff97b158d55200) 00010000:00010000:3.0:1783952249.955462:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.955465:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955471:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86ba00/0x22c73c7857bb6ad7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955484:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955490:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955496:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955501:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86b200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.955504:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955510:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955527:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff97b176e45f00) 00010000:00010000:3.0:1783952249.955530:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.955532:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955538:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86b200/0x22c73c7857bb6afa lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955562:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955569:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955575:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955580:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499d200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.955583:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955617:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955625:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff97b158d55f00) 00010000:00010000:3.0:1783952249.955628:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.955631:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955637:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499d200/0x22c73c7857bb6b5c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955658:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955665:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955671:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955676:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.955679:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955686:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955694:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff97b158d55900) 00010000:00010000:3.0:1783952249.955696:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.955699:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955705:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22600/0x22c73c7857bb6b9b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955715:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955720:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955725:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955735:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.955738:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955756:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955775:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff97b176e45c00) 00010000:00010000:3.0:1783952249.955777:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.955781:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955787:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23000/0x22c73c7857bb6bda lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955799:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955806:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955812:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955817:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d22a00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.955820:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955825:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955841:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff97b176e45600) 00010000:00010000:3.0:1783952249.955843:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.955846:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955852:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d22a00/0x22c73c7857bb6c19 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955863:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955869:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955875:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955880:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.955883:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955890:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955897:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff97b15f403300) 00010000:00010000:3.0:1783952249.955900:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.955903:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955909:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c000/0x22c73c7857bb6c89 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955929:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955935:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955940:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955944:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.955947:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955953:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955961:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff97b158d55d00) 00010000:00010000:3.0:1783952249.955963:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.955965:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955971:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d000/0x22c73c7857bb6c90 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955982:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955988:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.955994:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956005:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644de00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.956008:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956014:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956022:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff97b143007200) 00010000:00010000:3.0:1783952249.956024:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.956027:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956032:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644de00/0x22c73c7857bb6cd6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956044:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956050:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956057:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956062:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644c400 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.956065:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956070:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956088:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff97b143007300) 00010000:00010000:3.0:1783952249.956090:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.956093:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956099:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644c400/0x22c73c7857bb6d15 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 83761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956111:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956116:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956121:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956127:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b14d86a000 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.956129:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956135:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956142:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff97b143007600) 00010000:00010000:3.0:1783952249.956144:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.956147:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956153:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b14d86a000/0x22c73c7857bb6d54 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956176:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956182:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956188:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956193:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23600 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.956196:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956201:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956209:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff97b176e45800) 00010000:00010000:3.0:1783952249.956211:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.956213:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956219:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23600/0x22c73c7857bb6d9a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956228:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956234:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956240:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956251:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b176d23e00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.956254:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956260:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956268:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff97b158d55800) 00010000:00010000:3.0:1783952249.956270:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.956273:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956278:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b176d23e00/0x22c73c7857bb6dcb lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956290:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956296:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956302:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956306:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17644d200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.956309:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956315:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956333:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff97b158d55e00) 00010000:00010000:3.0:1783952249.956336:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.956339:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956344:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17644d200/0x22c73c7857bb6e0a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956355:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956360:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956366:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956371:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499dc00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.956373:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956380:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956388:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff97b15f403100) 00010000:00010000:3.0:1783952249.956390:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.956393:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956398:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b17499dc00/0x22c73c7857bb6e50 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956419:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956425:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956431:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956436:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030800 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.956439:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956445:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956454:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff97b176e45b00) 00010000:00010000:3.0:1783952249.956456:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.956459:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956465:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030800/0x22c73c7857bb6e88 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956476:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956482:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956489:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956499:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b050cbce00 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.956502:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.956508:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.957085:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff97b1584d4700) 00010000:00010000:3.0:1783952249.957090:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.957094:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.957101:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b050cbce00/0x22c73c7857bb6ece lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 68591 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.957115:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.957122:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.957128:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.957134:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b140030200 already unused, calling callback (ffffffffc19bd4f0) 00010000:00010000:3.0:1783952249.957137:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.957144:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.957167:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff97b1584d4a00) 00010000:00010000:3.0:1783952249.957169:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783952249.957172:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952249.957177:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97b140030200/0x22c73c7857bb6eea lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952250.406792:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952250.468298:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952250.468324:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465635840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952250.468410:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952250.468459:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465635840 00000100:00100000:1.0:1783952250.468467:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465635840 00000100:00100000:1.0:1783952250.468522:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:1.0:1783952250.468531:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465635840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952250.468553:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952250.468612:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465635840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952250.468619:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00000100:00080000:1.0:1783952250.468637:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952250.468670:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465635840:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783952251.429877:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952252.453037:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952253.482466:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783952253.632845:0:96387:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00000100:00080000:0.0:1783952254.049566:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952254.049573:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783952254.049577:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952254.049585:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3963 00000100:00100000:1.0:1783952254.049640:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465635968:0@lo:400:kworker.0 00000100:00080000:0.0:1783952254.049685:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783952254.049692:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff97b15f80e000 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952254.049726:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049c33800 x1870605465636480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952254.049736:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783952254.049760:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952254.049763:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783952254.049770:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952254.049774:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3963 00000100:00080000:0.0:1783952254.049776:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1783952254.049781:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465636608:0@lo:400:kworker.0 00000100:00080000:0.0:1783952254.049781:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b143af6800 using connection 192.168.202.148@tcp/0@lo 00000100:00100000:0.0:1783952254.049793:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049c33480 x1870605465636992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952254.049819:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952254.049831:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465636096:0@lo:400:kworker.0 00000100:00100000:1.0:1783952254.049850:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465637248:0@lo:400:kworker.0 00000100:00100000:0.0:1783952254.049862:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952254.049880:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465636608 00000100:00100000:0.0:1783952254.049883:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465636736:0@lo:400:kworker.0 00000100:00100000:1.0:1783952254.049887:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465636608 00000100:00100000:0.0:1783952254.049902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952254.049918:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783952254.049922:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465636224:0@lo:400:kworker.0 00000100:00100000:1.0:1783952254.049939:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:0.0:1783952254.049942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952254.049948:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465636608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952254.049955:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465636864:0@lo:400:kworker.0 00000100:00100000:0.0:1783952254.049977:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952254.050003:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465636608:12345-0@lo:400:kworker.0 Request processed in 56us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952254.050010:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000100:00080000:1.0:1783952254.050031:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952254.050043:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465636096 00000100:00100000:1.0:1783952254.050047:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465636096 00000100:00100000:0.0:1783952254.050068:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465636480:0@lo:8:kworker.0 00000100:00100000:1.0:1783952254.050077:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465636736 00000100:00100000:1.0:1783952254.050079:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465636736 00000100:00100000:1.0:1783952254.050094:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465636224 00000100:00100000:1.0:1783952254.050096:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465636224 00000100:00100000:1.0:1783952254.050115:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:1.0:1783952254.050121:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465636096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952254.050156:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465636096:12345-0@lo:400:kworker.0 Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952254.050163:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:0.0:1783952254.050168:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952254.050175:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:1.0:1783952254.050180:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465636736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952254.050185:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465636992:0@lo:8:kworker.0 00000100:00100000:0.0:1783952254.050205:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952254.050207:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465636736:12345-0@lo:400:kworker.0 Request processed in 28us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952254.050220:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:1.0:1783952254.050231:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1783952254.050237:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465636224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952254.050248:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465636864 00000100:00100000:0.0:1783952254.050251:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465636864 00000100:00100000:1.0:1783952254.050266:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465636224:12345-0@lo:400:kworker.0 Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952254.050271:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:0.0:1783952254.050277:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:0.0:1783952254.050282:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465636864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952254.050314:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465636864:12345-0@lo:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952254.050329:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:0.0:1783952254.050349:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465636480 00000100:00100000:0.0:1783952254.050353:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465636480 00000100:00100000:0.0:1783952254.050370:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465636992 00000100:00100000:0.0:1783952254.050373:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465636992 00000100:00100000:0.0:1783952254.050388:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5035 00000100:00100000:0.0:1783952254.050392:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3641:x1870605465636480:12345-0@lo:8:kworker.0 00000100:00080000:1.0:1783952254.050490:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952254.050493:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783952254.050631:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465636352:0@lo:400:kworker.0 00000100:00100000:2.0:1783952254.050661:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952254.050691:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465637120:0@lo:400:kworker.0 00000100:00100000:2.0:1783952254.050753:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952254.050784:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465635968 00000100:00100000:2.0:1783952254.050788:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465635968 00010000:00020000:0.0:1783952254.050841:0:26207:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783952254.050877:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3641:x1870605465636480:12345-0@lo:8:kworker.0 Request processed in 484us (708us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783952254.050885:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5035 00000100:00100000:0.0:1783952254.050895:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465637120 00000100:00100000:0.0:1783952254.050898:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465637120 00000100:00100000:0.0:1783952254.050927:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:0.0:1783952254.050933:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465637120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952254.050943:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783952254.050954:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3643:x1870605465635968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952254.050967:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465637120:12345-0@lo:400:kworker.0 Request processed in 35us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952254.050973:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00100000:2.0:1783952254.050982:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17507a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3643:x1870605465635968:12345-0@lo:400:kworker.0 Request processed in 31us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952254.051046:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783952254.051089:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5036 00000100:00100000:2.0:1783952254.051094:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17738fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3641:x1870605465636992:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783952254.051105:0:26205:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952254.051132:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17738fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3641:x1870605465636992:12345-0@lo:8:kworker.0 Request processed in 37us (926us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952254.051138:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5036 00000100:00100000:1.0:1783952254.051322:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465636352 00000100:00100000:1.0:1783952254.051326:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465636352 00000100:00100000:3.0:1783952254.054437:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783952254.054459:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465637376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952254.054520:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952254.068814:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465637376 00000100:00100000:1.0:1783952254.068829:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465637376 00000100:00100000:1.0:1783952254.068871:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:1.0:1783952254.068883:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465636352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952254.068985:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465636352:12345-0@lo:400:kworker.0 Request processed in 104us (18322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952254.068992:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00100000:1.0:1783952254.069009:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:1.0:1783952254.069016:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465637376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783952254.069042:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:1.0:1783952254.069083:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465637376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (14562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952254.069090:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:1.0:1783952254.069151:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465637376:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1783952254.070384:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952254.071067:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465636352:0@lo:400:kworker.0 00000100:00100000:1.0:1783952254.071107:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465637120:0@lo:400:kworker.0 00000100:00080000:2.0:1783952254.071197:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952254.071203:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952254.071207:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465636480:0@lo:8:kworker.0 00000100:00080000:2.0:1783952254.071218:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952254.071221:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783952254.071225:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465636992:0@lo:8:kworker.0 00000100:00100000:2.0:1783952254.071259:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465636224:0@lo:400:kworker.0 00000100:00100000:2.0:1783952254.071271:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465636864:0@lo:400:kworker.0 00000100:00100000:2.0:1783952254.071284:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465636096:0@lo:400:kworker.0 00000100:00100000:2.0:1783952254.071310:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465636736:0@lo:400:kworker.0 00000100:00100000:2.0:1783952254.071342:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952254.071398:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465636608:0@lo:400:kworker.0 00000100:00100000:2.0:1783952254.071409:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465635968:0@lo:400:kworker.0 00000100:00100000:1.0:1783952254.071537:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465637248 00000100:00100000:1.0:1783952254.071544:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465637248 00000100:00100000:1.0:1783952254.071614:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1783952254.071622:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465637248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952254.071694:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465637248:12345-0@lo:400:kworker.0 Request processed in 73us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952254.071710:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1783952254.071742:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465637248:0@lo:400:kworker.0 00000100:00100000:1.0:1783952254.446762:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952254.446801:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952254.446829:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952254.446859:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952254.446868:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447846272 00000100:00100000:0.0:1783952254.446877:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447846272 00000100:00100000:1.0:1783952254.446882:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447845888 00000100:00100000:1.0:1783952254.446884:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447845888 00000100:00100000:2.0:1783952254.446930:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447846016 00000100:00100000:2.0:1783952254.446934:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447846016 00000100:00100000:0.0:1783952254.446938:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2927 00000100:00100000:0.0:1783952254.446946:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447846272:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952254.446977:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447845760 00000100:00100000:3.0:1783952254.446981:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447845760 00000100:00100000:3.0:1783952254.447011:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 185 00000100:00100000:3.0:1783952254.447017:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2399:x1870605447845760:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952254.447018:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447846272:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 73us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952254.447025:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2927 00000100:00100000:3.0:1783952254.447043:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2399:x1870605447845760:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 27us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952254.447048:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 185 00000100:00100000:1.0:1783952254.448884:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1485 00000100:00100000:1.0:1783952254.448897:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04ef1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2399:x1870605447845888:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952254.448958:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04ef1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2399:x1870605447845888:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 65us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952254.448965:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1485 00000100:00100000:2.0:1783952254.449786:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1486 00000100:00100000:2.0:1783952254.449796:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447846016:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952254.449863:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447846016:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 62us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952254.449871:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1486 00000100:00100000:2.0:1783952254.449926:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952254.450006:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447846144 00000100:00100000:2.0:1783952254.450014:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447846144 00000100:00100000:2.0:1783952254.450039:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5037 00000100:00100000:2.0:1783952254.450044:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1870605447846144:12345-192.168.202.48@tcp:8:kworker.0 00010000:00020000:2.0:1783952254.450404:0:8494:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783952254.450611:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1870605447846144:12345-192.168.202.48@tcp:8:kworker.0 Request processed in 542us (662us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952254.450618:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5037 00000100:00080000:0.0:1783952254.451799:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952254.451807:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952254.451810:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783952254.497856:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952254.560899:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952254.560925:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465637504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952254.560996:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952254.561078:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465637504 00000100:00100000:1.0:1783952254.561086:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465637504 00000100:00100000:1.0:1783952254.561141:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285 00000100:00100000:1.0:1783952254.561150:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465637504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952254.561183:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952254.561244:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465637504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952254.561251:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285 00000100:00100000:1.0:1783952254.561296:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465637504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952254.565560:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465637632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952254.565670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952254.565890:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465637632 00000100:00100000:3.0:1783952254.565898:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465637632 00000100:00100000:3.0:1783952254.565953:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:3.0:1783952254.565964:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465637632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783952254.566000:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:3.0:1783952254.566046:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465637632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952254.566069:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:2.0:1783952254.566200:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465637632:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783952255.523465:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1783952255.584698:0:75705:0:(genops.c:1231:class_import_get()) import ffff97b166f50000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783952255.584740:0:75705:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000028b968cc] to pc [ptlrpcd_00_01+1] req@ffff97b1447b2a00 x1870605465637760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952255.584918:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b2a00 x1870605465637760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952255.584933:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465637760:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1783952255.584963:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b2a00 x1870605465637760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952271 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952255.584971:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952255.585009:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b144731f80 x1870605465637760 msgsize 224 00000100:00100000:0.0:1783952255.585014:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952255.585036:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b2a00 x1870605465637760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952271 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952255.585049:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5525 usecs (6 jiffies) 00000100:00100000:0.0:1783952255.585081:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465637760 00000100:00100000:0.0:1783952255.585088:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465637760 00000020:00000040:0.0:1783952255.585091:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe7a 00000020:00000040:0.0:1783952255.585094:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b143cde000 refcount=5 00000100:00000040:0.0:1783952255.585115:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1783952255.585140:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286 00000100:00000040:0.0:1783952255.585144:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b143cde000 : new rpc_count 1 00000100:00000040:0.0:1783952255.585149:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b144731f80 x1870605465637760/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:516/0 lens 224/0 e 0 to 0 dl 1783952266 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952255.585161:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465637760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952255.585186:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1783952255.585198:0:8438:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870605465637760 00000100:00000040:0.0:1783952255.585208:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952255.585213:0:8438:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952255.585240:0:8438:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b1447b2a00 x1870605465637760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952271 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952255.585257:0:8438:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952255.585262:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b144731f80 x1870605465637760/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:516/0 lens 224/368 e 0 to 0 dl 1783952266 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952255.585272:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465637760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952255.585278:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286 00000100:00000040:0.0:1783952255.585281:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b143cde000 : new rpc_count 0 00000020:00000040:0.0:1783952255.585291:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff97b143cde000 : new refcount 4 00000100:00000040:0.0:1783952255.585324:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:0.0:1783952255.585329:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b2a00 x1870605465637760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1783952255.585339:0:3643:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1783952255.585342:0:3643:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1783952255.585350:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b2a00 x1870605465637760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952271 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952255.585356:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465637760:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1783952255.585362:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b2a00 x1870605465637760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952271 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952255.585370:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b166f50000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:0.0:1783952256.545256:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952257.569647:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952258.593807:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1783952259.170908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952259.170934:0:8:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000100:00000040:0.0:1783952259.170970:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS req@ffff97b144732d80 x1870605465637888/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171002:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bac6adf0] to pc [ptlrpcd_00_02+2] req@ffff97b144732d80 x1870605465637888/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171032:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952259.171038:0:8:0:(genops.c:1231:class_import_get()) import ffff97b046b43800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1783952259.171046:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff97b144731500 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171056:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000faf7ae07] to pc [ptlrpcd_00_03+3] req@ffff97b144731500 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171064:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952259.171069:0:8:0:(genops.c:1231:class_import_get()) import ffff97b046a94800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1783952259.171075:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff97b144731180 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171084:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e1074838] to pc [ptlrpcd_00_00+0] req@ffff97b144731180 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952259.171106:0:8:0:(genops.c:1231:class_import_get()) import ffff97b048caf800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1783952259.171111:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff97b144730e00 x1870605465638272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171119:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006c3ae14d] to pc [ptlrpcd_00_01+1] req@ffff97b144730e00 x1870605465638272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952259.171126:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952259.171130:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783952259.171134:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952259.171144:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3968 00000100:00080000:0.0:1783952259.171151:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:0.0:1783952259.171154:0:8:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 50 to 0@lo 00000100:00000040:0.0:1783952259.171158:0:8:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 51 to 0@lo 00000020:00000040:0.0:1783952259.171162:0:8:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe49 00000020:00000040:0.0:1783952259.171169:0:8:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b14f00b000 refcount=4 00000100:00000040:0.0:1783952259.171172:0:8:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 50 to 0@lo 00000100:00000040:0.0:1783952259.171175:0:8:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 51 to 0@lo 00000020:00000040:0.0:1783952259.171178:0:8:0:(genops.c:900:class_export_put()) PUTting export ffff97b14f00b000 : new refcount 3 00000100:00080000:0.0:1783952259.171181:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff97b15f80e000 using connection 192.168.202.148@tcp/0@lo 00000020:00000040:0.0:1783952259.171195:0:8:0:(genops.c:1231:class_import_get()) import ffff97b15f80e000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1783952259.171208:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b144733100 x1870605465638400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171216:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b37b1982] to pc [ptlrpcd_rcv+-1] req@ffff97b144733100 x1870605465638400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171229:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952259.171239:0:8:0:(genops.c:1231:class_import_get()) import ffff97b166f50000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1783952259.171246:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff97b1756e0380 x1870605465638528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171254:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000043005a9a] to pc [ptlrpcd_00_02+2] req@ffff97b1756e0380 x1870605465638528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171261:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952259.171265:0:8:0:(genops.c:1231:class_import_get()) import ffff97b0410da800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1783952259.171270:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff97b1756e2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171277:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d343e21a] to pc [ptlrpcd_00_03+3] req@ffff97b1756e2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171288:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952259.171293:0:8:0:(genops.c:1231:class_import_get()) import ffff97b15036a000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1783952259.171299:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff97b1756e0000 x1870605465638784/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171306:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000047b77710] to pc [ptlrpcd_00_00+0] req@ffff97b1756e0000 x1870605465638784/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952259.171313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952259.171316:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783952259.171318:0:8:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952259.171322:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3968 00000100:00080000:0.0:1783952259.171324:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:0.0:1783952259.171327:0:8:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 50 to 0@lo 00000100:00000040:0.0:1783952259.171329:0:8:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 51 to 0@lo 00000020:00000040:0.0:1783952259.171331:0:8:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5ffc 00000020:00000040:0.0:1783952259.171333:0:8:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04e288800 refcount=4 00000100:00000040:0.0:1783952259.171336:0:8:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 50 to 0@lo 00000100:00000040:0.0:1783952259.171338:0:8:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 51 to 0@lo 00000020:00000040:0.0:1783952259.171340:0:8:0:(genops.c:900:class_export_put()) PUTting export ffff97b04e288800 : new refcount 3 00000100:00080000:0.0:1783952259.171343:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b143af6800 using connection 192.168.202.148@tcp/0@lo 00000020:00000040:0.0:1783952259.171348:0:8:0:(genops.c:1231:class_import_get()) import ffff97b143af6800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1783952259.171357:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b1756e1f80 x1870605465638912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171366:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000fdcfe5b] to pc [ptlrpcd_rcv+-1] req@ffff97b1756e1f80 x1870605465638912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171373:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952259.171384:0:8:0:(genops.c:1231:class_import_get()) import ffff97b14f00d800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1783952259.171393:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff97b1756e1500 x1870605465639040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171403:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000627d5ff3] to pc [ptlrpcd_00_01+1] req@ffff97b1756e1500 x1870605465639040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171410:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952259.171415:0:8:0:(genops.c:1231:class_import_get()) import ffff97b176be7000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1783952259.171422:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff97b1756e2300 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952259.171430:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007424b4b5] to pc [ptlrpcd_00_02+2] req@ffff97b1756e2300 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171441:0:8:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3979) 00000100:00000040:0.0:1783952259.171482:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b144732d80 x1870605465637888/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.171497:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465637888:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.171532:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b144732d80 x1870605465637888/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171541:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.171628:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b175079450 x1870605465637888 msgsize 224 00000100:00100000:0.0:1783952259.171633:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952259.171635:0:3644:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783952259.171670:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b144732d80 x1870605465637888/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171706:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1756e0380 x1870605465638528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.171715:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465638528:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.171741:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1756e0380 x1870605465638528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171749:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.171768:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b1756e1c00 x1870605465638528 msgsize 224 00000100:00100000:0.0:1783952259.171771:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952259.171787:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1756e0380 x1870605465638528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171797:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5512 usecs (6 jiffies) 00000100:00000040:0.0:1783952259.171803:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1756e2300 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.171811:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465639168:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.171824:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1756e2300 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171832:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.171847:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b1756e0700 x1870605465639168 msgsize 224 00000100:00100000:0.0:1783952259.171851:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952259.171867:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1756e2300 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171876:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 9272 usecs (10 jiffies) 00000100:00100000:0.0:1783952259.171894:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:0.0:1783952259.171900:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b144731500 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.171908:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465638016:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.171920:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b144731500 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171927:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.171939:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b1756e3100 x1870605465638016 msgsize 224 00000100:00100000:0.0:1783952259.171948:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952259.171962:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b144731500 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.171972:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8965 usecs (9 jiffies) 00000100:00000040:0.0:1783952259.171978:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1756e2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.171986:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465638656:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.172001:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1756e2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172007:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.172021:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b166fb2d80 x1870605465638656 msgsize 224 00000100:00100000:0.0:1783952259.172025:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952259.172039:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1756e2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172048:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 128097 usecs (129 jiffies) 00000100:00000040:0.0:1783952259.172074:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b144730e00 x1870605465638272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.172083:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465638272:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.172096:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b144730e00 x1870605465638272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172104:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.172118:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b166fb3100 x1870605465638272 msgsize 224 00000100:00100000:0.0:1783952259.172121:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952259.172134:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b144730e00 x1870605465638272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172143:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1627743 usecs (1628 jiffies) 00000100:00000040:0.0:1783952259.172149:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1756e1500 x1870605465639040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.172163:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465639040:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.172175:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1756e1500 x1870605465639040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172182:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.172193:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b166fb3b80 x1870605465639040 msgsize 224 00000100:00100000:0.0:1783952259.172197:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952259.172208:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1756e1500 x1870605465639040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172216:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8552 usecs (9 jiffies) 00000100:00100000:0.0:1783952259.172225:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000040:0.0:1783952259.172228:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b144731180 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.172236:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465638144:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.172249:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b144731180 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172256:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.172265:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b166fb1f80 x1870605465638144 msgsize 224 00000100:00100000:0.0:1783952259.172269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952259.172284:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b144731180 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172292:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8311 usecs (9 jiffies) 00000100:00000040:0.0:1783952259.172297:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1756e0000 x1870605465638784/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.172304:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465638784:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.172315:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1756e0000 x1870605465638784/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172332:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.172344:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b166fb3800 x1870605465638784 msgsize 224 00000100:00100000:0.0:1783952259.172348:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952259.172360:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1756e0000 x1870605465638784/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172369:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5851 usecs (6 jiffies) 00000100:00100000:0.0:1783952259.172393:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465637888 00000100:00100000:0.0:1783952259.172402:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465637888 00000020:00000040:0.0:1783952259.172405:0:94410:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:0.0:1783952259.172408:0:94410:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=21 00000100:00000040:0.0:1783952259.172434:0:94410:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783952259.172463:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00000040:0.0:1783952259.172468:0:94410:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:0.0:1783952259.172474:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b175079450 x1870605465637888/t0(0) o400->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.172487:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175079450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3644:x1870605465637888:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952259.172512:0:94410:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465637888 00000100:00000040:0.0:1783952259.172524:0:94410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952259.172529:0:94410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.172546:0:94410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b144732d80 x1870605465637888/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172564:0:94410:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952259.172569:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b175079450 x1870605465637888/t0(0) o400->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.172578:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175079450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3644:x1870605465637888:12345-0@lo:400:kworker.0 Request processed in 94us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952259.172614:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00000040:0.0:1783952259.172625:0:94410:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:0.0:1783952259.172636:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 20 00000100:00100000:0.0:1783952259.172682:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465638528 00000100:00100000:0.0:1783952259.172687:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465638528 00000020:00000040:0.0:1783952259.172689:0:26203:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe7a 00000020:00000040:0.0:1783952259.172692:0:26203:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b143cde000 refcount=5 00000020:00000040:0.0:1783952259.172703:0:26203:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:0.0:1783952259.172718:0:26203:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1783952259.172736:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465639040 00000100:00100000:0.0:1783952259.172739:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465639040 00000020:00000040:0.0:1783952259.172740:0:26203:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb601f 00000020:00000040:0.0:1783952259.172742:0:26203:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b11800 refcount=5 00000100:00100000:0.0:1783952259.172761:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00000040:0.0:1783952259.172764:0:26203:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b143cde000 : new rpc_count 1 00000100:00000040:0.0:1783952259.172769:0:26203:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1756e1c00 x1870605465638528/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.172778:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465638528:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952259.172790:0:26203:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870605465638528 00000100:00000040:0.0:1783952259.172795:0:26203:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952259.172798:0:26203:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.172814:0:26203:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b1756e0380 x1870605465638528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172826:0:26203:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952259.172830:0:26203:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e1c00 x1870605465638528/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.172837:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465638528:12345-0@lo:400:kworker.0 Request processed in 60us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952259.172843:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00000040:0.0:1783952259.172846:0:26203:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b143cde000 : new rpc_count 0 00000020:00000040:0.0:1783952259.172858:0:26203:0:(genops.c:900:class_export_put()) PUTting export ffff97b143cde000 : new refcount 4 00000100:00100000:0.0:1783952259.172869:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00000040:0.0:1783952259.172871:0:26203:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b11800 : new rpc_count 1 00000100:00000040:0.0:1783952259.172875:0:26203:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b166fb3b80 x1870605465639040/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.172885:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465639040:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952259.172894:0:26203:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968959, transno 0, xid 1870605465639040 00000100:00000040:0.0:1783952259.172898:0:26203:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952259.172901:0:26203:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.172916:0:26203:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b1756e1500 x1870605465639040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.172932:0:26203:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952259.172936:0:26203:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb3b80 x1870605465639040/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.172944:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465639040:12345-0@lo:400:kworker.0 Request processed in 61us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952259.172949:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00000040:0.0:1783952259.172952:0:26203:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b11800 : new rpc_count 0 00000020:00000040:0.0:1783952259.172957:0:26203:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b11800 : new refcount 4 00000100:00100000:0.0:1783952259.172975:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465639168 00000100:00100000:0.0:1783952259.172978:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465639168 00000020:00000040:0.0:1783952259.172980:0:66238:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6161 00000020:00000040:0.0:1783952259.172983:0:66238:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f2800 refcount=5 00000100:00000040:0.0:1783952259.172994:0:66238:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1783952259.173012:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465638016 00000100:00100000:0.0:1783952259.173015:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465638016 00000020:00000040:0.0:1783952259.173017:0:66238:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6153 00000020:00000040:0.0:1783952259.173019:0:66238:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f6800 refcount=5 00000020:00000040:0.0:1783952259.173025:0:66238:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 14 - evictor 00000100:00100000:0.0:1783952259.173052:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465638656 00000100:00100000:0.0:1783952259.173056:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465638656 00000020:00000040:0.0:1783952259.173057:0:66238:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb615a 00000020:00000040:0.0:1783952259.173060:0:66238:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f7800 refcount=5 00000100:00100000:0.0:1783952259.173072:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465638144 00000100:00100000:0.0:1783952259.173075:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465638144 00000020:00000040:0.0:1783952259.173076:0:66238:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafef1 00000020:00000040:0.0:1783952259.173078:0:66238:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b32800 refcount=5 00000020:00000040:0.0:1783952259.173084:0:66238:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 10 - evictor 00000100:00100000:0.0:1783952259.173096:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00000040:0.0:1783952259.173098:0:66238:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f2800 : new rpc_count 1 00000100:00000040:0.0:1783952259.173103:0:66238:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1756e0700 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.173112:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465639168:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952259.173123:0:66238:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465639168 00000100:00000040:0.0:1783952259.173127:0:66238:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952259.173130:0:66238:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.173147:0:66238:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b1756e2300 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.173158:0:66238:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952259.173163:0:66238:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e0700 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.173171:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465639168:12345-0@lo:400:kworker.0 Request processed in 60us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952259.173176:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00000040:0.0:1783952259.173178:0:66238:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f2800 : new rpc_count 0 00000020:00000040:0.0:1783952259.173184:0:66238:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f2800 : new refcount 4 00000100:00100000:0.0:1783952259.173193:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00000040:0.0:1783952259.173195:0:66238:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f6800 : new rpc_count 1 00000100:00000040:0.0:1783952259.173208:0:66238:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1756e3100 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.173218:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465638016:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952259.173228:0:66238:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465638016 00000100:00000040:0.0:1783952259.173232:0:66238:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952259.173236:0:66238:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.173252:0:66238:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b144731500 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.173264:0:66238:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952259.173268:0:66238:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e3100 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.173276:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465638016:12345-0@lo:400:kworker.0 Request processed in 59us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952259.173282:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00000040:0.0:1783952259.173284:0:66238:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f6800 : new rpc_count 0 00000020:00000040:0.0:1783952259.173289:0:66238:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f6800 : new refcount 4 00000100:00100000:0.0:1783952259.173297:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00000040:0.0:1783952259.173300:0:66238:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f7800 : new rpc_count 1 00000100:00000040:0.0:1783952259.173303:0:66238:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b166fb2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.173313:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465638656:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952259.173323:0:66238:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465638656 00000100:00000040:0.0:1783952259.173327:0:66238:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952259.173330:0:66238:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.173343:0:66238:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b1756e2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.173370:0:66238:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952259.173374:0:66238:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.173381:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465638656:12345-0@lo:400:kworker.0 Request processed in 69us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952259.173386:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00000040:0.0:1783952259.173388:0:66238:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f7800 : new rpc_count 0 00000020:00000040:0.0:1783952259.173393:0:66238:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f7800 : new refcount 4 00000100:00100000:0.0:1783952259.173400:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00000040:0.0:1783952259.173402:0:66238:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b32800 : new rpc_count 1 00000100:00000040:0.0:1783952259.173405:0:66238:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b166fb1f80 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.173415:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465638144:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952259.173425:0:66238:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465638144 00000100:00000040:0.0:1783952259.173430:0:66238:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952259.173433:0:66238:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952259.173447:0:66238:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b144731180 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.173458:0:66238:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952259.173462:0:66238:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb1f80 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.173470:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465638144:12345-0@lo:400:kworker.0 Request processed in 56us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952259.173476:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00000040:0.0:1783952259.173478:0:66238:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b32800 : new rpc_count 0 00000020:00000040:0.0:1783952259.173488:0:66238:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b32800 : new refcount 4 00000100:00100000:0.0:1783952259.173515:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465638272 00000100:00100000:0.0:1783952259.173519:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465638272 00000020:00000040:0.0:1783952259.173521:0:23862:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5faf 00000020:00000040:0.0:1783952259.173523:0:23862:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c5000 refcount=7 00000100:00000040:0.0:1783952259.173535:0:23862:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1783952259.173553:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465638784 00000100:00100000:0.0:1783952259.173556:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465638784 00000020:00000040:0.0:1783952259.173558:0:23862:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5fe7 00000020:00000040:0.0:1783952259.173560:0:23862:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04965f000 refcount=5 00000100:00100000:0.0:1783952259.173576:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00000040:0.0:1783952259.173578:0:23862:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c5000 : new rpc_count 1 00000100:00000040:0.0:1783952259.173582:0:23862:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b166fb3100 x1870605465638272/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.173618:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465638272:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952259.173630:0:23862:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870605465638272 00000100:00000040:0.0:1783952259.173635:0:23862:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952259.173638:0:23862:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952259.173766:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b144733100 x1870605465638400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.173779:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465638400:0@lo:8:kworker.0 00000100:00000040:2.0:1783952259.173802:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b144733100 x1870605465638400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952279 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952259.173821:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952259.173841:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b164e3d180 x1870605465638400 msgsize 520 00000100:00100000:2.0:1783952259.173844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952259.173863:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b144733100 x1870605465638400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952279 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952259.173875:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5573 usecs (6 jiffies) 00000100:00000040:2.0:1783952259.173884:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1756e1f80 x1870605465638912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.173891:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1756e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465638912:0@lo:8:kworker.0 00000100:00000040:2.0:1783952259.173904:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1756e1f80 x1870605465638912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952279 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952259.173910:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952259.173922:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b049dee300 x1870605465638912 msgsize 520 00000100:00100000:2.0:1783952259.173926:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952259.173937:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1756e1f80 x1870605465638912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952279 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952259.173945:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8956 usecs (9 jiffies) 00000100:00100000:2.0:1783952259.173979:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465638400 00000100:00100000:2.0:1783952259.173984:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465638400 00000020:00000040:2.0:1783952259.173986:0:11961:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe50 00000100:00100000:2.0:1783952259.174010:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465638912 00000100:00100000:2.0:1783952259.174012:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465638912 00000020:00000040:2.0:1783952259.174014:0:11961:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6011 00000100:00100000:2.0:1783952259.174041:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5038 00000100:00000040:2.0:1783952259.174046:0:11961:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b164e3d180 x1870605465638400/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952279 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.174054:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3641:x1870605465638400:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783952259.174078:0:11961:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1783952259.174096:0:11961:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 53 to 0@lo 00000100:00000040:2.0:1783952259.174099:0:11961:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 53 to 0@lo 00000100:00000040:2.0:1783952259.174102:0:11961:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952259.174119:0:11961:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff97b144733100 x1870605465638400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952279 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952259.174134:0:11961:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952259.174138:0:11961:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b164e3d180 x1870605465638400/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.174146:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b164e3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3641:x1870605465638400:12345-0@lo:8:kworker.0 Request processed in 92us (303us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952259.174151:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5038 00000100:00100000:2.0:1783952259.174165:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5039 00000100:00000040:2.0:1783952259.174168:0:11961:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049dee300 x1870605465638912/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952279 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.174175:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3641:x1870605465638912:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783952259.174184:0:11961:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1783952259.174191:0:11961:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 53 to 0@lo 00000100:00000040:2.0:1783952259.174194:0:11961:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 53 to 0@lo 00000100:00000040:2.0:1783952259.174197:0:11961:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952259.174209:0:11961:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff97b1756e1f80 x1870605465638912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952279 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952259.174219:0:11961:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952259.174222:0:11961:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049dee300 x1870605465638912/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.174229:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3641:x1870605465638912:12345-0@lo:8:kworker.0 Request processed in 53us (306us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952259.174234:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5039 00000100:00100000:2.0:1783952259.174267:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00000040:2.0:1783952259.174270:0:26467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b04965f000 : new rpc_count 1 00000100:00000040:2.0:1783952259.174275:0:26467:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b166fb3800 x1870605465638784/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.174285:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465638784:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783952259.174298:0:26467:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465638784 00000100:00000040:2.0:1783952259.174302:0:26467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 53 to 0@lo 00000100:00000040:2.0:1783952259.174305:0:26467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952259.174323:0:26467:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b1756e0000 x1870605465638784/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952259.174333:0:26467:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952259.174336:0:26467:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb3800 x1870605465638784/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.174344:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465638784:12345-0@lo:400:kworker.0 Request processed in 61us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952259.174350:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00000040:2.0:1783952259.174352:0:26467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b04965f000 : new rpc_count 0 00000020:00000040:2.0:1783952259.174359:0:26467:0:(genops.c:900:class_export_put()) PUTting export ffff97b04965f000 : new refcount 4 00000100:00000040:2.0:1783952259.174411:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b144733100 x1870605465638400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952279 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952259.174422:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952259.174426:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1783952259.174430:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b144733100 x1870605465638400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952279 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.174437:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465638400:0@lo:8:kworker.0 00000100:00000040:2.0:1783952259.174448:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1756e1f80 x1870605465638912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952279 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952259.174460:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952259.174464:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1783952259.174467:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e1f80 x1870605465638912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952279 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.174474:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465638912:0@lo:8:kworker.0 00000100:00000040:2.0:1783952259.174479:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b144733100 x1870605465638400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952279 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952259.174492:0:3641:0:(genops.c:1244:class_import_put()) import ffff97b15f80e000 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1783952259.174503:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1756e1f80 x1870605465638912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952279 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952259.174509:0:3641:0:(genops.c:1244:class_import_put()) import ffff97b143af6800 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1783952259.179307:0:23862:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b144730e00 x1870605465638272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.179373:0:23862:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952259.179390:0:23862:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb3100 x1870605465638272/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.179401:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465638272:12345-0@lo:400:kworker.0 Request processed in 5783us (7280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952259.179414:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00000040:0.0:1783952259.179419:0:23862:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c5000 : new rpc_count 0 00000020:00000040:0.0:1783952259.179438:0:23862:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c5000 : new refcount 6 00000100:00080000:0.0:1783952259.179486:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1783952259.179515:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff97b167c13380) now 10 - evictor 00000100:00080000:0.0:1783952259.179518:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1783952259.179521:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff97b0468a4d40) now 14 - evictor 00000100:00080000:0.0:1783952259.179524:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1783952259.179527:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:0.0:1783952259.179778:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1783952259.179786:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b144731180 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.179798:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b144731180 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.179807:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465638144:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.179820:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1783952259.179825:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1756e0000 x1870605465638784/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.179833:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e0000 x1870605465638784/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.179840:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465638784:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.179850:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:0.0:1783952259.179853:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b144730e00 x1870605465638272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.179860:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b144730e00 x1870605465638272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.179866:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465638272:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.179878:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968959 00000100:00000040:0.0:1783952259.179882:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1756e1500 x1870605465639040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.179896:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e1500 x1870605465639040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.179902:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465639040:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.179909:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b144731180 x1870605465638144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952259.179920:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b046a94800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1783952259.179931:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1756e0000 x1870605465638784/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952259.179937:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b15036a000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1783952259.179941:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b144730e00 x1870605465638272/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952259.179947:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b048caf800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1783952259.179952:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1756e1500 x1870605465639040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952259.179958:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b14f00d800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1783952259.179992:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1783952259.179997:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b144731500 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.180006:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b144731500 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.180012:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465638016:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.180026:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1783952259.180030:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1756e2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.180048:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.180055:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465638656:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.180070:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b144732d80 x1870605465637888/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.180078:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b144732d80 x1870605465637888/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.180084:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465637888:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.180097:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:0.0:1783952259.180101:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1756e0380 x1870605465638528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.180108:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e0380 x1870605465638528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.180114:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465638528:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.180126:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1783952259.180130:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1756e2300 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952259.180137:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e2300 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.180144:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1756e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465639168:0@lo:400:kworker.0 00000100:00000040:0.0:1783952259.180149:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b144731500 x1870605465638016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952259.180165:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b046b43800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1783952259.180171:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1756e2d80 x1870605465638656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952259.180178:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b0410da800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1783952259.180182:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b144732d80 x1870605465637888/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952259.180188:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000100:00000040:0.0:1783952259.180193:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1756e0380 x1870605465638528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952259.180199:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b166f50000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1783952259.180202:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1756e2300 x1870605465639168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952259.180209:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b176be7000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000040:1.0:1783952259.180312:0:94421:0:(genops.c:1231:class_import_get()) import ffff97b15036a000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1783952259.180347:0:94421:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b2b7de2b] to pc [ptlrpcd_00_03+3] req@ffff97b1447b3800 x1870605465639296/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952259.180383:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:1.0:1783952259.180391:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b3800 x1870605465639296/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952259.180403:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465639296:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1783952259.180432:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b3800 x1870605465639296/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952259.180441:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952259.180483:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b1447b0a80 x1870605465639296 msgsize 224 00000100:00100000:1.0:1783952259.180488:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952259.180506:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b3800 x1870605465639296/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952259.180520:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 6027 usecs (7 jiffies) 00000100:00100000:1.0:1783952259.180544:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465639296 00000100:00100000:1.0:1783952259.180552:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465639296 00000020:00000040:1.0:1783952259.180555:0:26467:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5fe7 00000020:00000040:1.0:1783952259.180559:0:26467:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04965f000 refcount=5 00000100:00000040:1.0:1783952259.180583:0:26467:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1783952259.180647:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00000040:1.0:1783952259.180652:0:26467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b04965f000 : new rpc_count 1 00000100:00000040:1.0:1783952259.180669:0:26467:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1447b0a80 x1870605465639296/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952259.180681:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465639296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783952259.180729:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00010000:00000040:1.0:1783952259.180743:0:26467:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465639296 00000100:00000040:1.0:1783952259.180753:0:26467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952259.180758:0:26467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952259.180777:0:26467:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b1447b3800 x1870605465639296/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952259.180794:0:26467:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952259.180799:0:26467:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b0a80 x1870605465639296/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:520/0 lens 224/368 e 0 to 0 dl 1783952270 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952259.180809:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465639296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952259.180816:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00000040:1.0:1783952259.180819:0:26467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b04965f000 : new rpc_count 0 00000020:00000040:1.0:1783952259.180828:0:26467:0:(genops.c:900:class_export_put()) PUTting export ffff97b04965f000 : new refcount 4 00000100:00000040:1.0:1783952259.180847:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1783952259.180852:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b3800 x1870605465639296/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1783952259.180862:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352909 avail=317206 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023681 state=0: rc = 0 00000100:00000040:1.0:1783952259.180870:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b3800 x1870605465639296/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952259.180876:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465639296:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1783952259.180889:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b3800 x1870605465639296/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952259.180899:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b15036a000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1783952259.568747:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b049dedf80 x1870605447846528 msgsize 224 00000100:00100000:2.0:1783952259.568761:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:2.0:1783952259.568806:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b1756e2300 x1870605447846912 msgsize 224 00000100:00100000:2.0:1783952259.568811:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:2.0:1783952259.568841:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b175079850 x1870605447846400 msgsize 224 00000100:00100000:2.0:1783952259.568846:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:2.0:1783952259.568848:0:3636:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1783952259.568868:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b1756e0380 x1870605447846656 msgsize 224 00000100:00100000:2.0:1783952259.568873:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:2.0:1783952259.568892:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b1756e2d80 x1870605447846784 msgsize 520 00000100:00100000:2.0:1783952259.568897:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952259.568928:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447846912 00000100:00100000:2.0:1783952259.568937:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447846912 00000020:00000040:2.0:1783952259.568940:0:26205:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6367 00000020:00000040:2.0:1783952259.568945:0:26205:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1746c9000 refcount=7 00000020:00000040:2.0:1783952259.568974:0:26205:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:2.0:1783952259.569008:0:26205:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1783952259.569030:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447846784 00000100:00100000:2.0:1783952259.569033:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447846784 00000020:00000040:2.0:1783952259.569035:0:26205:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6360 00000100:00100000:2.0:1783952259.569050:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2930 00000100:00000040:2.0:1783952259.569055:0:26205:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1746c9000 : new rpc_count 1 00000100:00000040:2.0:1783952259.569062:0:26205:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1756e2300 x1870605447846912/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.569077:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447846912:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:2.0:1783952259.569099:0:26205:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605447846912 00000100:00000040:2.0:1783952259.569107:0:26205:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952259.569113:0:26205:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952259.569144:0:26205:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952259.569150:0:26205:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e2300 x1870605447846912/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.569159:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447846912:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 84us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952259.569167:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2930 00000100:00000040:2.0:1783952259.569170:0:26205:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1746c9000 : new rpc_count 0 00000020:00000040:2.0:1783952259.569178:0:26205:0:(genops.c:900:class_export_put()) PUTting export ffff97b1746c9000 : new refcount 6 00000100:00100000:2.0:1783952259.569186:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5040 00000100:00000040:2.0:1783952259.569190:0:26205:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1756e2d80 x1870605447846784/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952279 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.569198:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2397:x1870605447846784:12345-192.168.202.48@tcp:8:kworker.0 00010000:00020000:2.0:1783952259.569218:0:26205:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1783952259.569236:0:26205:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952259.569239:0:26205:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952259.569242:0:26205:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952259.569253:0:26205:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952259.569257:0:26205:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e2d80 x1870605447846784/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.569266:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2397:x1870605447846784:12345-192.168.202.48@tcp:8:kworker.0 Request processed in 67us (371us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952259.569272:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5040 00000100:00100000:2.0:1783952259.569290:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447846400 00000100:00100000:2.0:1783952259.569293:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447846400 00000020:00000040:2.0:1783952259.569294:0:94415:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6065 00000020:00000040:2.0:1783952259.569297:0:94415:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f5000 refcount=10 00000100:00000040:2.0:1783952259.569305:0:94415:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952259.569321:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 187 00000100:00000040:2.0:1783952259.569323:0:94415:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f5000 : new rpc_count 1 00000100:00000040:2.0:1783952259.569327:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b175079850 x1870605447846400/t0(0) o400->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.569337:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b175079850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2399:x1870605447846400:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:2.0:1783952259.569345:0:94415:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605447846400 00000100:00000040:2.0:1783952259.569349:0:94415:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952259.569352:0:94415:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952259.569363:0:94415:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952259.569368:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b175079850 x1870605447846400/t0(0) o400->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952259.569377:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b175079850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2399:x1870605447846400:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 40us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952259.569392:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 187 00000100:00000040:2.0:1783952259.569644:0:94415:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f5000 : new rpc_count 0 00000020:00000040:2.0:1783952259.569660:0:94415:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f5000 : new refcount 9 00000100:00100000:0.0:1783952259.570016:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447846528 00000100:00100000:0.0:1783952259.570022:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447846528 00000020:00000040:0.0:1783952259.570024:0:66237:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5fb6 00000020:00000040:0.0:1783952259.570027:0:66237:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c3800 refcount=51 00000020:00000040:0.0:1783952259.570037:0:66237:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 14 - evictor 00000100:00000040:0.0:1783952259.570049:0:66237:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1783952259.570065:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447846656 00000100:00100000:0.0:1783952259.570068:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447846656 00000020:00000040:0.0:1783952259.570069:0:66237:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb55c2 00000020:00000040:0.0:1783952259.570072:0:66237:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0410df000 refcount=11 00000020:00000040:0.0:1783952259.570077:0:66237:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 10 - evictor 00000100:00100000:0.0:1783952259.570097:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1491 00000100:00000040:0.0:1783952259.570100:0:66237:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c3800 : new rpc_count 1 00000100:00000040:0.0:1783952259.570105:0:66237:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049dedf80 x1870605447846528/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.570129:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2399:x1870605447846528:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:0.0:1783952259.570143:0:66237:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1870605447846528 00000100:00000040:0.0:1783952259.570149:0:66237:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952259.570153:0:66237:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952259.570172:0:66237:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952259.570177:0:66237:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049dedf80 x1870605447846528/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.570184:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2399:x1870605447846528:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 59us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952259.570190:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1491 00000100:00000040:0.0:1783952259.570192:0:66237:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c3800 : new rpc_count 0 00000020:00000040:0.0:1783952259.570199:0:66237:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c3800 : new refcount 50 00000100:00100000:0.0:1783952259.570209:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1492 00000100:00000040:0.0:1783952259.570211:0:66237:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0410df000 : new rpc_count 1 00000100:00000040:0.0:1783952259.570215:0:66237:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1756e0380 x1870605447846656/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.570225:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447846656:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:0.0:1783952259.570234:0:66237:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411471, transno 0, xid 1870605447846656 00000100:00000040:0.0:1783952259.570238:0:66237:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952259.570241:0:66237:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952259.570251:0:66237:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952259.570256:0:66237:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e0380 x1870605447846656/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:520/0 lens 224/224 e 0 to 0 dl 1783952270 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952259.570265:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447846656:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 41us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952259.570276:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1492 00000100:00000040:0.0:1783952259.570278:0:66237:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0410df000 : new rpc_count 0 00000020:00000040:0.0:1783952259.570283:0:66237:0:(genops.c:900:class_export_put()) PUTting export ffff97b0410df000 : new refcount 10 00000100:00080000:0.0:1783952259.570296:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1783952259.570300:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff97b167c13380) now 10 - evictor 00000100:00080000:0.0:1783952259.570303:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1783952259.570305:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff97b0468a4d40) now 14 - evictor 00000100:00080000:0.0:1783952259.570307:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1783952259.570309:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00010000:00010000:2.0:1783952259.617955:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1783952259.681533:0:94425:0:(genops.c:1231:class_import_get()) import ffff97b14f00d800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000020:00000040:3.0:1783952259.681547:0:75701:0:(genops.c:1231:class_import_get()) import ffff97b048caf800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1783952259.681573:0:75701:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004e45596e] to pc [ptlrpcd_00_00+0] req@ffff97b14deba300 x1870605465639552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952259.681573:0:94425:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b2b7de2b] to pc [ptlrpcd_00_00+0] req@ffff97b1447b3800 x1870605465639424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952259.681645:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14deba300 x1870605465639552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952259.681670:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465639552:0@lo:41:osp-pre-0-1.0 00000100:00000040:3.0:1783952259.681704:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14deba300 x1870605465639552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952259.681712:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952259.681758:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b14deb9c00 x1870605465639552 msgsize 224 00000100:00100000:3.0:1783952259.681763:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952259.681795:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14deba300 x1870605465639552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952259.681808:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1623176 usecs (1624 jiffies) 00000100:00000040:3.0:1783952259.681822:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b3800 x1870605465639424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952259.681832:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465639424:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1783952259.681848:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b3800 x1870605465639424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952275 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952259.681855:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952259.681875:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b14deb8000 x1870605465639424 msgsize 224 00000100:00100000:3.0:1783952259.681880:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952259.681896:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b3800 x1870605465639424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952275 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952259.681929:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8622 usecs (9 jiffies) 00000100:00100000:3.0:1783952259.681963:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465639424 00000100:00100000:3.0:1783952259.681971:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465639424 00000020:00000040:3.0:1783952259.681974:0:11087:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb601f 00000020:00000040:3.0:1783952259.681978:0:11087:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b11800 refcount=5 00000100:00100000:1.0:1783952259.682213:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465639552 00000100:00100000:1.0:1783952259.682218:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465639552 00000020:00000040:1.0:1783952259.682220:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5faf 00000020:00000040:1.0:1783952259.682223:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c5000 refcount=7 00000100:00000040:1.0:1783952259.682241:0:8445:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1783952259.682267:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00000040:1.0:1783952259.682272:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c5000 : new rpc_count 1 00000100:00000040:1.0:1783952259.682277:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14deb9c00 x1870605465639552/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952259.682288:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465639552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783952259.682331:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00010000:00000040:1.0:1783952259.682341:0:8445:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870605465639552 00000100:00000040:1.0:1783952259.682351:0:8445:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952259.682356:0:8445:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952259.682377:0:8445:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b14deba300 x1870605465639552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952259.682411:0:8445:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952259.682415:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb9c00 x1870605465639552/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:520/0 lens 224/368 e 0 to 0 dl 1783952270 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952259.682424:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465639552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952259.682442:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00000040:1.0:1783952259.682445:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c5000 : new rpc_count 0 00000020:00000040:1.0:1783952259.682455:0:8445:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c5000 : new refcount 6 00000100:00000040:1.0:1783952259.682491:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:1.0:1783952259.682499:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14deba300 x1870605465639552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1783952259.682511:0:3642:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352834 avail=317131 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023577 state=0: rc = 0 00000100:00000040:1.0:1783952259.682519:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deba300 x1870605465639552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952259.682527:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465639552:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1783952259.682533:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14deba300 x1870605465639552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952259.682543:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b048caf800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1783952259.683123:0:11087:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1783952259.683145:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00000040:3.0:1783952259.683148:0:11087:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b11800 : new rpc_count 1 00000100:00000040:3.0:1783952259.683153:0:11087:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14deb8000 x1870605465639424/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:520/0 lens 224/0 e 0 to 0 dl 1783952270 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952259.683164:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465639424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952259.683185:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:3.0:1783952259.683193:0:11087:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968959, transno 0, xid 1870605465639424 00000100:00000040:3.0:1783952259.683199:0:11087:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:3.0:1783952259.683202:0:11087:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952259.683223:0:11087:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b1447b3800 x1870605465639424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952259.683240:0:11087:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:3.0:1783952259.683244:0:11087:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8000 x1870605465639424/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:520/0 lens 224/368 e 0 to 0 dl 1783952270 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952259.683251:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465639424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952259.683257:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00000040:3.0:1783952259.683260:0:11087:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b11800 : new rpc_count 0 00000020:00000040:3.0:1783952259.683266:0:11087:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b11800 : new refcount 4 00000100:00000040:3.0:1783952259.683483:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968959 00000100:00000040:3.0:1783952259.683490:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b3800 x1870605465639424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1783952259.683506:0:3642:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:3.0:1783952259.683509:0:3642:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1783952259.683516:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b3800 x1870605465639424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952259.683613:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465639424:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1783952259.683621:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b3800 x1870605465639424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952259.683628:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b14f00d800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:0.0:1783952260.641878:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1783952260.706280:0:75705:0:(genops.c:1231:class_import_get()) import ffff97b166f50000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783952260.706345:0:75705:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b13656d5] to pc [ptlrpcd_00_01+1] req@ffff97b1447b1180 x1870605465639680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952260.706668:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b1180 x1870605465639680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952260.706682:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465639680:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1783952260.706791:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b1180 x1870605465639680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952276 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952260.706810:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952260.706853:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b14debb480 x1870605465639680 msgsize 224 00000100:00100000:3.0:1783952260.706857:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952260.706920:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465639680 00000100:00100000:0.0:1783952260.706927:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465639680 00000020:00000040:0.0:1783952260.706930:0:8437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe7a 00000020:00000040:0.0:1783952260.706935:0:8437:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b143cde000 refcount=5 00000100:00000040:0.0:1783952260.706960:0:8437:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1783952260.706986:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00000040:0.0:1783952260.706990:0:8437:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b143cde000 : new rpc_count 1 00000100:00000040:0.0:1783952260.706996:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14debb480 x1870605465639680/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:521/0 lens 224/0 e 0 to 0 dl 1783952271 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952260.707010:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465639680:12345-0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1783952260.707012:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b1180 x1870605465639680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952276 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952260.707032:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5527 usecs (6 jiffies) 00002000:00000024:0.0:1783952260.707036:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1783952260.707049:0:8437:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870605465639680 00000100:00000040:0.0:1783952260.707059:0:8437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952260.707065:0:8437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952260.707093:0:8437:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b1447b1180 x1870605465639680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952276 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952260.707118:0:8437:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952260.707123:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14debb480 x1870605465639680/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:521/0 lens 224/368 e 0 to 0 dl 1783952271 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952260.707148:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465639680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952260.707155:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00000040:0.0:1783952260.707158:0:8437:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b143cde000 : new rpc_count 0 00000020:00000040:0.0:1783952260.707167:0:8437:0:(genops.c:900:class_export_put()) PUTting export ffff97b143cde000 : new refcount 4 00000100:00000040:3.0:1783952260.707825:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:3.0:1783952260.707836:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b1180 x1870605465639680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1783952260.707849:0:3643:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1783952260.707852:0:3643:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1783952260.707870:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b1180 x1870605465639680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952276 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952260.707878:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465639680:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1783952260.708336:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b1180 x1870605465639680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952276 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952260.708364:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b166f50000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:2.0:1783952261.669883:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952262.691056:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952263.713527:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1783952264.289321:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952264.289335:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000100:00000040:1.0:1783952264.289361:0:40998:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS req@ffff97b1447b1c00 x1870605465639808/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289379:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a6994035] to pc [ptlrpcd_00_02+2] req@ffff97b1447b1c00 x1870605465639808/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.289402:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952264.289408:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b046b43800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1783952264.289430:0:40998:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff97b1447b1180 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289439:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b13656d5] to pc [ptlrpcd_00_03+3] req@ffff97b1447b1180 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.289447:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952264.289452:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b046a94800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1783952264.289459:0:40998:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff97b1447b3800 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289468:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b2b7de2b] to pc [ptlrpcd_00_00+0] req@ffff97b1447b3800 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.289487:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952264.289492:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b048caf800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1783952264.289498:0:40998:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff97b1447b2a00 x1870605465640192/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289507:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000028b968cc] to pc [ptlrpcd_00_01+1] req@ffff97b1447b2a00 x1870605465640192/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952264.289516:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952264.289519:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783952264.289523:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952264.289528:0:40998:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3974 00000100:00080000:1.0:1783952264.289533:0:40998:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:1.0:1783952264.289536:0:40998:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 50 to 0@lo 00000100:00000040:1.0:1783952264.289540:0:40998:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 51 to 0@lo 00000020:00000040:1.0:1783952264.289543:0:40998:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe49 00000020:00000040:1.0:1783952264.289548:0:40998:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b14f00b000 refcount=4 00000100:00000040:1.0:1783952264.289558:0:40998:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 50 to 0@lo 00000100:00000040:1.0:1783952264.289561:0:40998:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 51 to 0@lo 00000020:00000040:1.0:1783952264.289564:0:40998:0:(genops.c:900:class_export_put()) PUTting export ffff97b14f00b000 : new refcount 3 00000100:00080000:1.0:1783952264.289567:0:40998:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff97b15f80e000 using connection 192.168.202.148@tcp/0@lo 00000020:00000040:1.0:1783952264.289582:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b15f80e000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1783952264.289629:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b16dd4c000 x1870605465640320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289638:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000092332804] to pc [ptlrpcd_rcv+-1] req@ffff97b16dd4c000 x1870605465640320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.289650:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952264.289656:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b166f50000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783952264.289663:0:40998:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff97b16dd4e300 x1870605465640448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289672:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f39ae314] to pc [ptlrpcd_00_02+2] req@ffff97b16dd4e300 x1870605465640448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.289680:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952264.289684:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b0410da800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1783952264.289691:0:40998:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff97b14de1dc00 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289700:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008ff25dc1] to pc [ptlrpcd_00_03+3] req@ffff97b14de1dc00 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.289707:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952264.289713:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b15036a000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1783952264.289732:0:40998:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff97b14de1c000 x1870605465640704/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289754:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002e8f6d7a] to pc [ptlrpcd_00_00+0] req@ffff97b14de1c000 x1870605465640704/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952264.289761:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952264.289765:0:40998:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783952264.289767:0:40998:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783952264.289771:0:40998:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3974 00000100:00080000:1.0:1783952264.289773:0:40998:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:1.0:1783952264.289776:0:40998:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 50 to 0@lo 00000100:00000040:1.0:1783952264.289778:0:40998:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 51 to 0@lo 00000020:00000040:1.0:1783952264.289780:0:40998:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5ffc 00000020:00000040:1.0:1783952264.289783:0:40998:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04e288800 refcount=4 00000100:00000040:1.0:1783952264.289786:0:40998:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 50 to 0@lo 00000100:00000040:1.0:1783952264.289788:0:40998:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 51 to 0@lo 00000020:00000040:1.0:1783952264.289791:0:40998:0:(genops.c:900:class_export_put()) PUTting export ffff97b04e288800 : new refcount 3 00000100:00080000:1.0:1783952264.289793:0:40998:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b143af6800 using connection 192.168.202.148@tcp/0@lo 00000020:00000040:1.0:1783952264.289800:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b143af6800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1783952264.289810:0:40998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b14de1df80 x1870605465640832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289818:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f1239294] to pc [ptlrpcd_rcv+-1] req@ffff97b14de1df80 x1870605465640832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.289826:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952264.289831:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b14f00d800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1783952264.289836:0:40998:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff97b14de1fb80 x1870605465640960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289844:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d984da34] to pc [ptlrpcd_00_01+1] req@ffff97b14de1fb80 x1870605465640960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.289858:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952264.289863:0:40998:0:(genops.c:1231:class_import_get()) import ffff97b176be7000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1783952264.289872:0:40998:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff97b14de1f480 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952264.289881:0:40998:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000043893d00] to pc [ptlrpcd_00_02+2] req@ffff97b14de1f480 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.289891:0:40998:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3984) 00000100:00000040:1.0:1783952264.289911:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b1c00 x1870605465639808/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.289925:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465639808:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.289952:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b1c00 x1870605465639808/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.289960:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.289998:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b17507b850 x1870605465639808 msgsize 224 00000100:00100000:1.0:1783952264.290003:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952264.290005:0:3644:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783952264.290021:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b1c00 x1870605465639808/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290049:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b16dd4e300 x1870605465640448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290057:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465640448:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.290069:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b16dd4e300 x1870605465640448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290075:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.290090:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e75180 x1870605465640448 msgsize 224 00000100:00100000:1.0:1783952264.290098:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952264.290113:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b16dd4e300 x1870605465640448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290124:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5515 usecs (6 jiffies) 00000100:00000040:1.0:1783952264.290130:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14de1f480 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290138:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465641088:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.290150:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14de1f480 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290157:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.290170:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e77100 x1870605465641088 msgsize 224 00000100:00100000:1.0:1783952264.290173:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952264.290185:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14de1f480 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290194:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 9385 usecs (10 jiffies) 00000100:00100000:1.0:1783952264.290206:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:1.0:1783952264.290210:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b1180 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290218:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465639936:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.290229:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b1180 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290235:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.290246:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e76d80 x1870605465639936 msgsize 224 00000100:00100000:1.0:1783952264.290249:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952264.290262:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b1180 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290270:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8967 usecs (9 jiffies) 00000100:00000040:1.0:1783952264.290275:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14de1dc00 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290289:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465640576:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.290300:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14de1dc00 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290307:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.290319:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e76300 x1870605465640576 msgsize 224 00000100:00100000:1.0:1783952264.290323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952264.290336:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14de1dc00 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290344:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 127541 usecs (128 jiffies) 00000100:00000040:1.0:1783952264.290364:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b3800 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290373:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465640064:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.290383:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b3800 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290390:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.290400:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e75f80 x1870605465640064 msgsize 224 00000100:00100000:1.0:1783952264.290404:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952264.290416:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b3800 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290425:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8315 usecs (9 jiffies) 00000100:00000040:1.0:1783952264.290430:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14de1c000 x1870605465640704/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290438:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465640704:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.290449:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14de1c000 x1870605465640704/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290465:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.290482:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e74380 x1870605465640704 msgsize 224 00000100:00100000:1.0:1783952264.290486:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952264.290500:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14de1c000 x1870605465640704/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290508:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5833 usecs (6 jiffies) 00000100:00100000:1.0:1783952264.290516:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:1.0:1783952264.290520:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b2a00 x1870605465640192/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290527:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465640192:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.290538:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b2a00 x1870605465640192/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290543:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.290554:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e75c00 x1870605465640192 msgsize 224 00000100:00100000:1.0:1783952264.290557:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952264.290569:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b2a00 x1870605465640192/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290576:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1618607 usecs (1619 jiffies) 00000100:00000040:1.0:1783952264.290581:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14de1fb80 x1870605465640960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290621:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465640960:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.290633:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14de1fb80 x1870605465640960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290639:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.290650:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e75880 x1870605465640960 msgsize 224 00000100:00100000:1.0:1783952264.290654:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952264.290666:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14de1fb80 x1870605465640960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290681:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8412 usecs (9 jiffies) 00000100:00100000:1.0:1783952264.290703:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465639808 00000100:00100000:1.0:1783952264.290710:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465639808 00000020:00000040:1.0:1783952264.290713:0:94410:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:1.0:1783952264.290715:0:94410:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=21 00000100:00000040:1.0:1783952264.290736:0:94410:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783952264.290759:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1783952264.290764:0:94410:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:1.0:1783952264.290769:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b17507b850 x1870605465639808/t0(0) o400->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290782:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17507b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3644:x1870605465639808:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952264.290801:0:94410:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465639808 00000100:00000040:1.0:1783952264.290809:0:94410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952264.290813:0:94410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.290829:0:94410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b1447b1c00 x1870605465639808/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.290846:0:94410:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952264.290850:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b17507b850 x1870605465639808/t0(0) o400->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290858:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17507b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:3644:x1870605465639808:12345-0@lo:400:kworker.0 Request processed in 79us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952264.290864:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1783952264.290868:0:94410:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:1.0:1783952264.290876:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 20 00000100:00100000:1.0:1783952264.290900:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465640448 00000100:00100000:1.0:1783952264.290904:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465640448 00000020:00000040:1.0:1783952264.290906:0:26200:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe7a 00000020:00000040:1.0:1783952264.290914:0:26200:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b143cde000 refcount=5 00000020:00000040:1.0:1783952264.290922:0:26200:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:1.0:1783952264.290938:0:26200:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1783952264.290952:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465640960 00000100:00100000:1.0:1783952264.290955:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465640960 00000020:00000040:1.0:1783952264.290957:0:26200:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb601f 00000020:00000040:1.0:1783952264.290959:0:26200:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b11800 refcount=5 00000100:00100000:1.0:1783952264.290978:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00000040:1.0:1783952264.290980:0:26200:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b143cde000 : new rpc_count 1 00000100:00000040:1.0:1783952264.290985:0:26200:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e75180 x1870605465640448/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.290994:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465640448:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952264.291006:0:26200:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870605465640448 00000100:00000040:1.0:1783952264.291010:0:26200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952264.291012:0:26200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.291028:0:26200:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b16dd4e300 x1870605465640448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.291038:0:26200:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952264.291041:0:26200:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e75180 x1870605465640448/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291048:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465640448:12345-0@lo:400:kworker.0 Request processed in 55us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952264.291052:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00000040:1.0:1783952264.291054:0:26200:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b143cde000 : new rpc_count 0 00000020:00000040:1.0:1783952264.291060:0:26200:0:(genops.c:900:class_export_put()) PUTting export ffff97b143cde000 : new refcount 4 00000100:00100000:1.0:1783952264.291067:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00000040:1.0:1783952264.291069:0:26200:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b11800 : new rpc_count 1 00000100:00000040:1.0:1783952264.291073:0:26200:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e75880 x1870605465640960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291094:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465640960:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952264.291103:0:26200:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968959, transno 0, xid 1870605465640960 00000100:00000040:1.0:1783952264.291108:0:26200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952264.291111:0:26200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.291125:0:26200:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b14de1fb80 x1870605465640960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.291141:0:26200:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952264.291146:0:26200:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e75880 x1870605465640960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291153:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465640960:12345-0@lo:400:kworker.0 Request processed in 62us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952264.291159:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00000040:1.0:1783952264.291161:0:26200:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b11800 : new rpc_count 0 00000020:00000040:1.0:1783952264.291166:0:26200:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b11800 : new refcount 4 00000100:00100000:1.0:1783952264.291181:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465641088 00000100:00100000:1.0:1783952264.291184:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465641088 00000020:00000040:1.0:1783952264.291185:0:67035:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6161 00000020:00000040:1.0:1783952264.291188:0:67035:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f2800 refcount=5 00000100:00000040:1.0:1783952264.291197:0:67035:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1783952264.291213:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465639936 00000100:00100000:1.0:1783952264.291216:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465639936 00000020:00000040:1.0:1783952264.291217:0:67035:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6153 00000020:00000040:1.0:1783952264.291219:0:67035:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f6800 refcount=5 00000020:00000040:1.0:1783952264.291224:0:67035:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 14 - evictor 00000100:00100000:1.0:1783952264.291238:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465640576 00000100:00100000:1.0:1783952264.291240:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465640576 00000020:00000040:1.0:1783952264.291241:0:67035:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb615a 00000020:00000040:1.0:1783952264.291243:0:67035:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f7800 refcount=5 00000100:00100000:1.0:1783952264.291261:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465640064 00000100:00100000:1.0:1783952264.291264:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465640064 00000020:00000040:1.0:1783952264.291265:0:67035:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafef1 00000020:00000040:1.0:1783952264.291267:0:67035:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b32800 refcount=5 00000020:00000040:1.0:1783952264.291273:0:67035:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 10 - evictor 00000100:00100000:1.0:1783952264.291286:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00000040:1.0:1783952264.291288:0:67035:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f2800 : new rpc_count 1 00000100:00000040:1.0:1783952264.291292:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e77100 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291301:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465641088:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952264.291311:0:67035:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465641088 00000100:00000040:1.0:1783952264.291315:0:67035:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952264.291318:0:67035:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.291333:0:67035:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b14de1f480 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.291344:0:67035:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952264.291348:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e77100 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291355:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465641088:12345-0@lo:400:kworker.0 Request processed in 55us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952264.291361:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00000040:1.0:1783952264.291363:0:67035:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f2800 : new rpc_count 0 00000020:00000040:1.0:1783952264.291367:0:67035:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f2800 : new refcount 4 00000100:00100000:1.0:1783952264.291374:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00000040:1.0:1783952264.291376:0:67035:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f6800 : new rpc_count 1 00000100:00000040:1.0:1783952264.291379:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e76d80 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291388:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465639936:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952264.291403:0:67035:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465639936 00000100:00000040:1.0:1783952264.291407:0:67035:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952264.291410:0:67035:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.291425:0:67035:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b1447b1180 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.291435:0:67035:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952264.291439:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e76d80 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291445:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465639936:12345-0@lo:400:kworker.0 Request processed in 59us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952264.291450:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00000040:1.0:1783952264.291452:0:67035:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f6800 : new rpc_count 0 00000020:00000040:1.0:1783952264.291457:0:67035:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f6800 : new refcount 4 00000100:00100000:1.0:1783952264.291464:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00000040:1.0:1783952264.291466:0:67035:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f7800 : new rpc_count 1 00000100:00000040:1.0:1783952264.291469:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e76300 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291478:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465640576:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952264.291486:0:67035:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465640576 00000100:00000040:1.0:1783952264.291489:0:67035:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952264.291492:0:67035:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.291504:0:67035:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b14de1dc00 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.291513:0:67035:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952264.291517:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e76300 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291533:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465640576:12345-0@lo:400:kworker.0 Request processed in 55us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952264.291538:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00000040:1.0:1783952264.291540:0:67035:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f7800 : new rpc_count 0 00000020:00000040:1.0:1783952264.291545:0:67035:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f7800 : new refcount 4 00000100:00100000:1.0:1783952264.291552:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00000040:1.0:1783952264.291555:0:67035:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b32800 : new rpc_count 1 00000100:00000040:1.0:1783952264.291558:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e75f80 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291568:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465640064:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952264.291578:0:67035:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465640064 00000100:00000040:1.0:1783952264.291581:0:67035:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952264.291584:0:67035:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.291635:0:67035:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b1447b3800 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.291648:0:67035:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952264.291652:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e75f80 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291660:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465640064:12345-0@lo:400:kworker.0 Request processed in 94us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952264.291666:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00000040:1.0:1783952264.291668:0:67035:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b32800 : new rpc_count 0 00000020:00000040:1.0:1783952264.291673:0:67035:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b32800 : new refcount 4 00000100:00100000:1.0:1783952264.291710:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465640704 00000100:00100000:1.0:1783952264.291715:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465640704 00000020:00000040:1.0:1783952264.291717:0:23862:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5fe7 00000020:00000040:1.0:1783952264.291725:0:23862:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04965f000 refcount=5 00000100:00000040:1.0:1783952264.291737:0:23862:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1783952264.291755:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465640192 00000100:00100000:1.0:1783952264.291758:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465640192 00000020:00000040:1.0:1783952264.291759:0:23862:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5faf 00000020:00000040:1.0:1783952264.291761:0:23862:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c5000 refcount=7 00000100:00100000:1.0:1783952264.291778:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00000040:1.0:1783952264.291780:0:23862:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b04965f000 : new rpc_count 1 00000100:00000040:1.0:1783952264.291784:0:23862:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e74380 x1870605465640704/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291793:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465640704:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952264.291804:0:23862:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465640704 00000100:00000040:1.0:1783952264.291808:0:23862:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952264.291811:0:23862:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.291828:0:23862:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b14de1c000 x1870605465640704/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.291838:0:23862:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952264.291841:0:23862:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e74380 x1870605465640704/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291847:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465640704:12345-0@lo:400:kworker.0 Request processed in 56us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952264.291852:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00000040:1.0:1783952264.291854:0:23862:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b04965f000 : new rpc_count 0 00000020:00000040:1.0:1783952264.291859:0:23862:0:(genops.c:900:class_export_put()) PUTting export ffff97b04965f000 : new refcount 4 00000100:00100000:1.0:1783952264.291866:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00000040:1.0:1783952264.291868:0:23862:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c5000 : new rpc_count 1 00000100:00000040:1.0:1783952264.291871:0:23862:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e75c00 x1870605465640192/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291893:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465640192:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952264.291901:0:23862:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870605465640192 00000100:00000040:1.0:1783952264.291905:0:23862:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952264.291908:0:23862:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.291922:0:23862:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b1447b2a00 x1870605465640192/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.291933:0:23862:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952264.291936:0:23862:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e75c00 x1870605465640192/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.291944:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465640192:12345-0@lo:400:kworker.0 Request processed in 53us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952264.291950:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00000040:1.0:1783952264.291952:0:23862:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c5000 : new rpc_count 0 00000020:00000040:1.0:1783952264.291957:0:23862:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c5000 : new refcount 6 00000100:00080000:1.0:1783952264.291983:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1783952264.291986:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff97b167c13380) now 10 - evictor 00000100:00080000:1.0:1783952264.291989:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1783952264.291991:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff97b0468a4d40) now 14 - evictor 00000100:00080000:1.0:1783952264.291993:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1783952264.291995:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:1.0:1783952264.292038:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:1.0:1783952264.292044:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b2a00 x1870605465640192/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.292052:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b2a00 x1870605465640192/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.292059:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465640192:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.292079:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968959 00000100:00000040:1.0:1783952264.292082:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14de1fb80 x1870605465640960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.292089:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de1fb80 x1870605465640960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.292095:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465640960:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.292104:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1783952264.292107:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b3800 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.292114:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b3800 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.292119:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465640064:0@lo:400:kworker.0 00000100:00000040:1.0:1783952264.292127:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1783952264.292130:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14de1c000 x1870605465640704/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.292137:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de1c000 x1870605465640704/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.292144:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465640704:0@lo:400:kworker.0 00000100:00000040:2.0:1783952264.292328:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b16dd4c000 x1870605465640320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.292340:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465640320:0@lo:8:kworker.0 00000100:00000040:2.0:1783952264.292359:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b16dd4c000 x1870605465640320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952289 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.292366:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952264.292384:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b1756e1500 x1870605465640320 msgsize 520 00000100:00100000:2.0:1783952264.292388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952264.292404:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b16dd4c000 x1870605465640320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952289 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.292414:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5568 usecs (6 jiffies) 00000100:00000040:2.0:1783952264.292421:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14de1df80 x1870605465640832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.292430:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465640832:0@lo:8:kworker.0 00000100:00000040:2.0:1783952264.292441:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14de1df80 x1870605465640832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952289 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.292447:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952264.292458:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b1756e0000 x1870605465640832 msgsize 520 00000100:00100000:2.0:1783952264.292462:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952264.292473:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14de1df80 x1870605465640832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952289 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.292495:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8780 usecs (9 jiffies) 00000100:00100000:2.0:1783952264.292515:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465640320 00000100:00100000:2.0:1783952264.292519:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465640320 00000020:00000040:2.0:1783952264.292521:0:8494:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe50 00000100:00100000:2.0:1783952264.292542:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465640832 00000100:00100000:2.0:1783952264.292545:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465640832 00000020:00000040:2.0:1783952264.292547:0:8494:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6011 00000100:00100000:2.0:1783952264.292559:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5041 00000100:00000040:2.0:1783952264.292563:0:8494:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1756e1500 x1870605465640320/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.292571:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1870605465640320:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783952264.292628:0:8494:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1783952264.292637:0:8494:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952264.292640:0:8494:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952264.292643:0:8494:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952264.292659:0:8494:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff97b16dd4c000 x1870605465640320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952289 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.292676:0:8494:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952264.292680:0:8494:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e1500 x1870605465640320/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783952284 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.292687:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1870605465640320:12345-0@lo:8:kworker.0 Request processed in 116us (302us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952264.292693:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5041 00000100:00100000:2.0:1783952264.292720:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5042 00000100:00000040:2.0:1783952264.292724:0:8494:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1756e0000 x1870605465640832/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.292730:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1870605465640832:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783952264.292747:0:8494:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1783952264.292756:0:8494:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952264.292758:0:8494:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952264.292761:0:8494:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952264.292775:0:8494:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff97b14de1df80 x1870605465640832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952289 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.292787:0:8494:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952264.292790:0:8494:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e0000 x1870605465640832/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783952284 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.292796:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1870605465640832:12345-0@lo:8:kworker.0 Request processed in 66us (337us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783952264.292802:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5042 00000100:00000040:2.0:1783952264.292830:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b16dd4c000 x1870605465640320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952289 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952264.292839:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952264.292842:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1783952264.292846:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16dd4c000 x1870605465640320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952289 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.292852:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465640320:0@lo:8:kworker.0 00000100:00000040:2.0:1783952264.292862:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14de1df80 x1870605465640832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952289 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783952264.292867:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783952264.292871:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1783952264.292874:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de1df80 x1870605465640832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952289 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.292891:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465640832:0@lo:8:kworker.0 00000100:00000040:2.0:1783952264.292897:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b16dd4c000 x1870605465640320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952289 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952264.292909:0:3641:0:(genops.c:1244:class_import_put()) import ffff97b15f80e000 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1783952264.292917:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14de1df80 x1870605465640832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952289 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952264.292923:0:3641:0:(genops.c:1244:class_import_put()) import ffff97b143af6800 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1783952264.293859:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783952264.293872:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b1180 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.293885:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b1180 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.293893:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465639936:0@lo:400:kworker.0 00000100:00000040:2.0:1783952264.293906:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783952264.293910:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14de1dc00 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.293919:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de1dc00 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.293926:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465640576:0@lo:400:kworker.0 00000100:00000040:2.0:1783952264.293940:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b1c00 x1870605465639808/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.293950:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b1c00 x1870605465639808/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.293976:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465639808:0@lo:400:kworker.0 00000100:00000040:2.0:1783952264.293990:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:2.0:1783952264.293994:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b16dd4e300 x1870605465640448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.294001:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16dd4e300 x1870605465640448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.294007:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b16dd4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465640448:0@lo:400:kworker.0 00000100:00000040:2.0:1783952264.294020:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1783952264.294023:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14de1f480 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.294031:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de1f480 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.294038:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465641088:0@lo:400:kworker.0 00000100:00000040:2.0:1783952264.294043:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b1180 x1870605465639936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952264.294051:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b046b43800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1783952264.294059:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14de1dc00 x1870605465640576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952264.294065:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b0410da800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1783952264.294069:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b1c00 x1870605465639808/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952264.294076:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000100:00000040:2.0:1783952264.294079:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b16dd4e300 x1870605465640448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952264.294092:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b166f50000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1783952264.294097:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14de1f480 x1870605465641088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952264.294103:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b176be7000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000040:3.0:1783952264.294192:0:94421:0:(genops.c:1231:class_import_get()) import ffff97b15036a000 refcount=4 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1783952264.294220:0:94421:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007eb29408] to pc [ptlrpcd_00_03+3] req@ffff97b14deb8a80 x1870605465641216/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.294294:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:2.0:1783952264.294301:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14deb8a80 x1870605465641216/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.294321:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465641216:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1783952264.294342:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14deb8a80 x1870605465641216/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.294350:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952264.294376:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b1756e1f80 x1870605465641216 msgsize 224 00000100:00100000:2.0:1783952264.294380:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952264.294403:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14deb8a80 x1870605465641216/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.294415:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5735 usecs (6 jiffies) 00000100:00100000:3.0:1783952264.294522:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465641216 00000100:00100000:3.0:1783952264.294530:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465641216 00000020:00000040:3.0:1783952264.294532:0:23862:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5fe7 00000020:00000040:3.0:1783952264.294536:0:23862:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04965f000 refcount=5 00000100:00000040:3.0:1783952264.294556:0:23862:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1783952264.294607:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00000040:3.0:1783952264.294640:0:23862:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b04965f000 : new rpc_count 1 00000100:00000040:3.0:1783952264.294646:0:23862:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1756e1f80 x1870605465641216/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.294657:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1756e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465641216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952264.294694:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00010000:00000040:3.0:1783952264.294704:0:23862:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465641216 00000100:00000040:3.0:1783952264.294720:0:23862:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:3.0:1783952264.294724:0:23862:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952264.294743:0:23862:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b14deb8a80 x1870605465641216/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952264.294762:0:23862:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:3.0:1783952264.294774:0:23862:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1756e1f80 x1870605465641216/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:525/0 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.294782:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1756e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465641216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952264.294788:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00000040:3.0:1783952264.294791:0:23862:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b04965f000 : new rpc_count 0 00000020:00000040:3.0:1783952264.294800:0:23862:0:(genops.c:900:class_export_put()) PUTting export ffff97b04965f000 : new refcount 4 00000100:00000040:3.0:1783952264.294823:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1783952264.294828:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14deb8a80 x1870605465641216/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1783952264.294838:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352909 avail=317206 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023681 state=0: rc = 0 00000100:00000040:3.0:1783952264.294846:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8a80 x1870605465641216/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.294853:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465641216:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1783952264.294858:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14deb8a80 x1870605465641216/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952264.294865:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b15036a000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1783952264.295102:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b2a00 x1870605465640192/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952264.295113:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b048caf800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1783952264.295120:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14de1fb80 x1870605465640960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952264.295127:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b14f00d800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1783952264.295140:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b3800 x1870605465640064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952264.295148:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b046a94800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1783952264.295153:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14de1c000 x1870605465640704/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952264.295159:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b15036a000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1783952264.694390:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b143746850 x1870605447847040 msgsize 224 00000100:00100000:1.0:1783952264.694406:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:1.0:1783952264.694408:0:3635:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783952264.694442:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e77800 x1870605447847296 msgsize 224 00000100:00100000:1.0:1783952264.694447:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:1.0:1783952264.694475:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e76680 x1870605447847168 msgsize 224 00000100:00100000:1.0:1783952264.694480:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:1.0:1783952264.694503:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e74000 x1870605447847424 msgsize 520 00000100:00100000:1.0:1783952264.694508:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952264.694556:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447847296 00000100:00100000:0.0:1783952264.694565:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447847296 00000020:00000040:0.0:1783952264.694568:0:67035:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb55c2 00000020:00000040:0.0:1783952264.694574:0:67035:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0410df000 refcount=11 00000020:00000040:0.0:1783952264.694640:0:67035:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 10 - evictor 00000100:00000040:0.0:1783952264.694668:0:67035:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1783952264.694693:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447847168 00000100:00100000:0.0:1783952264.694697:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447847168 00000020:00000040:0.0:1783952264.694698:0:67035:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5fb6 00000020:00000040:0.0:1783952264.694700:0:67035:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c3800 refcount=51 00000020:00000040:0.0:1783952264.694717:0:67035:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 14 - evictor 00000100:00100000:0.0:1783952264.694739:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1497 00000100:00000040:0.0:1783952264.694742:0:67035:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0410df000 : new rpc_count 1 00000100:00000040:0.0:1783952264.694750:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e77800 x1870605447847296/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952264.694762:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2401:x1870605447847296:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:0.0:1783952264.694801:0:67035:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411471, transno 0, xid 1870605447847296 00000100:00000040:0.0:1783952264.694812:0:67035:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952264.694819:0:67035:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952264.694859:0:67035:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952264.694866:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e77800 x1870605447847296/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952264.694892:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2401:x1870605447847296:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 130us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952264.694899:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1497 00000100:00000040:0.0:1783952264.694903:0:67035:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0410df000 : new rpc_count 0 00000020:00000040:0.0:1783952264.694913:0:67035:0:(genops.c:900:class_export_put()) PUTting export ffff97b0410df000 : new refcount 10 00000100:00100000:0.0:1783952264.694922:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1498 00000100:00000040:0.0:1783952264.694925:0:67035:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c3800 : new rpc_count 1 00000100:00000040:0.0:1783952264.694928:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e76680 x1870605447847168/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952264.694939:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2401:x1870605447847168:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:0.0:1783952264.694950:0:67035:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1870605447847168 00000100:00000040:0.0:1783952264.694955:0:67035:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952264.694958:0:67035:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952264.694973:0:67035:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952264.694977:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e76680 x1870605447847168/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952264.694986:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2401:x1870605447847168:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 49us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952264.694992:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1498 00000100:00000040:0.0:1783952264.694994:0:67035:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c3800 : new rpc_count 0 00000020:00000040:0.0:1783952264.694999:0:67035:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c3800 : new refcount 50 00000100:00100000:3.0:1783952264.696075:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447847040 00000100:00100000:3.0:1783952264.696084:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447847040 00000020:00000040:3.0:1783952264.696086:0:94415:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6065 00000020:00000040:3.0:1783952264.696091:0:94415:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f5000 refcount=10 00000100:00000040:3.0:1783952264.696108:0:94415:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783952264.696132:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 189 00000100:00000040:3.0:1783952264.696135:0:94415:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f5000 : new rpc_count 1 00000100:00000040:3.0:1783952264.696140:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b143746850 x1870605447847040/t0(0) o400->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.696151:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b143746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447847040:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:3.0:1783952264.696171:0:94415:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605447847040 00000100:00000040:3.0:1783952264.696178:0:94415:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952264.696181:0:94415:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952264.696202:0:94415:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952264.696207:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b143746850 x1870605447847040/t0(0) o400->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.696215:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b143746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447847040:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 66us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952264.696220:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 189 00000100:00000040:3.0:1783952264.696223:0:94415:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f5000 : new rpc_count 0 00000020:00000040:3.0:1783952264.696230:0:94415:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f5000 : new refcount 9 00000100:00000040:1.0:1783952264.697576:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b177317100 x1870605447847552 msgsize 224 00000100:00080000:0.0:1783952264.697838:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1783952264.697844:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff97b0468a4d40) now 14 - evictor 00000100:00080000:0.0:1783952264.697848:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1783952264.697850:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff97b167c13380) now 10 - evictor 00000100:00100000:1.0:1783952264.698399:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952264.698668:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447847424 00000100:00100000:3.0:1783952264.698678:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447847424 00000020:00000040:3.0:1783952264.698681:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6360 00000100:00100000:3.0:1783952264.698718:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447847552 00000100:00100000:3.0:1783952264.698721:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447847552 00000020:00000040:3.0:1783952264.698723:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6367 00000020:00000040:3.0:1783952264.698726:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1746c9000 refcount=7 00000020:00000040:3.0:1783952264.698738:0:8433:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:3.0:1783952264.698757:0:8433:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1783952264.698793:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2933 00000100:00000040:3.0:1783952264.698797:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1746c9000 : new rpc_count 1 00000100:00000040:3.0:1783952264.698804:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177317100 x1870605447847552/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.698818:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447847552:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:3.0:1783952264.698841:0:8433:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605447847552 00000100:00000040:3.0:1783952264.698851:0:8433:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952264.698866:0:8433:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952264.698901:0:8433:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952264.698906:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177317100 x1870605447847552/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:525/0 lens 224/224 e 0 to 0 dl 1783952275 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.698915:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447847552:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 100us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952264.698921:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2933 00000100:00000040:3.0:1783952264.698924:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1746c9000 : new rpc_count 0 00000020:00000040:3.0:1783952264.698933:0:8433:0:(genops.c:900:class_export_put()) PUTting export ffff97b1746c9000 : new refcount 6 00000100:00100000:3.0:1783952264.698943:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5043 00000100:00000040:3.0:1783952264.698946:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e74000 x1870605447847424/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.698954:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1870605447847424:12345-192.168.202.48@tcp:8:kworker.0 00010000:00020000:3.0:1783952264.698975:0:8433:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.48@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1783952264.698987:0:8433:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952264.698990:0:8433:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952264.698993:0:8433:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952264.699005:0:8433:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952264.699008:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e74000 x1870605447847424/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783952284 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.699015:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1870605447847424:12345-192.168.202.48@tcp:8:kworker.0 Request processed in 61us (4510us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783952264.699021:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5043 00000100:00080000:1.0:1783952264.699514:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1783952264.699519:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00010000:00010000:2.0:1783952264.737103:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1783952264.800709:0:94425:0:(genops.c:1231:class_import_get()) import ffff97b14f00d800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1783952264.800747:0:94425:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007eb29408] to pc [ptlrpcd_00_00+0] req@ffff97b14deb8a80 x1870605465641344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.800812:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14deb8a80 x1870605465641344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.800826:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465641344:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1783952264.800854:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14deb8a80 x1870605465641344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952280 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.800863:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952264.800900:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b1447b3800 x1870605465641344 msgsize 224 00000100:00100000:2.0:1783952264.800905:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952264.800930:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14deb8a80 x1870605465641344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952264.800955:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8230 usecs (9 jiffies) 00000100:00100000:3.0:1783952264.801022:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465641344 00000100:00100000:3.0:1783952264.801028:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465641344 00000020:00000040:3.0:1783952264.801030:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb601f 00000020:00000040:3.0:1783952264.801034:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b11800 refcount=5 00000100:00000040:3.0:1783952264.801050:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1783952264.801076:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289 00000100:00000040:3.0:1783952264.801081:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b11800 : new rpc_count 1 00000100:00000040:3.0:1783952264.801086:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1447b3800 x1870605465641344/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.801098:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465641344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952264.801128:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:3.0:1783952264.801138:0:8438:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968959, transno 0, xid 1870605465641344 00000100:00000040:3.0:1783952264.801145:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:3.0:1783952264.801149:0:8438:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952264.801166:0:8438:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b14deb8a80 x1870605465641344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952264.801191:0:8438:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:3.0:1783952264.801196:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b3800 x1870605465641344/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:525/0 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952264.801205:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465641344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952264.801212:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289 00000100:00000040:3.0:1783952264.801215:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b11800 : new rpc_count 0 00000020:00000040:3.0:1783952264.801224:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b11800 : new refcount 4 00000100:00000040:2.0:1783952264.801245:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968959 00000100:00000040:2.0:1783952264.801252:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14deb8a80 x1870605465641344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1783952264.801261:0:3642:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1783952264.801264:0:3642:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1783952264.801272:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8a80 x1870605465641344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952264.801279:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465641344:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1783952264.801285:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14deb8a80 x1870605465641344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952264.801295:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b14f00d800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000020:00000040:1.0:1783952264.808915:0:75701:0:(genops.c:1231:class_import_get()) import ffff97b048caf800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1783952264.808957:0:75701:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000019e93690] to pc [ptlrpcd_00_01+1] req@ffff97b177317b80 x1870605465641472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.809005:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177317b80 x1870605465641472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.809017:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465641472:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1783952264.809045:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177317b80 x1870605465641472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.809068:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.809107:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b177316300 x1870605465641472 msgsize 224 00000100:00100000:1.0:1783952264.809111:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952264.809132:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177317b80 x1870605465641472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.809146:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1614070 usecs (1615 jiffies) 00000100:00100000:1.0:1783952264.809176:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465641472 00000100:00100000:1.0:1783952264.809184:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465641472 00000020:00000040:1.0:1783952264.809187:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5faf 00000020:00000040:1.0:1783952264.809191:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c5000 refcount=7 00000100:00000040:1.0:1783952264.809211:0:8445:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1783952264.809234:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00000040:1.0:1783952264.809238:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c5000 : new rpc_count 1 00000100:00000040:1.0:1783952264.809244:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177316300 x1870605465641472/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:525/0 lens 224/0 e 0 to 0 dl 1783952275 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.809254:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465641472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783952264.809287:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00010000:00000040:1.0:1783952264.809297:0:8445:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870605465641472 00000100:00000040:1.0:1783952264.809305:0:8445:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952264.809310:0:8445:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952264.809324:0:8445:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b177317b80 x1870605465641472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952264.809339:0:8445:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952264.809343:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177316300 x1870605465641472/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:525/0 lens 224/368 e 0 to 0 dl 1783952275 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.809351:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465641472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952264.809367:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00000040:1.0:1783952264.809370:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c5000 : new rpc_count 0 00000020:00000040:1.0:1783952264.809380:0:8445:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c5000 : new refcount 6 00000100:00000040:1.0:1783952264.809409:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:1.0:1783952264.809416:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177317b80 x1870605465641472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1783952264.809425:0:3643:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352834 avail=317131 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023577 state=0: rc = 0 00000100:00000040:1.0:1783952264.809431:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177317b80 x1870605465641472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952264.809439:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465641472:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1783952264.809445:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177317b80 x1870605465641472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952264.809456:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b048caf800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:01000004:3.0:1783952265.558049:0:96984:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783952265.558053:0:96984:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783952265.558054:0:96984:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783952265.558229:0:96984:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97b17484c000 00000020:01000004:3.0:1783952265.558243:0:96984:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783952265.558258:0:96984:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783952265.558271:0:96984:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97b0489bcd40) 00000020:00000040:3.0:1783952265.558279:0:96984:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b17484b800 with handle 0x22c73c7857bb6ef8 to hash 00000020:00000040:3.0:1783952265.558285:0:96984:0:(genops.c:900:class_export_put()) PUTting export ffff97b17484b800 : new refcount 1 00000020:00000040:3.0:1783952265.558377:0:96984:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff97b0489bcd40) now 2 - obd_device_list 00000020:00000080:3.0:1783952265.558382:0:96984:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1783952265.764306:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1783952265.829077:0:75705:0:(genops.c:1231:class_import_get()) import ffff97b166f50000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783952265.829114:0:75705:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000019e93690] to pc [ptlrpcd_00_02+2] req@ffff97b177317b80 x1870605465641600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952265.829192:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177317b80 x1870605465641600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952265.829203:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465641600:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1783952265.829229:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177317b80 x1870605465641600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952281 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952265.829235:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952265.829266:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b14deb9880 x1870605465641600 msgsize 224 00000100:00100000:3.0:1783952265.829269:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952265.829297:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177317b80 x1870605465641600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952281 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952265.829308:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5515 usecs (6 jiffies) 00000100:00100000:1.0:1783952265.831422:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465641600 00000100:00100000:1.0:1783952265.831437:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465641600 00000020:00000040:1.0:1783952265.831440:0:11087:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe7a 00000020:00000040:1.0:1783952265.831445:0:11087:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b143cde000 refcount=5 00000100:00000040:1.0:1783952265.831477:0:11087:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1783952265.831514:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290 00000100:00000040:1.0:1783952265.831518:0:11087:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b143cde000 : new rpc_count 1 00000100:00000040:1.0:1783952265.831526:0:11087:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14deb9880 x1870605465641600/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:526/0 lens 224/0 e 0 to 0 dl 1783952276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952265.831539:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465641600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952265.831573:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:1.0:1783952265.831584:0:11087:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870605465641600 00000100:00000040:1.0:1783952265.831631:0:11087:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952265.831636:0:11087:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952265.831679:0:11087:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b177317b80 x1870605465641600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952281 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952265.831708:0:11087:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952265.831713:0:11087:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb9880 x1870605465641600/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:526/0 lens 224/368 e 0 to 0 dl 1783952276 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952265.831721:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465641600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 184us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952265.831727:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290 00000100:00000040:1.0:1783952265.831731:0:11087:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b143cde000 : new rpc_count 0 00000020:00000040:1.0:1783952265.831740:0:11087:0:(genops.c:900:class_export_put()) PUTting export ffff97b143cde000 : new refcount 4 00000100:00000040:3.0:1783952265.832737:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:3.0:1783952265.832748:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177317b80 x1870605465641600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1783952265.832759:0:3644:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1783952265.832763:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1783952265.832771:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177317b80 x1870605465641600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952281 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952265.832779:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465641600:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1783952265.832798:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177317b80 x1870605465641600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952281 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952265.832807:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b166f50000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000001:00000040:2.0:1783952266.068540:0:96984:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:0.0:1783952266.081555:0:96984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783952266.082884:0:96984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783952266.082911:0:96984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1783952266.082933:0:96984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783952266.082953:0:96984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783952266.082974:0:96984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783952266.082995:0:96984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1783952266.083412:0:96984:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:0.0:1783952266.083583:0:96984:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff97b0489bcd40) now 3 - setup 00000020:00000080:0.0:1783952266.083693:0:96984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783952266.083703:0:96984:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000040:0.0:1783952266.083709:0:96984:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b174b35800 with handle 0x22c73c7857bb6eff to hash 00000020:00000040:0.0:1783952266.083715:0:96984:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff97b0489bcd40) now 4 - export 00000020:00000040:0.0:1783952266.083717:0:96984:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b35800 : new refcount 1 00000020:00000080:0.0:1783952266.083720:0:96984:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x22c73c7857bb6eff 00000020:00000040:0.0:1783952266.083722:0:96984:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6eff 00000020:00000040:0.0:1783952266.083723:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b35800 refcount=2 00000020:01000004:0.0:1783952266.083729:0:96984:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783952266.083746:0:96984:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.148@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783952266.083748:0:96984:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783952266.083753:0:96984:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783952266.083775:0:96984:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783952266.083778:0:96984:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:0.0:1783952266.084216:0:96984:0:(genops.c:889:class_export_get()) GET export ffff97b17484b800 refcount=2 00000040:00000040:0.0:1783952266.084220:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b17496d900 : new refcount 2 00000040:00000040:0.0:1783952266.086205:0:96984:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b17496d900 : new refcount 1 00000040:01000000:0.0:1783952266.086211:0:96984:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.148@tcp ctxt 0 is initialized 10000000:00000040:0.0:1783952266.086214:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b17496d900 : new refcount 2 10000000:00000040:0.0:1783952266.086216:0:96984:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b17496d900 : new refcount 1 00000020:00000040:0.0:1783952266.086218:0:96984:0:(obd_config.c:994:class_incref()) incref MGC192.168.202.148@tcp (ffff97b167c90000) now 6 - mgc_fs 00000020:01000004:0.0:1783952266.086257:0:96984:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.148@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1783952266.086261:0:96984:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783952266.086263:0:96984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783952266.086264:0:96984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952266.086265:0:96984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952266.086266:0:96984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952266.086267:0:96984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952266.086268:0:96984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783952266.086270:0:96984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952266.086271:0:96984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783952266.086274:0:96984:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1783952266.086276:0:96984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783952266.086277:0:96984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783952266.086278:0:96984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952266.086279:0:96984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952266.086281:0:96984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952266.086281:0:96984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952266.086283:0:96984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783952266.086284:0:96984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952266.086285:0:96984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:0.0:1783952266.086355:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 10000000:01000000:0.0:1783952266.086378:0:96984:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:0.0:1783952266.086396:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b166fb2a00 x1870605465641728/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.086410:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465641728:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1783952266.086437:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b166fb2a00 x1870605465641728/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.086445:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.086485:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b177065850 x1870605465641728 msgsize 4848 00000100:00100000:0.0:1783952266.086488:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.086490:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783952266.086557:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b166fb2a00 x1870605465641728/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.086583:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1775d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1783952266.086671:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465641728 00000100:00100000:1.0:1783952266.086678:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465641728 00000020:00000040:1.0:1783952266.086681:0:94410:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:1.0:1783952266.086685:0:94410:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=21 00000100:00000040:1.0:1783952266.086706:0:94410:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783952266.086781:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:1.0:1783952266.086785:0:94410:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:1.0:1783952266.086790:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177065850 x1870605465641728/t0(0) o253->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 4848/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.086802:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:96984:x1870605465641728:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783952266.086832:0:94410:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783952266.086835:0:94410:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783952266.086839:0:94410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:1.0:1783952266.087280:0:94410:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465641728 00000100:00000040:1.0:1783952266.087301:0:94410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:1.0:1783952266.087306:0:94410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.087331:0:94410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff97b166fb2a00 x1870605465641728/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.087357:0:94410:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:1.0:1783952266.087362:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177065850 x1870605465641728/t0(0) o253->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 4848/4768 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.087372:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:96984:x1870605465641728:12345-0@lo:253:mount.lustre.0 Request processed in 573us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952266.087380:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:1.0:1783952266.087383:0:94410:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:1.0:1783952266.087393:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 20 00000100:00000040:0.0:1783952266.087461:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b166fb2a00 x1870605465641728/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.087472:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb2a00 x1870605465641728/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.087480:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465641728:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1783952266.087488:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b166fb2a00 x1870605465641728/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783952266.087497:0:96984:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783952266.087500:0:96984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783952266.087501:0:96984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783952266.087502:0:96984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783952266.087503:0:96984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783952266.087504:0:96984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783952266.087506:0:96984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783952266.087507:0:96984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783952266.087508:0:96984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783952266.087509:0:96984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:0.0:1783952266.087512:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b166fb2a00 x1870605465641728/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.087522:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000020:01000004:0.0:1783952266.087537:0:96984:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97b17484c000 from lustre-OST0000 10000000:01000000:0.0:1783952266.087564:0:96984:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783952266.087567:0:96984:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:0.0:1783952266.087575:0:96984:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff97b1522d5400) refs 5 10000000:01000000:0.0:1783952266.087578:0:96984:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97b167c90000 local copy 00000020:00000040:0.0:1783952266.087582:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b140030e00 refcount=2 00010000:00010000:0.0:1783952266.087626:0:96984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6543 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:0.0:1783952266.087651:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b14ed84b40 : new refcount 2 10000000:00000040:0.0:1783952266.087653:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b17496d900 : new refcount 2 10000000:00000040:0.0:1783952266.087662:0:96984:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.202.148@tcp: copy local log lustre-sptlrpc 00000020:00000040:0.0:1783952266.087700:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:0.0:1783952266.087704:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:0.0:1783952266.087725:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b166fb2a00 x1870605465641856/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.087735:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465641856:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783952266.087748:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b166fb2a00 x1870605465641856/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.087754:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.087772:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b177066050 x1870605465641856 msgsize 512 00000100:00100000:0.0:1783952266.087776:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.087778:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783952266.087958:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b166fb2a00 x1870605465641856/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.087976:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1775d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.088054:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465641856 00000100:00100000:2.0:1783952266.088060:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465641856 00000020:00000040:2.0:1783952266.088062:0:94412:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.088064:0:94412:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=21 00000100:00000040:2.0:1783952266.088082:0:94412:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.088113:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:2.0:1783952266.088117:0:94412:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.088122:0:94412:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177066050 x1870605465641856/t0(0) o501->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 512/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.088133:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:96984:x1870605465641856:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1783952266.088149:0:94412:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:2.0:1783952266.088157:0:94412:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:2.0:1783952266.088178:0:94412:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:2.0:1783952266.088182:0:94412:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465641856 00000100:00000040:2.0:1783952266.088187:0:94412:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.088191:0:94412:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.088209:0:94412:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff97b166fb2a00 x1870605465641856/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.088225:0:94412:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952266.088229:0:94412:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177066050 x1870605465641856/t0(0) o501->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 512/272 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.088237:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:96984:x1870605465641856:12345-0@lo:501:mount.lustre.0 Request processed in 106us (464us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783952266.088243:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:2.0:1783952266.088246:0:94412:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.088253:0:94412:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 20 00000100:00000040:0.0:1783952266.088425:0:96984:0:(client.c:1497:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff97b166fb2a00 x1870605465641856/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.088433:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b166fb2a00 x1870605465641856/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.088441:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb2a00 x1870605465641856/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.088449:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465641856:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783952266.088455:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b166fb2a00 x1870605465641856/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.088463:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000100:00000040:0.0:1783952266.088467:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b166fb2a00 x1870605465641856/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.088480:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 10000000:01000000:0.0:1783952266.088486:0:96984:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783952266.088505:0:96984:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:0.0:1783952266.088509:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b140030e00 refcount=3 00010000:00010000:0.0:1783952266.088513:0:96984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6543 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.088522:0:96984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6543 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952266.088547:0:96984:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97b17484c000 10000000:01000000:0.0:1783952266.088551:0:96984:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:0.0:1783952266.088555:0:96984:0:(genops.c:889:class_export_get()) GET export ffff97b1476ff800 refcount=18 10000000:00000040:0.0:1783952266.088558:0:96984:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff97b174aad600) refs 4 10000000:01000000:0.0:1783952266.088560:0:96984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783952266.088562:0:96984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:0.0:1783952266.088564:0:96984:0:(genops.c:889:class_export_get()) GET export ffff97b1476ff800 refcount=19 10000000:01000000:0.0:1783952266.088568:0:96984:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783952266.088570:0:96984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:0.0:1783952266.088574:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00010000:00000040:0.0:1783952266.088622:0:96984:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b158d55c00 count: 8 00000020:00000040:0.0:1783952266.088631:0:96984:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b050cbcc00 with handle 0x22c73c7857bb6f06 to hash 00010000:00010000:0.0:1783952266.088636:0:96984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb6f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.088643:0:96984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb6f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.088653:0:96984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb6f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783952266.088674:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b166fb2a00 x1870605465641984/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.088683:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465641984:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1783952266.088694:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b166fb2a00 x1870605465641984/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.088702:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.088716:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b16595f450 x1870605465641984 msgsize 328 00000100:00100000:0.0:1783952266.088720:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.088722:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783952266.088731:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b166fb2a00 x1870605465641984/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.088746:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1775d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.088798:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465641984 00000100:00100000:2.0:1783952266.088803:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465641984 00000020:00000040:2.0:1783952266.088805:0:94412:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.088808:0:94412:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=21 00000100:00000040:2.0:1783952266.088818:0:94412:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.088841:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:2.0:1783952266.088843:0:94412:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.088847:0:94412:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16595f450 x1870605465641984/t0(0) o101->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.088858:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+21:96984:x1870605465641984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783952266.088867:0:94412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1783952266.088874:0:94412:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b15f403900 count: 10 00000020:00000040:2.0:1783952266.088879:0:94412:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b1414a3a00 with handle 0x22c73c7857bb6f0d to hash 00010000:00010000:2.0:1783952266.088889:0:94412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1414a3a00/0x22c73c7857bb6f0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6f06 expref: -99 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.088896:0:94412:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff97b1445c4000 : new locks_count 16 00000020:00000040:2.0:1783952266.088898:0:94412:0:(genops.c:889:class_export_get()) GET export ffff97b1445c4000 refcount=22 00010000:00000040:2.0:1783952266.088912:0:94412:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff97b15f403900) refcount = 10 00010000:00000040:2.0:1783952266.088915:0:94412:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1783952266.088918:0:94412:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b14d86ac00/0x22c73c7857bb6543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb653c expref: 22 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.088926:0:94412:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b140031400/0x22c73c7857bb6519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6512 expref: 22 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.088933:0:94412:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb650b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6504 expref: 22 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.088939:0:94412:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b14d86a200/0x22c73c7857bb64fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64f6 expref: 22 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.088945:0:94412:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db70400/0x22c73c7857bb64ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64e8 expref: 22 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.088951:0:94412:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b050cbd000/0x22c73c7857bb64e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64da expref: 22 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.088957:0:94412:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db70c00/0x22c73c7857bb64d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64cc expref: 22 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.088966:0:94412:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb64c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a56f expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.088973:0:94412:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a568 expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952266.088990:0:94412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1414a3a00/0x22c73c7857bb6f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6f06 expref: 22 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952266.089001:0:94412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1414a3a00/0x22c73c7857bb6f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6f06 expref: 22 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952266.089010:0:94412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1414a3a00, rc 0) 00010000:00000040:2.0:1783952266.089012:0:94412:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465641984 00000100:00000040:2.0:1783952266.089018:0:94412:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.089021:0:94412:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.089037:0:94412:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff97b166fb2a00 x1870605465641984/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.089117:0:94412:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952266.089122:0:94412:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16595f450 x1870605465641984/t0(0) o101->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/344 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.089129:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:96984:x1870605465641984:12345-0@lo:101:mount.lustre.0 Request processed in 273us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.089135:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:2.0:1783952266.089138:0:94412:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.089145:0:94412:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 21 00000100:00000040:0.0:1783952266.089211:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b166fb2a00 x1870605465641984/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.089220:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb2a00 x1870605465641984/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.089227:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465641984:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1783952266.089233:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b166fb2a00 x1870605465641984/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.089243:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b050cbcc00 refcount=4 00010000:00000040:0.0:1783952266.089247:0:96984:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff97b050cbcc00, remote cookie: 0x22c73c7857bb6f0d, flags: 0x0 00010000:00000040:0.0:1783952266.089252:0:96984:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff97b158d55c00) refcount = 8 00010000:00000040:0.0:1783952266.089255:0:96984:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1783952266.089257:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6543 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.089274:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb6512 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6519 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.089280:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b050cbd600/0x22c73c7857bb6504 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb650b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.089287:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b050cbdc00/0x22c73c7857bb64f6 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.089358:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b050cbc800/0x22c73c7857bb64e8 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.089364:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb64da lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.089370:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b14d86b800/0x22c73c7857bb64cc lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64d3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.089376:0:96984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb6f06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f0d expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.089384:0:96984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb6f06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6f0d expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783952266.089393:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b166fb2a00 x1870605465641984/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.089400:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 10000000:00000040:0.0:1783952266.089405:0:96984:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff97b167c43e00) refs 2 00000020:00000040:0.0:1783952266.089408:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b050cbcc00 refcount=3 10000000:00000040:0.0:1783952266.089429:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b14ed84b40 : new refcount 2 10000000:00000040:0.0:1783952266.089438:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b17496d900 : new refcount 2 10000000:00000040:0.0:1783952266.089440:0:96984:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.202.148@tcp: copy local log lustre-OST0000 00000040:00080000:0.0:1783952266.089743:0:96984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783952266.091762:0:96984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783952266.095461:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783952266.095513:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783952266.095527:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783952266.095539:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783952266.095552:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783952266.095565:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783952266.095617:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783952266.095624:0:96984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:0.0:1783952266.095704:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:0.0:1783952266.095713:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:0.0:1783952266.095758:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b166fb2a00 x1870605465642112/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.095773:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642112:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783952266.095802:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b166fb2a00 x1870605465642112/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.095811:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.095851:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b16595f850 x1870605465642112 msgsize 512 00000100:00100000:0.0:1783952266.095855:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.095857:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783952266.095884:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b166fb2a00 x1870605465642112/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.095912:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b048af1480 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.096024:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465642112 00000100:00100000:2.0:1783952266.096033:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465642112 00000020:00000040:2.0:1783952266.096035:0:94412:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.096040:0:94412:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=22 00000100:00000040:2.0:1783952266.096062:0:94412:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.096089:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1783952266.096093:0:94412:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.096098:0:94412:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16595f850 x1870605465642112/t0(0) o501->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 512/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.096121:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:96984:x1870605465642112:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1783952266.096141:0:94412:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:2.0:1783952266.096144:0:94412:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:2.0:1783952266.096197:0:94412:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00000020:00000040:2.0:1783952266.096204:0:94412:0:(genops.c:889:class_export_get()) GET export ffff97b1445c4000 refcount=23 00000020:00000040:2.0:1783952266.096207:0:94412:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 22 00010000:00000040:2.0:1783952266.096211:0:94412:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465642112 00000100:00000040:2.0:1783952266.096220:0:94412:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.096225:0:94412:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.096243:0:94412:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff97b166fb2a00 x1870605465642112/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.096272:0:94412:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952266.096277:0:94412:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16595f850 x1870605465642112/t0(0) o501->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 512/272 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.096286:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:96984:x1870605465642112:12345-0@lo:501:mount.lustre.0 Request processed in 167us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.096355:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1783952266.096358:0:94412:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.096367:0:94412:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 21 00000100:00000040:1.0:1783952266.096449:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b166fb2a00 x1870605465642112/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.096459:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb2a00 x1870605465642112/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.096467:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642112:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1783952266.096474:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b166fb2a00 x1870605465642112/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952266.096484:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000100:00000040:1.0:1783952266.096488:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b166fb2a00 x1870605465642112/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952266.096496:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952266.096506:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952266.096509:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:1.0:1783952266.096521:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177314000 x1870605465642240/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.096535:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177314000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642240:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1783952266.096559:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177314000 x1870605465642240/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.096566:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.096581:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b16595d850 x1870605465642240 msgsize 272 00000100:00100000:1.0:1783952266.096618:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952266.096620:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783952266.096638:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b177314000 x1870605465642240/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.096648:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1742c7840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.096697:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465642240 00000100:00100000:2.0:1783952266.096701:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465642240 00000020:00000040:2.0:1783952266.096703:0:94410:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.096706:0:94410:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=22 00000100:00000040:2.0:1783952266.096715:0:94410:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.096735:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1783952266.096738:0:94410:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.096743:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16595d850 x1870605465642240/t0(0) o503->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.096764:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:96984:x1870605465642240:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1783952266.096781:0:94410:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:2.0:1783952266.096807:0:94410:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:2.0:1783952266.096810:0:94410:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465642240 00000100:00000040:2.0:1783952266.096814:0:94410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.096818:0:94410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.096833:0:94410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff97b177314000 x1870605465642240/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.096889:0:94410:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952266.096894:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16595d850 x1870605465642240/t0(0) o503->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/8416 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.096903:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:96984:x1870605465642240:12345-0@lo:503:mount.lustre.0 Request processed in 140us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.096909:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1783952266.096911:0:94410:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.096917:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 21 00000100:00000040:1.0:1783952266.102211:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177314000 x1870605465642240/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.102226:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177314000 x1870605465642240/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.102234:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177314000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642240:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1783952266.102242:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177314000 x1870605465642240/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.102260:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177314000 x1870605465642240/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952266.102281:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952266.102513:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000040:00080000:1.0:1783952266.102967:0:96984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:1.0:1783952266.103028:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952266.103035:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:1.0:1783952266.103252:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177314000 x1870605465642368/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.103279:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177314000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642368:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783952266.103321:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177314000 x1870605465642368/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.103329:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.103368:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174625050 x1870605465642368 msgsize 272 00000100:00100000:1.0:1783952266.103373:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952266.103375:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783952266.103403:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b177314000 x1870605465642368/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.103429:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee79900 going to sleep for 11 seconds 00000100:00100000:0.0:1783952266.103523:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465642368 00000100:00100000:0.0:1783952266.103531:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465642368 00000020:00000040:0.0:1783952266.103534:0:94412:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:0.0:1783952266.103539:0:94412:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=22 00000100:00000040:0.0:1783952266.103564:0:94412:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783952266.103646:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:0.0:1783952266.103650:0:94412:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:0.0:1783952266.103654:0:94412:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174625050 x1870605465642368/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.103665:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:96984:x1870605465642368:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1783952266.103693:0:94412:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:0.0:1783952266.109971:0:94412:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:0.0:1783952266.109996:0:94412:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465642368 00000100:00000040:0.0:1783952266.110012:0:94412:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952266.110019:0:94412:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.110086:0:94412:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff97b177314000 x1870605465642368/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.110122:0:94412:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952266.110129:0:94412:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174625050 x1870605465642368/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/8472 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.110139:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:96984:x1870605465642368:12345-0@lo:502:mount.lustre.0 Request processed in 6475us (6768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952266.110149:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:0.0:1783952266.110152:0:94412:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000100:00000040:1.0:1783952266.110155:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177314000 x1870605465642368/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.110163:0:94412:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 21 00000100:00000040:1.0:1783952266.110165:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177314000 x1870605465642368/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.110172:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177314000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642368:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783952266.110180:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177314000 x1870605465642368/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.110194:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177314000 x1870605465642368/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952266.110207:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952266.110214:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000040:00080000:1.0:1783952266.110622:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783952266.110655:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783952266.110668:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783952266.110678:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783952266.110688:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783952266.110708:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783952266.110718:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783952266.110727:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783952266.110740:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1783952266.110751:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1783952266.110761:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1783952266.110772:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:1.0:1783952266.110778:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952266.110783:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:1.0:1783952266.110807:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177314000 x1870605465642496/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.110819:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177314000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642496:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783952266.110845:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177314000 x1870605465642496/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.110853:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.110874:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174624c50 x1870605465642496 msgsize 272 00000100:00100000:1.0:1783952266.110879:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952266.110880:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783952266.110906:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b177314000 x1870605465642496/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.110930:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b14ee79900 going to sleep for 11 seconds 00000100:00100000:3.0:1783952266.111031:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465642496 00000100:00100000:3.0:1783952266.111047:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465642496 00000020:00000040:3.0:1783952266.111050:0:94415:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:3.0:1783952266.111054:0:94415:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=22 00000100:00000040:3.0:1783952266.111073:0:94415:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783952266.111102:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:3.0:1783952266.111107:0:94415:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:3.0:1783952266.111112:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174624c50 x1870605465642496/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.111123:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:96984:x1870605465642496:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1783952266.111149:0:94415:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:3.0:1783952266.111202:0:94415:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:3.0:1783952266.111206:0:94415:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465642496 00000100:00000040:3.0:1783952266.111212:0:94415:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:3.0:1783952266.111215:0:94415:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.111237:0:94415:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff97b177314000 x1870605465642496/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.111259:0:94415:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:3.0:1783952266.111264:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174624c50 x1870605465642496/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/8472 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.111271:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:96984:x1870605465642496:12345-0@lo:502:mount.lustre.0 Request processed in 150us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952266.111277:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:3.0:1783952266.111280:0:94415:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:3.0:1783952266.111302:0:94415:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 21 00000100:00000040:1.0:1783952266.111638:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177314000 x1870605465642496/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.111648:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177314000 x1870605465642496/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.111655:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177314000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642496:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783952266.111663:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177314000 x1870605465642496/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.111687:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177314000 x1870605465642496/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952266.111699:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952266.111705:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000040:00080000:1.0:1783952266.111736:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1783952266.111744:0:96984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:1.0:1783952266.111998:0:96984:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b14ed84b40 : new refcount 1 00000020:00000040:1.0:1783952266.112003:0:96984:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:3.0:1783952266.112749:0:96988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783952266.112758:0:96988:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1783952266.112764:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952266.112767:0:96988:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783952266.112773:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783952266.112788:0:96988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97b167c919c0) 00000020:00000040:3.0:1783952266.112794:0:96988:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b174b23000 with handle 0x22c73c7857bb6f14 to hash 00000020:00000040:3.0:1783952266.112800:0:96988:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b23000 : new refcount 1 00000020:00000040:3.0:1783952266.112814:0:96988:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 2 - obd_device_list 00000020:00000080:3.0:1783952266.112819:0:96988:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:3.0:1783952266.112824:0:96988:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:3.0:1783952266.112826:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783952266.112895:0:96988:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b17484c000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783952266.112902:0:96988:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000040:3.0:1783952266.112906:0:96988:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b1514b9800 with handle 0x22c73c7857bb6f1b to hash 00000020:00000040:3.0:1783952266.112910:0:96988:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff97b0489bcd40) now 5 - export 00000020:00000040:3.0:1783952266.112913:0:96988:0:(genops.c:900:class_export_put()) PUTting export ffff97b1514b9800 : new refcount 1 00000020:00000080:3.0:1783952266.112915:0:96988:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x22c73c7857bb6f1b 00000020:00000040:3.0:1783952266.112917:0:96988:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f1b 00000020:00000040:3.0:1783952266.112919:0:96988:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1514b9800 refcount=2 00010000:00010000:3.0:1783952266.118847:0:96988:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:3.0:1783952266.118857:0:96988:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 867, crc32c 4619, adler 856, t10ip512 2199, t10ip4k 2490, t10crc512 468, t10crc4k 771 00002000:00000040:3.0:1783952266.118898:0:96988:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:3.0:1783952266.118978:0:96988:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968956: rc = 0 00000001:00000040:3.0:1783952266.118984:0:96988:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:3.0:1783952266.118993:0:96988:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294968956, last_xid = 1870605465542656, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1783952266.118998:0:96988:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294968956 srv lr: 4294968956 lx: 1870605465542656 gen 0 00000020:00000040:3.0:1783952266.119013:0:96988:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b1514bf800 with handle 0x22c73c7857bb6f22 to hash 00000020:00000040:3.0:1783952266.119095:0:96988:0:(genops.c:889:class_export_get()) GET export ffff97b1514bf800 refcount=3 00000020:00000040:3.0:1783952266.119102:0:96988:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 3 - export 00000001:00000040:3.0:1783952266.119106:0:96988:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:3.0:1783952266.119110:0:96988:0:(genops.c:900:class_export_put()) PUTting export ffff97b1514bf800 : new refcount 2 00000001:00000040:3.0:1783952266.119116:0:96988:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294968974, last_xid = 1870605465628032, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1783952266.119120:0:96988:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294968974 srv lr: 4294968956 lx: 1870605465628032 gen 0 00000020:00000040:3.0:1783952266.119126:0:96988:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b0410d9000 with handle 0x22c73c7857bb6f29 to hash 00000020:00000040:3.0:1783952266.119137:0:96988:0:(genops.c:889:class_export_get()) GET export ffff97b0410d9000 refcount=3 00000020:00000040:3.0:1783952266.119140:0:96988:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 4 - export 00000001:00000040:3.0:1783952266.119142:0:96988:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:3.0:1783952266.119144:0:96988:0:(genops.c:900:class_export_put()) PUTting export ffff97b0410d9000 : new refcount 2 00000001:00000040:3.0:1783952266.119148:0:96988:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = d33551be-a709-4ba2-a74c-f4d7b53c6817, last_transno = 4294968978, last_xid = 1870605447813888, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1783952266.119151:0:96988:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: d33551be-a709-4ba2-a74c-f4d7b53c6817 idx: 2 lr: 4294968978 srv lr: 4294968956 lx: 1870605447813888 gen 0 00000020:00000040:3.0:1783952266.119155:0:96988:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b0497f3000 with handle 0x22c73c7857bb6f30 to hash 00000020:00000040:3.0:1783952266.119167:0:96988:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=3 00000020:00000040:3.0:1783952266.119169:0:96988:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 5 - export 00000001:00000040:3.0:1783952266.119172:0:96988:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID 'd33551be-a709-4ba2-a74c-f4d7b53c6817' added, generation 0 00000020:00000040:3.0:1783952266.119174:0:96988:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 2 00000001:00000040:3.0:1783952266.119178:0:96988:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:3.0:1783952266.119182:0:96988:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:3.0:1783952266.119186:0:96988:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294968978 00000001:00000040:3.0:1783952266.119231:0:96988:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968978: rc = 0 00000001:00000040:3.0:1783952266.119245:0:96988:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968978: rc = 0 00002000:00000040:3.0:1783952266.119264:0:96988:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:3.0:1783952266.120190:0:96988:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:3.0:1783952266.120256:0:96988:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:3.0:1783952266.120264:0:96988:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:3.0:1783952266.120274:0:96988:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:3.0:1783952266.120404:0:96988:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:3.0:1783952266.120413:0:96988:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:3.0:1783952266.120531:0:96988:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:3.0:1783952266.121150:0:96988:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:3.0:1783952266.121214:0:96988:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:3.0:1783952266.121262:0:96988:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:3.0:1783952266.121750:0:96988:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:3.0:1783952266.121993:0:96988:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:3.0:1783952266.122253:0:96988:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:3.0:1783952266.126896:0:96988:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 6 - setup 00000020:00000080:3.0:1783952266.126902:0:96988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783952266.126911:0:96988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952266.126916:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952266.126918:0:96988:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783952266.126922:0:96988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783952266.126925:0:96988:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1783952266.126927:0:96988:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783952266.126928:0:96988:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783952266.126930:0:96988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783952266.126932:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952266.126933:0:96988:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783952266.126935:0:96988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952266.126937:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952266.126938:0:96988:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783952266.126941:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783952266.126942:0:96988:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783952266.126945:0:96988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952266.126946:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952266.126952:0:96988:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783952266.126954:0:96988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783952266.126956:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952266.126958:0:96988:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783952266.126961:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783952266.126989:0:96988:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783952266.126991:0:96988:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783952266.126992:0:96988:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783952266.126995:0:96988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1783952266.127207:0:96984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783952266.127239:0:96984:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:0.0:1783952266.127258:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b050cbcc00 refcount=3 00010000:00010000:0.0:1783952266.127264:0:96984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb6f06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f0d expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.127276:0:96984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb6f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f0d expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952266.127289:0:96984:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97b17484c000 from 1 10000000:01000000:0.0:1783952266.127292:0:96984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:0.0:1783952266.127298:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00010000:00000040:0.0:1783952266.127318:0:96984:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b176ee0c00 count: 4 00000020:00000040:0.0:1783952266.127325:0:96984:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b050cbd800 with handle 0x22c73c7857bb6f37 to hash 00010000:00010000:0.0:1783952266.127332:0:96984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb6f37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.127339:0:96984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb6f37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.127350:0:96984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb6f37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783952266.127371:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b166fb2a00 x1870605465642624/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.127385:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642624:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1783952266.127409:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b166fb2a00 x1870605465642624/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.127417:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.127451:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174624850 x1870605465642624 msgsize 328 00000100:00100000:0.0:1783952266.127455:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.127457:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783952266.127482:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b166fb2a00 x1870605465642624/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.127505:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1485a3600 going to sleep for 11 seconds 00000100:00100000:3.0:1783952266.128753:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465642624 00000100:00100000:3.0:1783952266.128763:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465642624 00000020:00000040:3.0:1783952266.128766:0:94410:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:3.0:1783952266.128770:0:94410:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=22 00000100:00000040:3.0:1783952266.128790:0:94410:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783952266.128824:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:3.0:1783952266.128829:0:94410:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:3.0:1783952266.128835:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174624850 x1870605465642624/t0(0) o101->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.128848:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:96984:x1870605465642624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783952266.128863:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1783952266.128872:0:94410:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b1767eda00 count: 5 00000020:00000040:3.0:1783952266.128878:0:94410:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b176d23e00 with handle 0x22c73c7857bb6f3e to hash 00010000:00010000:3.0:1783952266.128882:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d23e00/0x22c73c7857bb6f3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6f37 expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.128889:0:94410:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff97b1445c4000 : new locks_count 17 00000020:00000040:3.0:1783952266.128892:0:94410:0:(genops.c:889:class_export_get()) GET export ffff97b1445c4000 refcount=23 00010000:00000040:3.0:1783952266.128909:0:94410:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff97b1767eda00) refcount = 5 00010000:00000040:3.0:1783952266.128912:0:94410:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783952266.128918:0:94410:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b175a14c00/0x22c73c7857bb613e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a506 expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.128935:0:94410:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db70200/0x22c73c7857bb60e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60dc expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.128941:0:94410:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b1762afc00/0x22c73c7857bb60b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb60b2 expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.128947:0:94410:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db71000/0x22c73c7857bb603b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6034 expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952266.128953:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d23e00/0x22c73c7857bb6f3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6f37 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952266.128965:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d23e00/0x22c73c7857bb6f3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6f37 expref: 23 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952266.128973:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23e00, rc 0) 00010000:00000040:3.0:1783952266.128977:0:94410:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465642624 00000100:00000040:3.0:1783952266.128986:0:94410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:3.0:1783952266.128990:0:94410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.129023:0:94410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff97b166fb2a00 x1870605465642624/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.129055:0:94410:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:3.0:1783952266.129060:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174624850 x1870605465642624/t0(0) o101->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/344 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.129068:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:96984:x1870605465642624:12345-0@lo:101:mount.lustre.0 Request processed in 222us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952266.129075:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:3.0:1783952266.129078:0:94410:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:3.0:1783952266.129092:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 22 00000100:00000040:2.0:1783952266.129098:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b166fb2a00 x1870605465642624/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.129108:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb2a00 x1870605465642624/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.129115:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642624:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1783952266.129123:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b166fb2a00 x1870605465642624/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952266.129135:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b050cbd800 refcount=4 00010000:00000040:2.0:1783952266.129149:0:96984:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff97b050cbd800, remote cookie: 0x22c73c7857bb6f3e, flags: 0x0 00010000:00000040:2.0:1783952266.129153:0:96984:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff97b176ee0c00) refcount = 4 00010000:00000040:2.0:1783952266.129155:0:96984:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1783952266.129159:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b1762afe00/0x22c73c7857bb60dc lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb60e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.129165:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b175a15800/0x22c73c7857bb60b2 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb60b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952266.129170:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b175a14800/0x22c73c7857bb6034 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb603b expref: -99 pid: 94404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952266.129175:0:96984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb6f37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f3e expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952266.129183:0:96984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb6f37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6f3e expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783952266.129192:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b166fb2a00 x1870605465642624/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952266.129201:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 10000000:00000040:2.0:1783952266.129209:0:96984:0:(mgc_request.c:108:config_log_get()) log params (ffff97b167c43000) refs 2 00000020:00000040:2.0:1783952266.129212:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b050cbd800 refcount=3 10000000:00000040:2.0:1783952266.129234:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b14ed84b40 : new refcount 2 10000000:00000040:2.0:1783952266.129237:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b17496d900 : new refcount 2 10000000:00000040:2.0:1783952266.129240:0:96984:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.202.148@tcp: copy local log params 00000040:00080000:2.0:1783952266.129398:0:96984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783952266.129669:0:96984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783952266.129883:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783952266.129910:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783952266.129927:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783952266.129941:0:96984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:2.0:1783952266.129972:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:2.0:1783952266.129978:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:2.0:1783952266.130019:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b2a00 x1870605465642752/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.130032:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642752:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1783952266.130049:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b2a00 x1870605465642752/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.130056:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.130079:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174625c50 x1870605465642752 msgsize 504 00000100:00100000:2.0:1783952266.130084:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952266.130085:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1783952266.130107:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b1447b2a00 x1870605465642752/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.130129:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046864300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952266.130162:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465642752 00000100:00100000:3.0:1783952266.130168:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465642752 00000020:00000040:3.0:1783952266.130170:0:94411:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:3.0:1783952266.130173:0:94411:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=23 00000100:00000040:3.0:1783952266.130187:0:94411:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783952266.130264:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:3.0:1783952266.130268:0:94411:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:3.0:1783952266.130273:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174625c50 x1870605465642752/t0(0) o501->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 504/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.130286:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:96984:x1870605465642752:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1783952266.130312:0:94411:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:3.0:1783952266.130315:0:94411:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:3.0:1783952266.130357:0:94411:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:3.0:1783952266.130363:0:94411:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465642752 00000100:00000040:3.0:1783952266.130369:0:94411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:3.0:1783952266.130373:0:94411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.130390:0:94411:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff97b1447b2a00 x1870605465642752/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.130409:0:94411:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:3.0:1783952266.130413:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174625c50 x1870605465642752/t0(0) o501->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 504/272 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.130421:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:96984:x1870605465642752:12345-0@lo:501:mount.lustre.0 Request processed in 138us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952266.130427:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:3.0:1783952266.130430:0:94411:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:3.0:1783952266.130447:0:94411:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 22 00000100:00000040:2.0:1783952266.138932:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b2a00 x1870605465642752/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.138950:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b2a00 x1870605465642752/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.138957:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642752:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1783952266.138966:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b2a00 x1870605465642752/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952266.138981:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000100:00000040:2.0:1783952266.138985:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b2a00 x1870605465642752/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952266.138995:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000020:00000040:2.0:1783952266.139010:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:2.0:1783952266.139030:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:2.0:1783952266.139065:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b2a00 x1870605465642880/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.139076:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642880:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1783952266.139111:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b2a00 x1870605465642880/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.139119:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.139157:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174624450 x1870605465642880 msgsize 272 00000100:00100000:2.0:1783952266.139161:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952266.139163:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1783952266.139194:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b1447b2a00 x1870605465642880/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.139219:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046864300 going to sleep for 11 seconds 00000100:00100000:3.0:1783952266.139404:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465642880 00000100:00100000:3.0:1783952266.139418:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465642880 00000020:00000040:3.0:1783952266.139422:0:94411:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:3.0:1783952266.139425:0:94411:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=23 00000100:00000040:3.0:1783952266.139523:0:94411:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783952266.139555:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:3.0:1783952266.139559:0:94415:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:3.0:1783952266.139564:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174624450 x1870605465642880/t0(0) o503->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.139577:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:96984:x1870605465642880:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1783952266.139629:0:94415:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:3.0:1783952266.139683:0:94415:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:3.0:1783952266.139688:0:94415:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465642880 00000100:00000040:3.0:1783952266.139697:0:94415:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:3.0:1783952266.139701:0:94415:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.139722:0:94415:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff97b1447b2a00 x1870605465642880/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.139742:0:94415:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:3.0:1783952266.139746:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174624450 x1870605465642880/t0(0) o503->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/8416 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.139754:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:96984:x1870605465642880:12345-0@lo:503:mount.lustre.0 Request processed in 179us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952266.139761:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:3.0:1783952266.139765:0:94415:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:3.0:1783952266.139774:0:94415:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 22 00000100:00000040:3.0:1783952266.139817:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b2a00 x1870605465642880/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.139825:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b2a00 x1870605465642880/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.139842:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465642880:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1783952266.139848:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b2a00 x1870605465642880/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.139859:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b2a00 x1870605465642880/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.139874:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.139879:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000040:00080000:3.0:1783952266.140254:0:96984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1783952266.142745:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.142758:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:3.0:1783952266.142793:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14deb8380 x1870605465643008/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.142806:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643008:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783952266.142848:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14deb8380 x1870605465643008/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.142857:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.142895:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b16595fc50 x1870605465643008 msgsize 272 00000100:00100000:3.0:1783952266.142900:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952266.142902:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783952266.142928:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b14deb8380 x1870605465643008/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.142956:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1775d0840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.143387:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465643008 00000100:00100000:2.0:1783952266.143395:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465643008 00000020:00000040:2.0:1783952266.143398:0:94410:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.143402:0:94410:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=23 00000100:00000040:2.0:1783952266.143423:0:94410:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.144435:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:2.0:1783952266.144450:0:94410:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.144458:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16595fc50 x1870605465643008/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.144474:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:96984:x1870605465643008:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1783952266.144508:0:94410:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:2.0:1783952266.144560:0:94410:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:2.0:1783952266.144565:0:94410:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465643008 00000100:00000040:2.0:1783952266.144574:0:94410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.144578:0:94410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.144640:0:94410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff97b14deb8380 x1870605465643008/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.146020:0:94410:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952266.146030:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16595fc50 x1870605465643008/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/8472 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.146050:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:96984:x1870605465643008:12345-0@lo:502:mount.lustre.0 Request processed in 1570us (3143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.146058:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:2.0:1783952266.146062:0:94410:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.146074:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 22 00000100:00000040:1.0:1783952266.146412:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14deb8380 x1870605465643008/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.146424:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8380 x1870605465643008/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.146432:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643008:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783952266.146451:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14deb8380 x1870605465643008/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.146466:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14deb8380 x1870605465643008/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952266.146482:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952266.146490:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000040:00080000:1.0:1783952266.146740:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783952266.146774:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783952266.146789:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783952266.146803:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783952266.146816:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:1.0:1783952266.146825:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952266.146830:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:1.0:1783952266.146854:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177314000 x1870605465643136/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.146871:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177314000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643136:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783952266.146900:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177314000 x1870605465643136/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.146907:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.146938:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174627450 x1870605465643136 msgsize 272 00000100:00100000:1.0:1783952266.146943:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952266.146945:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783952266.146973:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b177314000 x1870605465643136/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.146996:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1775d0840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.147197:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465643136 00000100:00100000:2.0:1783952266.147204:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465643136 00000020:00000040:2.0:1783952266.147208:0:94411:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.147212:0:94411:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=23 00000100:00000040:2.0:1783952266.147232:0:94411:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.147264:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:2.0:1783952266.147267:0:94411:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.147272:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174627450 x1870605465643136/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.147283:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:96984:x1870605465643136:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1783952266.147319:0:94411:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:2.0:1783952266.147358:0:94411:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:2.0:1783952266.147362:0:94411:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465643136 00000100:00000040:2.0:1783952266.147370:0:94411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.147375:0:94411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.147394:0:94411:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff97b177314000 x1870605465643136/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.147422:0:94411:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:3.0:1783952266.147571:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177314000 x1870605465643136/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.147580:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177314000 x1870605465643136/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.147639:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177314000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643136:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783952266.147646:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177314000 x1870605465643136/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.147658:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177314000 x1870605465643136/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.147671:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.147676:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000040:00080000:3.0:1783952266.147705:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783952266.147712:0:96984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:3.0:1783952266.147973:0:96984:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b14ed84b40 : new refcount 1 00000020:00000040:3.0:1783952266.147978:0:96984:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000100:00000040:2.0:1783952266.148195:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174627450 x1870605465643136/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/8472 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.148208:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:96984:x1870605465643136:12345-0@lo:502:mount.lustre.0 Request processed in 925us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.148215:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:2.0:1783952266.148218:0:94411:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.148226:0:94411:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 22 00000020:01000000:1.0:1783952266.148674:0:96992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783952266.148684:0:96992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952266.148686:0:96992:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783952266.148692:0:96992:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b17484c000 00000020:00000080:1.0:1783952266.148695:0:96992:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783952266.148702:0:96992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952266.148704:0:96992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952266.148706:0:96992:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783952266.148708:0:96992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783952266.148710:0:96992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952266.148711:0:96992:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783952266.148714:0:96992:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97b17484c000 00000020:00000080:1.0:1783952266.148715:0:96992:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783952266.148770:0:96992:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783952266.148773:0:96992:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783952266.148774:0:96992:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783952266.148777:0:96992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:2.0:1783952266.155159:0:96984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1783952266.155213:0:96984:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:2.0:1783952266.155233:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b050cbd800 refcount=3 00010000:00010000:2.0:1783952266.155241:0:96984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb6f37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f3e expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952266.155252:0:96984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b050cbd800/0x22c73c7857bb6f37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f3e expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783952266.155329:0:96984:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783952266.155332:0:96984:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97b17484c000 10000000:01000000:2.0:1783952266.155336:0:96984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97b17484c000 10000000:01000000:2.0:1783952266.155340:0:96984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:2.0:1783952266.155344:0:96984:0:(genops.c:889:class_export_get()) GET export ffff97b1476ff800 refcount=20 10000000:01000000:2.0:1783952266.155349:0:96984:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97b17484c000 from 1 10000000:01000000:2.0:1783952266.155352:0:96984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:2.0:1783952266.155359:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00010000:00000040:2.0:1783952266.155382:0:96984:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b158d55c00 count: 9 00000020:00000040:2.0:1783952266.155390:0:96984:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b1414a3800 with handle 0x22c73c7857bb6f45 to hash 00010000:00010000:2.0:1783952266.155397:0:96984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1414a3800/0x22c73c7857bb6f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952266.155405:0:96984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b1414a3800/0x22c73c7857bb6f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952266.155428:0:96984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b1414a3800/0x22c73c7857bb6f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783952266.155581:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b1c00 x1870605465643264/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.155622:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643264:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1783952266.155650:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b1c00 x1870605465643264/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.155659:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.155699:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174626c50 x1870605465643264 msgsize 328 00000100:00100000:2.0:1783952266.155703:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952266.155705:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1783952266.155725:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b1447b1c00 x1870605465643264/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.155751:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b046864300 going to sleep for 11 seconds 00000100:00100000:0.0:1783952266.155933:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465643264 00000100:00100000:0.0:1783952266.155941:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465643264 00000020:00000040:0.0:1783952266.155950:0:94415:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:0.0:1783952266.155953:0:94415:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=23 00000100:00000040:0.0:1783952266.155971:0:94415:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783952266.156004:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:0.0:1783952266.156008:0:94415:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:0.0:1783952266.156013:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174626c50 x1870605465643264/t0(0) o101->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.156025:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:96984:x1870605465643264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783952266.156110:0:94415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1783952266.156119:0:94415:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b15f403900 count: 11 00000020:00000040:0.0:1783952266.156125:0:94415:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b050cbce00 with handle 0x22c73c7857bb6f4c to hash 00010000:00010000:0.0:1783952266.156129:0:94415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb6f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6f45 expref: -99 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.156136:0:94415:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff97b1445c4000 : new locks_count 18 00000020:00000040:0.0:1783952266.156139:0:94415:0:(genops.c:889:class_export_get()) GET export ffff97b1445c4000 refcount=24 00010000:00000040:0.0:1783952266.156157:0:94415:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff97b15f403900) refcount = 11 00010000:00000040:0.0:1783952266.156161:0:94415:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1783952266.156164:0:94415:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b1414a3a00/0x22c73c7857bb6f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6f06 expref: 24 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.156172:0:94415:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b14d86ac00/0x22c73c7857bb6543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb653c expref: 24 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.156178:0:94415:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b140031400/0x22c73c7857bb6519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6512 expref: 24 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.156184:0:94415:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b14d86b400/0x22c73c7857bb650b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6504 expref: 24 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.156189:0:94415:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b14d86a200/0x22c73c7857bb64fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64f6 expref: 24 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.156201:0:94415:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db70400/0x22c73c7857bb64ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64e8 expref: 24 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.156209:0:94415:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b050cbd000/0x22c73c7857bb64e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64da expref: 24 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.156216:0:94415:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db70c00/0x22c73c7857bb64d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb64cc expref: 24 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.156226:0:94415:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db70a00/0x22c73c7857bb64c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a56f expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.156232:0:94415:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db70800/0x22c73c7857bb64be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a568 expref: 9 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.156239:0:94415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb6f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6f45 expref: 24 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.156250:0:94415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b050cbce00/0x22c73c7857bb6f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6f45 expref: 24 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.156258:0:94415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b050cbce00, rc 0) 00010000:00000040:0.0:1783952266.156262:0:94415:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465643264 00000100:00000040:0.0:1783952266.156270:0:94415:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952266.156275:0:94415:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.158710:0:94415:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff97b1447b1c00 x1870605465643264/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.158761:0:94415:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:0.0:1783952266.158771:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174626c50 x1870605465643264/t0(0) o101->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/344 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.158802:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643264:12345-0@lo:101:mount.lustre.0 Request processed in 2778us (3101us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952266.158811:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:0.0:1783952266.158814:0:94415:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:0.0:1783952266.158827:0:94415:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00000040:3.0:1783952266.158923:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b1447b1c00 x1870605465643264/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.158935:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b1c00 x1870605465643264/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.158942:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643264:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1783952266.158950:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b1c00 x1870605465643264/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.158962:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b1414a3800 refcount=4 00010000:00000040:3.0:1783952266.158968:0:96984:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff97b1414a3800, remote cookie: 0x22c73c7857bb6f4c, flags: 0x0 00010000:00000040:3.0:1783952266.158975:0:96984:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff97b158d55c00) refcount = 9 00010000:00000040:3.0:1783952266.158979:0:96984:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783952266.158983:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b050cbcc00/0x22c73c7857bb6f06 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6f0d expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.158991:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b140030e00/0x22c73c7857bb653c lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6543 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.159003:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b14d86ae00/0x22c73c7857bb6512 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6519 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.159010:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b050cbd600/0x22c73c7857bb6504 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb650b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.159017:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b050cbdc00/0x22c73c7857bb64f6 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.159023:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b050cbc800/0x22c73c7857bb64e8 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.159029:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b140030a00/0x22c73c7857bb64da lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952266.159035:0:96984:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b14d86b800/0x22c73c7857bb64cc lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb64d3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952266.159042:0:96984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b1414a3800/0x22c73c7857bb6f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f4c expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952266.159051:0:96984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b1414a3800/0x22c73c7857bb6f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6f4c expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783952266.159061:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b1c00 x1870605465643264/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.159071:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 10000000:00000040:3.0:1783952266.159078:0:96984:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff97b1514e3400) refs 2 00000020:00000040:3.0:1783952266.159081:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b1414a3800 refcount=3 10000000:00000040:3.0:1783952266.159112:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b14ed84b40 : new refcount 2 10000000:00000040:3.0:1783952266.159120:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b17496d900 : new refcount 2 10000000:00000040:3.0:1783952266.159123:0:96984:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.202.148@tcp: copy local log lustre-client 00000040:00080000:3.0:1783952266.159281:0:96984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1783952266.159698:0:96984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783952266.159883:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783952266.159909:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783952266.159924:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783952266.159936:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783952266.159948:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783952266.159961:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783952266.159974:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783952266.159987:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783952266.160003:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783952266.160017:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783952266.160032:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783952266.160044:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783952266.160058:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783952266.160071:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783952266.160085:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783952266.160097:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783952266.160109:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783952266.160123:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783952266.160137:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783952266.160150:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783952266.160163:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783952266.160177:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783952266.160189:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783952266.160204:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783952266.160219:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1783952266.160233:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1783952266.160246:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1783952266.160261:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1783952266.160276:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1783952266.160701:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1783952266.160719:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1783952266.160732:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1783952266.160744:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1783952266.160755:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1783952266.160766:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1783952266.160779:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1783952266.160788:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1783952266.160806:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1783952266.160812:0:96984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:3.0:1783952266.160861:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.160868:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:3.0:1783952266.160903:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14deb8e00 x1870605465643392/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.160917:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643392:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1783952266.160941:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14deb8e00 x1870605465643392/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.160949:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.160988:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174627c50 x1870605465643392 msgsize 512 00000100:00100000:3.0:1783952266.160993:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952266.160995:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783952266.161055:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b14deb8e00 x1870605465643392/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.161082:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.167259:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465643392 00000100:00100000:2.0:1783952266.167274:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465643392 00000020:00000040:2.0:1783952266.167277:0:94411:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.167282:0:94411:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=24 00000100:00000040:2.0:1783952266.167363:0:94411:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.167399:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:2.0:1783952266.167404:0:94411:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.167412:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174627c50 x1870605465643392/t0(0) o501->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 512/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.167425:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643392:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1783952266.167510:0:94411:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:2.0:1783952266.167518:0:94411:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:2.0:1783952266.167717:0:94411:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00000020:00000040:2.0:1783952266.167728:0:94411:0:(genops.c:889:class_export_get()) GET export ffff97b1445c4000 refcount=25 00000020:00000040:2.0:1783952266.167732:0:94411:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 24 00010000:00000040:2.0:1783952266.167736:0:94411:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465643392 00000100:00000040:2.0:1783952266.167746:0:94411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.167752:0:94411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.167851:0:94411:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff97b14deb8e00 x1870605465643392/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.167912:0:94411:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952266.167918:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174627c50 x1870605465643392/t0(0) o501->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 512/272 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.167928:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643392:12345-0@lo:501:mount.lustre.0 Request processed in 504us (6937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.167935:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:2.0:1783952266.167938:0:94411:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.167947:0:94411:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00000040:3.0:1783952266.170287:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14deb8e00 x1870605465643392/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.170372:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8e00 x1870605465643392/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.170381:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643392:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1783952266.170397:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14deb8e00 x1870605465643392/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.170409:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000100:00000040:3.0:1783952266.170413:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14deb8e00 x1870605465643392/t0(0) o501->MGC192.168.202.148@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.170424:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.170434:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.171428:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:3.0:1783952266.171514:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14deb8e00 x1870605465643520/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.171528:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643520:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1783952266.171561:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14deb8e00 x1870605465643520/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.171570:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.171633:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174626850 x1870605465643520 msgsize 272 00000100:00100000:3.0:1783952266.171637:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952266.171639:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783952266.171661:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b14deb8e00 x1870605465643520/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.171687:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.171757:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465643520 00000100:00100000:2.0:1783952266.171764:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465643520 00000020:00000040:2.0:1783952266.171767:0:94415:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.171772:0:94415:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=24 00000100:00000040:2.0:1783952266.171794:0:94415:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.171826:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1783952266.171829:0:94415:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.171834:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174626850 x1870605465643520/t0(0) o503->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.171847:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643520:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1783952266.171874:0:94415:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:2.0:1783952266.171926:0:94415:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:2.0:1783952266.171936:0:94415:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465643520 00000100:00000040:2.0:1783952266.171944:0:94415:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.171949:0:94415:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.171970:0:94415:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff97b14deb8e00 x1870605465643520/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.171988:0:94415:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952266.171993:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174626850 x1870605465643520/t0(0) o503->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/8416 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.172001:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643520:12345-0@lo:503:mount.lustre.0 Request processed in 157us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.172008:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1783952266.172012:0:94415:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.172022:0:94415:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00000040:3.0:1783952266.172201:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14deb8e00 x1870605465643520/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.172210:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8e00 x1870605465643520/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.172217:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643520:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1783952266.172224:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14deb8e00 x1870605465643520/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.172243:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14deb8e00 x1870605465643520/t0(0) o503->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.172255:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.172263:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000040:00080000:3.0:1783952266.172899:0:96984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1783952266.172951:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.172956:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:3.0:1783952266.172976:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14deb8e00 x1870605465643648/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.172987:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643648:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783952266.173012:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14deb8e00 x1870605465643648/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.173020:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.174214:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174626450 x1870605465643648 msgsize 272 00000100:00100000:3.0:1783952266.174223:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952266.174226:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783952266.174247:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b14deb8e00 x1870605465643648/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.174274:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8e900 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.174375:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465643648 00000100:00100000:2.0:1783952266.174382:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465643648 00000020:00000040:2.0:1783952266.174384:0:94411:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.174388:0:94411:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=24 00000100:00000040:2.0:1783952266.174407:0:94411:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.174444:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:2.0:1783952266.174448:0:94411:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.174453:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174626450 x1870605465643648/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.174465:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643648:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1783952266.174497:0:94411:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:2.0:1783952266.174546:0:94411:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:2.0:1783952266.174549:0:94411:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465643648 00000100:00000040:2.0:1783952266.174558:0:94411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.174563:0:94411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.174624:0:94411:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff97b14deb8e00 x1870605465643648/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.174641:0:94411:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952266.174646:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174626450 x1870605465643648/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/8472 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.174655:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643648:12345-0@lo:502:mount.lustre.0 Request processed in 192us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.174662:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:2.0:1783952266.174665:0:94411:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.174675:0:94411:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00000040:3.0:1783952266.175769:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14deb8e00 x1870605465643648/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.175782:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8e00 x1870605465643648/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.175790:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643648:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783952266.175797:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14deb8e00 x1870605465643648/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.175821:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14deb8e00 x1870605465643648/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.175834:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.175841:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000040:00080000:3.0:1783952266.176032:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783952266.176067:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783952266.176083:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783952266.176097:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783952266.176111:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783952266.176123:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783952266.176135:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783952266.176148:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783952266.176161:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783952266.176174:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783952266.176187:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783952266.176201:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783952266.176214:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783952266.176227:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783952266.176245:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783952266.176258:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783952266.176270:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783952266.176282:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783952266.176431:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783952266.176567:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783952266.176582:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783952266.176633:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783952266.176650:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783952266.176664:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783952266.176676:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1783952266.176689:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1783952266.176702:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1783952266.176727:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1783952266.176738:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1783952266.176749:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1783952266.176759:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1783952266.176770:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1783952266.176780:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1783952266.176792:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1783952266.176802:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1783952266.176813:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1783952266.176823:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1783952266.176833:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1783952266.176843:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1783952266.176853:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1783952266.176864:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1783952266.176875:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1783952266.176885:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1783952266.176896:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1783952266.176906:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1783952266.176916:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1783952266.176927:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1783952266.176937:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:3.0:1783952266.176951:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.176957:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:3.0:1783952266.176983:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14deb8e00 x1870605465643776/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.176995:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643776:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783952266.177027:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14deb8e00 x1870605465643776/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.177036:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.177070:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b174625850 x1870605465643776 msgsize 272 00000100:00100000:3.0:1783952266.177074:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952266.177081:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783952266.177102:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b14deb8e00 x1870605465643776/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.177128:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8e900 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.177192:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465643776 00000100:00100000:2.0:1783952266.177199:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465643776 00000020:00000040:2.0:1783952266.177202:0:94415:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.177206:0:94415:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=24 00000100:00000040:2.0:1783952266.177225:0:94415:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.177253:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00000040:2.0:1783952266.177256:0:94415:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.177261:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174625850 x1870605465643776/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.177273:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643776:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1783952266.177311:0:94415:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:2.0:1783952266.177360:0:94415:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:2.0:1783952266.177365:0:94415:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465643776 00000100:00000040:2.0:1783952266.177372:0:94415:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.177377:0:94415:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.177400:0:94415:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff97b14deb8e00 x1870605465643776/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.177417:0:94415:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952266.177428:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174625850 x1870605465643776/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/8472 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.177447:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643776:12345-0@lo:502:mount.lustre.0 Request processed in 165us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.177454:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00000040:2.0:1783952266.177457:0:94415:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.177465:0:94415:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00000040:3.0:1783952266.177784:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14deb8e00 x1870605465643776/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.177795:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8e00 x1870605465643776/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.177802:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643776:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783952266.177809:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14deb8e00 x1870605465643776/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.177821:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14deb8e00 x1870605465643776/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.177835:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.177842:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000040:00080000:3.0:1783952266.177975:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1783952266.177999:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:3.0:1783952266.178016:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1783952266.178029:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:3.0:1783952266.178055:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:3.0:1783952266.178071:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:3.0:1783952266.178084:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:3.0:1783952266.178097:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:3.0:1783952266.178109:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:3.0:1783952266.178120:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:3.0:1783952266.178131:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:3.0:1783952266.178144:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:3.0:1783952266.178156:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:3.0:1783952266.178167:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:3.0:1783952266.178180:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.178184:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:3.0:1783952266.178200:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14deb8e00 x1870605465643904/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.178211:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643904:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783952266.178230:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14deb8e00 x1870605465643904/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.178237:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.178258:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b0418c3c50 x1870605465643904 msgsize 272 00000100:00100000:3.0:1783952266.178263:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952266.178264:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783952266.178281:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b14deb8e00 x1870605465643904/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.178399:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465643904 00000100:00100000:2.0:1783952266.178404:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465643904 00000020:00000040:2.0:1783952266.178406:0:94411:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.178409:0:94411:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=24 00000100:00000040:2.0:1783952266.178422:0:94411:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.178456:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00000040:2.0:1783952266.178459:0:94411:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.178463:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b0418c3c50 x1870605465643904/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.178473:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b0418c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643904:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1783952266.178495:0:94411:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b176e3b240 : new refcount 2 00000040:00000040:2.0:1783952266.178523:0:94411:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b176e3b240 : new refcount 1 00010000:00000040:2.0:1783952266.178527:0:94411:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465643904 00000100:00000040:2.0:1783952266.178532:0:94411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:2.0:1783952266.178535:0:94411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.178553:0:94411:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff97b14deb8e00 x1870605465643904/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.178566:0:94411:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 51 to 0@lo 00000100:00000040:2.0:1783952266.178570:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b0418c3c50 x1870605465643904/t0(0) o502->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 272/8472 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.178578:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b0418c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465643904:12345-0@lo:502:mount.lustre.0 Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.178614:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00000040:2.0:1783952266.178617:0:94411:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.178623:0:94411:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00100000:3.0:1783952266.178847:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049c8e900 going to sleep for 11 seconds 00000100:00000040:3.0:1783952266.178864:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14deb8e00 x1870605465643904/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.178873:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8e00 x1870605465643904/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.178878:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465643904:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1783952266.178884:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14deb8e00 x1870605465643904/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.178894:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14deb8e00 x1870605465643904/t0(0) o502->MGC192.168.202.148@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.178905:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:3.0:1783952266.178911:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000040:00080000:3.0:1783952266.178936:0:96984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:3.0:1783952266.178944:0:96984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:3.0:1783952266.180955:0:96984:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b14ed84b40 : new refcount 1 00000020:00000040:3.0:1783952266.180966:0:96984:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:0.0:1783952266.184104:0:96995:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.202.148@tcp 192.168.202.148@tcp cnt=1 00000020:01000004:0.0:1783952266.184127:0:96995:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783952266.184141:0:96995:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97b048b5cd40) 00000020:00000040:0.0:1783952266.184146:0:96995:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b174b33000 with handle 0x22c73c7857bb6f53 to hash 00000020:00000040:0.0:1783952266.184150:0:96995:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b33000 : new refcount 1 00000020:00000040:0.0:1783952266.184163:0:96995:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff97b048b5cd40) now 2 - obd_device_list 00000020:00000080:0.0:1783952266.184168:0:96995:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1783952266.192836:0:96995:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b17484c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783952266.192846:0:96995:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b17484c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783952266.192849:0:96995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b17484c000 3 00000020:00000040:0.0:1783952266.192871:0:96995:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff97b048b5cd40) now 3 - import 00000020:00000040:0.0:1783952266.192877:0:96995:0:(genops.c:1244:class_import_put()) import ffff97b04e288000 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1783952266.192893:0:96995:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952266.192897:0:96995:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 52 to 0@lo 00000100:00000040:0.0:1783952266.192899:0:96995:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.148@tcp -> ffff97b142e66080 00010000:00080000:0.0:1783952266.192903:0:96995:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b04e288000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.148@tcp at head 00010000:00010000:0.0:1783952266.195139:0:96995:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:0.0:1783952266.195242:0:96995:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff97b048b5cd40) now 4 - setup 00000020:00000080:0.0:1783952266.195246:0:96995:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1783952266.195407:0:96995:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:0.0:1783952266.195414:0:96995:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b174849000 with handle 0x22c73c7857bb6f5a to hash 00000020:00000040:0.0:1783952266.195420:0:96995:0:(genops.c:889:class_export_get()) GET export ffff97b174849000 refcount=3 00000020:00000040:0.0:1783952266.195424:0:96995:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff97b048b5cd40) now 5 - export 00000020:00000040:0.0:1783952266.195433:0:96995:0:(genops.c:900:class_export_put()) PUTting export ffff97b174849000 : new refcount 2 00000020:00000080:0.0:1783952266.195541:0:96995:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x22c73c7857bb6f5a 00000020:00000040:0.0:1783952266.195545:0:96995:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f5a 00000020:00000040:0.0:1783952266.195548:0:96995:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174849000 refcount=3 00000100:00080000:0.0:1783952266.195557:0:96995:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:0.0:1783952266.195562:0:96995:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 53 to 0@lo 00000020:00000040:0.0:1783952266.195564:0:96995:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f5a 00000020:00000040:0.0:1783952266.195566:0:96995:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174849000 refcount=4 00000100:00000040:0.0:1783952266.195568:0:96995:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 54 to 0@lo 00000020:00000040:0.0:1783952266.195570:0:96995:0:(genops.c:900:class_export_put()) PUTting export ffff97b174849000 : new refcount 3 00000100:00080000:0.0:1783952266.195572:0:96995:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97b04e288000 using connection 192.168.202.148@tcp/0@lo 00000020:00000040:0.0:1783952266.195613:0:96995:0:(genops.c:1231:class_import_get()) import ffff97b04e288000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:0.0:1783952266.195635:0:96995:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b166fb2a00 x1870605465644032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.195649:0:96995:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000053d16aaf] to pc [ptlrpcd_rcv+-1] req@ffff97b166fb2a00 x1870605465644032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952266.195670:0:96995:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:0.0:1783952266.195673:0:96995:0:(genops.c:1231:class_import_get()) import ffff97b04e288000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1783952266.195699:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952266.195706:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b046b43800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1783952266.195714:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff97b047acd180 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.195726:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000014c08a22] to pc [ptlrpcd_00_03+3] req@ffff97b047acd180 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.195743:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952266.195749:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b046a94800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1783952266.195755:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff97b047acc380 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.195771:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b1c7f805] to pc [ptlrpcd_00_00+0] req@ffff97b047acc380 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.195788:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952266.195793:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b048caf800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1783952266.195801:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff97b047aced80 x1870605465644416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.195810:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e522df45] to pc [ptlrpcd_00_01+1] req@ffff97b047aced80 x1870605465644416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952266.195819:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952266.195821:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783952266.195823:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952266.195827:0:86521:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3979 00000100:00080000:0.0:1783952266.195829:0:86521:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:0.0:1783952266.195831:0:86521:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 53 to 0@lo 00000100:00000040:0.0:1783952266.195834:0:86521:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 54 to 0@lo 00000020:00000040:0.0:1783952266.195836:0:86521:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe49 00000020:00000040:0.0:1783952266.195840:0:86521:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b14f00b000 refcount=4 00000100:00000040:0.0:1783952266.195843:0:86521:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 53 to 0@lo 00000100:00000040:0.0:1783952266.195845:0:86521:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 54 to 0@lo 00000020:00000040:0.0:1783952266.195847:0:86521:0:(genops.c:900:class_export_put()) PUTting export ffff97b14f00b000 : new refcount 3 00000100:00080000:0.0:1783952266.195849:0:86521:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff97b15f80e000 using connection 192.168.202.148@tcp/0@lo 00000020:00000040:0.0:1783952266.195855:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b15f80e000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1783952266.195862:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b047acce00 x1870605465644544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.195871:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005af80cea] to pc [ptlrpcd_rcv+-1] req@ffff97b047acce00 x1870605465644544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.195885:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952266.195891:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b166f50000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1783952266.195899:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff97b047acc000 x1870605465644672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.195908:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008eafbb8e] to pc [ptlrpcd_00_02+2] req@ffff97b047acc000 x1870605465644672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.195916:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952266.195922:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b0410da800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1783952266.195929:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff97b049d76d80 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.195938:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000813fa480] to pc [ptlrpcd_00_03+3] req@ffff97b049d76d80 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.195945:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952266.195949:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b15036a000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1783952266.195955:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff97b049d77100 x1870605465644928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.195964:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007f15a89d] to pc [ptlrpcd_00_00+0] req@ffff97b049d77100 x1870605465644928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783952266.195970:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783952266.195972:0:86521:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783952266.195974:0:86521:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783952266.195977:0:86521:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3979 00000100:00080000:0.0:1783952266.195979:0:86521:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00000040:0.0:1783952266.195985:0:86521:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 53 to 0@lo 00000100:00000040:0.0:1783952266.195987:0:86521:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 54 to 0@lo 00000020:00000040:0.0:1783952266.195989:0:86521:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5ffc 00000020:00000040:0.0:1783952266.195992:0:86521:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04e288800 refcount=4 00000100:00000040:0.0:1783952266.195994:0:86521:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 53 to 0@lo 00000100:00000040:0.0:1783952266.195996:0:86521:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 54 to 0@lo 00000020:00000040:0.0:1783952266.195998:0:86521:0:(genops.c:900:class_export_put()) PUTting export ffff97b04e288800 : new refcount 3 00000100:00080000:0.0:1783952266.196000:0:86521:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b143af6800 using connection 192.168.202.148@tcp/0@lo 00000020:00000040:0.0:1783952266.196005:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b143af6800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1783952266.196013:0:86521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049d76680 x1870605465645056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.196022:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000042a8ad81] to pc [ptlrpcd_rcv+-1] req@ffff97b049d76680 x1870605465645056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.196029:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952266.196033:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b14f00d800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1783952266.196038:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff97b049d77800 x1870605465645184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.196047:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000186c465f] to pc [ptlrpcd_00_01+1] req@ffff97b049d77800 x1870605465645184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.196054:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783952266.196059:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b176be7000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1783952266.196064:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff97b049d75f80 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952266.196072:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006d7aa292] to pc [ptlrpcd_00_02+2] req@ffff97b049d75f80 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.196081:0:86521:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3986) 00000100:00000040:0.0:1783952266.196104:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b047acd180 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.196116:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465644160:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.196144:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b047acd180 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.196151:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.196187:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d75880 x1870605465644160 msgsize 224 00000100:00100000:0.0:1783952266.196191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.196209:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b047acd180 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.196221:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8962 usecs (9 jiffies) 00000100:00000040:0.0:1783952266.196229:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049d76d80 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.196237:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465644800:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.196247:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049d76d80 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.196253:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.196263:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d74e00 x1870605465644800 msgsize 224 00000100:00100000:0.0:1783952266.196266:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.196278:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049d76d80 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.196286:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 126965 usecs (127 jiffies) 00000100:00100000:0.0:1783952266.199201:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:0.0:1783952266.199218:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b047acc000 x1870605465644672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.199234:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465644672:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.199264:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b047acc000 x1870605465644672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199279:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.199388:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d75500 x1870605465644672 msgsize 224 00000100:00100000:0.0:1783952266.199394:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.199423:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b047acc000 x1870605465644672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199500:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5512 usecs (6 jiffies) 00000100:00000040:0.0:1783952266.199512:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049d75f80 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.199521:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465645312:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.199535:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049d75f80 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199540:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.199555:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d74380 x1870605465645312 msgsize 224 00000100:00100000:0.0:1783952266.199559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.199574:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049d75f80 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199583:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 9103 usecs (10 jiffies) 00000100:00000040:0.0:1783952266.199628:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b047acc380 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.199636:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465644288:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.199648:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b047acc380 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199654:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.199666:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d74700 x1870605465644288 msgsize 224 00000100:00100000:0.0:1783952266.199670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.199683:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b047acc380 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199706:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8307 usecs (9 jiffies) 00000100:00000040:0.0:1783952266.199713:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049d77100 x1870605465644928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.199722:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465644928:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.199734:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049d77100 x1870605465644928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199740:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.199753:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d75c00 x1870605465644928 msgsize 224 00000100:00100000:0.0:1783952266.199757:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.199768:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049d77100 x1870605465644928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199776:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5568 usecs (6 jiffies) 00000100:00100000:0.0:1783952266.199786:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:0.0:1783952266.199792:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b047aced80 x1870605465644416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.199800:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465644416:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.199814:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b047aced80 x1870605465644416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199821:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.199831:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d77b80 x1870605465644416 msgsize 224 00000100:00100000:0.0:1783952266.199835:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.199847:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b047aced80 x1870605465644416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199856:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1609550 usecs (1610 jiffies) 00000100:00000040:0.0:1783952266.199861:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049d77800 x1870605465645184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.199880:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465645184:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.199892:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049d77800 x1870605465645184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199898:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.199909:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d74000 x1870605465645184 msgsize 224 00000100:00100000:0.0:1783952266.199913:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.199924:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049d77800 x1870605465645184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.199933:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7991 usecs (8 jiffies) 00000100:00100000:0.0:1783952266.199954:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465644160 00000100:00100000:0.0:1783952266.199960:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465644160 00000020:00000040:0.0:1783952266.199964:0:83761:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6153 00000020:00000040:0.0:1783952266.199968:0:83761:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f6800 refcount=5 00000020:00000040:0.0:1783952266.199978:0:83761:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 14 - evictor 00000100:00000040:0.0:1783952266.199994:0:83761:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1783952266.200012:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465644800 00000100:00100000:0.0:1783952266.200015:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465644800 00000020:00000040:0.0:1783952266.200016:0:83761:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb615a 00000020:00000040:0.0:1783952266.200018:0:83761:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f7800 refcount=5 00000100:00100000:0.0:1783952266.200030:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465645312 00000100:00100000:0.0:1783952266.200033:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465645312 00000020:00000040:0.0:1783952266.200034:0:83761:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6161 00000020:00000040:0.0:1783952266.200036:0:83761:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f2800 refcount=5 00000100:00100000:0.0:1783952266.200063:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465644288 00000100:00100000:0.0:1783952266.200066:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465644288 00000020:00000040:0.0:1783952266.200068:0:83761:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafef1 00000020:00000040:0.0:1783952266.200070:0:83761:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b32800 refcount=5 00000020:00000040:0.0:1783952266.200075:0:83761:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 10 - evictor 00000100:00100000:0.0:1783952266.200087:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00000040:0.0:1783952266.200090:0:83761:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f6800 : new rpc_count 1 00000100:00000040:0.0:1783952266.200099:0:83761:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d75880 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:527/0 lens 224/0 e 0 to 0 dl 1783952277 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.200110:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465644160:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952266.200129:0:83761:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465644160 00000100:00000040:0.0:1783952266.200138:0:83761:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:0.0:1783952266.200142:0:83761:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.200157:0:83761:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b047acd180 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.200172:0:83761:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 54 to 0@lo 00000100:00000040:0.0:1783952266.200176:0:83761:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d75880 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:527/0 lens 224/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.200185:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465644160:12345-0@lo:400:kworker.0 Request processed in 76us (3996us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952266.200191:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00000040:0.0:1783952266.200194:0:83761:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f6800 : new rpc_count 0 00000020:00000040:0.0:1783952266.200203:0:83761:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f6800 : new refcount 4 00000100:00100000:0.0:1783952266.200210:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00000040:0.0:1783952266.200212:0:83761:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f7800 : new rpc_count 1 00000100:00000040:0.0:1783952266.200215:0:83761:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d74e00 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:527/0 lens 224/0 e 0 to 0 dl 1783952277 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.200224:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465644800:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952266.200231:0:83761:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465644800 00000100:00000040:0.0:1783952266.200234:0:83761:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:0.0:1783952266.200237:0:83761:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.200248:0:83761:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049d76d80 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.200269:0:83761:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 54 to 0@lo 00000100:00000040:0.0:1783952266.200272:0:83761:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d74e00 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:527/0 lens 224/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.200279:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465644800:12345-0@lo:400:kworker.0 Request processed in 56us (4014us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952266.200284:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00000040:0.0:1783952266.200286:0:83761:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f7800 : new rpc_count 0 00000020:00000040:0.0:1783952266.203768:0:83761:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f7800 : new refcount 4 00000100:00100000:0.0:1783952266.203798:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00000040:0.0:1783952266.203803:0:83761:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f2800 : new rpc_count 1 00000100:00000040:0.0:1783952266.203811:0:83761:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d74380 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:527/0 lens 224/0 e 0 to 0 dl 1783952277 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.203828:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465645312:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952266.203851:0:83761:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465645312 00000100:00000040:0.0:1783952266.203862:0:83761:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:0.0:1783952266.203868:0:83761:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.203912:0:83761:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049d75f80 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.203932:0:83761:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 54 to 0@lo 00000100:00000040:0.0:1783952266.203936:0:83761:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d74380 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:527/0 lens 224/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.203945:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870605465645312:12345-0@lo:400:kworker.0 Request processed in 122us (4387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952266.203951:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00000040:0.0:1783952266.203955:0:83761:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f2800 : new rpc_count 0 00000020:00000040:0.0:1783952266.203969:0:83761:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f2800 : new refcount 4 00000100:00100000:0.0:1783952266.203979:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00000040:0.0:1783952266.203982:0:83761:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b32800 : new rpc_count 1 00000100:00000040:0.0:1783952266.203986:0:83761:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d74700 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:527/0 lens 224/0 e 0 to 0 dl 1783952277 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.203998:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465644288:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952266.204008:0:83761:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465644288 00000100:00000040:0.0:1783952266.204013:0:83761:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:0.0:1783952266.204016:0:83761:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.204033:0:83761:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b047acc380 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.204058:0:83761:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 54 to 0@lo 00000100:00000040:0.0:1783952266.204063:0:83761:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d74700 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:527/0 lens 224/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.204070:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465644288:12345-0@lo:400:kworker.0 Request processed in 75us (4402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952266.204075:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00000040:0.0:1783952266.204077:0:83761:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b32800 : new rpc_count 0 00000020:00000040:0.0:1783952266.204083:0:83761:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b32800 : new refcount 4 00000100:00100000:0.0:1783952266.204115:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465644928 00000100:00100000:0.0:1783952266.204123:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465644928 00000020:00000040:0.0:1783952266.204126:0:8444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5fe7 00000020:00000040:0.0:1783952266.204131:0:8444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04965f000 refcount=5 00000100:00000040:0.0:1783952266.204147:0:8444:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1783952266.204164:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465644416 00000100:00100000:0.0:1783952266.204167:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465644416 00000020:00000040:0.0:1783952266.204169:0:8444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5faf 00000020:00000040:0.0:1783952266.204171:0:8444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c5000 refcount=7 00000100:00100000:0.0:1783952266.204187:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00000040:0.0:1783952266.204195:0:8444:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b04965f000 : new rpc_count 1 00000100:00000040:0.0:1783952266.204199:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d75c00 x1870605465644928/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:527/0 lens 224/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.204211:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465644928:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952266.204223:0:8444:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465644928 00000100:00000040:0.0:1783952266.204229:0:8444:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:0.0:1783952266.204232:0:8444:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.204250:0:8444:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049d77100 x1870605465644928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.204264:0:8444:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 54 to 0@lo 00000100:00000040:0.0:1783952266.204267:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d75c00 x1870605465644928/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:527/0 lens 224/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.204275:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465644928:12345-0@lo:400:kworker.0 Request processed in 66us (4520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952266.204281:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00000040:0.0:1783952266.204283:0:8444:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b04965f000 : new rpc_count 0 00000100:00100000:1.0:1783952266.205457:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465644672 00000100:00100000:1.0:1783952266.205468:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465644672 00000020:00000040:1.0:1783952266.205470:0:26208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe7a 00000020:00000040:1.0:1783952266.205486:0:26208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b143cde000 refcount=5 00000020:00000040:1.0:1783952266.205498:0:26208:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:1.0:1783952266.205512:0:26208:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1783952266.205537:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465645184 00000100:00100000:1.0:1783952266.205540:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465645184 00000020:00000040:1.0:1783952266.205542:0:26208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb601f 00000020:00000040:1.0:1783952266.205544:0:26208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b11800 refcount=5 00000100:00100000:1.0:1783952266.205567:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00000040:1.0:1783952266.205571:0:26208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b143cde000 : new rpc_count 1 00000100:00000040:1.0:1783952266.205576:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d75500 x1870605465644672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:527/0 lens 224/0 e 0 to 0 dl 1783952277 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.205634:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465644672:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952266.205652:0:26208:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870605465644672 00000100:00000040:1.0:1783952266.205659:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:1.0:1783952266.205663:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.205694:0:26208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b047acc000 x1870605465644672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.205712:0:26208:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 54 to 0@lo 00000100:00000040:1.0:1783952266.205717:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d75500 x1870605465644672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:527/0 lens 224/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.205725:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3645:x1870605465644672:12345-0@lo:400:kworker.0 Request processed in 139us (6336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952266.205731:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00000100:00000040:1.0:1783952266.205733:0:26208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b143cde000 : new rpc_count 0 00000020:00000040:1.0:1783952266.205742:0:26208:0:(genops.c:900:class_export_put()) PUTting export ffff97b143cde000 : new refcount 4 00000100:00100000:1.0:1783952266.205750:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00000040:1.0:1783952266.205753:0:26208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b11800 : new rpc_count 1 00000100:00000040:1.0:1783952266.205756:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d74000 x1870605465645184/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:527/0 lens 224/0 e 0 to 0 dl 1783952277 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.205778:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465645184:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952266.205788:0:26208:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968959, transno 0, xid 1870605465645184 00000100:00000040:1.0:1783952266.205794:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:1.0:1783952266.205797:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.205813:0:26208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049d77800 x1870605465645184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.205824:0:26208:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 54 to 0@lo 00000100:00000040:1.0:1783952266.205828:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d74000 x1870605465645184/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:527/0 lens 224/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.205835:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465645184:12345-0@lo:400:kworker.0 Request processed in 59us (5924us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952266.205839:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00000040:1.0:1783952266.205842:0:26208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b11800 : new rpc_count 0 00000020:00000040:1.0:1783952266.205846:0:26208:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b11800 : new refcount 4 00000100:00080000:1.0:1783952266.205862:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1783952266.205865:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00080000:1.0:1783952266.205868:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1783952266.205870:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff97b167c13380) now 10 - evictor 00000100:00080000:1.0:1783952266.205872:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1783952266.205874:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff97b0468a4d40) now 14 - evictor 00000100:00100000:1.0:1783952266.205894:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00000040:1.0:1783952266.205896:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c5000 : new rpc_count 1 00000100:00000040:1.0:1783952266.205900:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d77b80 x1870605465644416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:527/0 lens 224/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.205909:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465644416:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952266.205920:0:8445:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870605465644416 00000100:00000040:1.0:1783952266.205931:0:8445:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:1.0:1783952266.205934:0:8445:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.205949:0:8445:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b047aced80 x1870605465644416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.205962:0:8445:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 54 to 0@lo 00000100:00000040:1.0:1783952266.205966:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d77b80 x1870605465644416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:527/0 lens 224/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.205973:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1870605465644416:12345-0@lo:400:kworker.0 Request processed in 66us (6140us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952266.205978:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00000040:1.0:1783952266.205981:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c5000 : new rpc_count 0 00000020:00000040:1.0:1783952266.205989:0:8445:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c5000 : new refcount 6 00000020:00000040:0.0:1783952266.206561:0:8444:0:(genops.c:900:class_export_put()) PUTting export ffff97b04965f000 : new refcount 4 00000100:00000040:0.0:1783952266.206639:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:0.0:1783952266.206647:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b047acc000 x1870605465644672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.206657:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b047acc000 x1870605465644672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.206664:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465644672:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.206678:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1783952266.206682:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049d75f80 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.206703:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d75f80 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.206710:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870605465645312:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.206725:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1783952266.206730:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b047acd180 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.206737:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b047acd180 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.206743:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465644160:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.206754:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1783952266.206757:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049d76d80 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.206764:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d76d80 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.206770:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465644800:0@lo:400:kworker.0 00000100:00000040:0.0:1783952266.206776:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b047acc000 x1870605465644672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.206786:0:3645:0:(genops.c:1244:class_import_put()) import ffff97b166f50000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1783952266.206794:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049d75f80 x1870605465645312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.206801:0:3645:0:(genops.c:1244:class_import_put()) import ffff97b176be7000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1783952266.206806:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b047acd180 x1870605465644160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.206822:0:3645:0:(genops.c:1244:class_import_put()) import ffff97b046b43800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1783952266.206828:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049d76d80 x1870605465644800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.206833:0:3645:0:(genops.c:1244:class_import_put()) import ffff97b0410da800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1783952266.206939:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b166fb2a00 x1870605465644032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.206952:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465644032:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1783952266.206979:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b166fb2a00 x1870605465644032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783952276 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.206986:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.207010:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b14deb8e00 x1870605465644032 msgsize 520 00000100:00100000:3.0:1783952266.207015:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952266.207035:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b166fb2a00 x1870605465644032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783952276 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.207057:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:3.0:1783952266.207077:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b047acce00 x1870605465644544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.207086:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b047acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465644544:0@lo:8:kworker.0 00000100:00000040:3.0:1783952266.207098:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b047acce00 x1870605465644544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952291 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.207104:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.207118:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b14deba680 x1870605465644544 msgsize 520 00000100:00100000:3.0:1783952266.207121:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952266.207134:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b047acce00 x1870605465644544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952291 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.207143:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5565 usecs (6 jiffies) 00000100:00000040:3.0:1783952266.207148:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049d76680 x1870605465645056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.207156:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465645056:0@lo:8:kworker.0 00000100:00000040:3.0:1783952266.207173:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049d76680 x1870605465645056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952291 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.207180:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.207191:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b14deb8380 x1870605465645056 msgsize 520 00000100:00100000:3.0:1783952266.207194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783952266.207205:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049d76680 x1870605465645056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952291 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.207213:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8613 usecs (9 jiffies) 00000100:00100000:3.0:1783952266.207281:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465644544 00000100:00100000:3.0:1783952266.207288:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465644544 00000020:00000040:3.0:1783952266.207302:0:8435:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe50 00000100:00100000:3.0:1783952266.207327:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465645056 00000100:00100000:3.0:1783952266.207329:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465645056 00000020:00000040:3.0:1783952266.207331:0:8435:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6011 00000100:00100000:3.0:1783952266.207346:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5044 00000100:00000040:3.0:1783952266.207350:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14deba680 x1870605465644544/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952286 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.207359:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1870605465644544:12345-0@lo:8:kworker.0 00000020:00000040:3.0:1783952266.207375:0:8435:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 7 - find 00010000:00000040:3.0:1783952266.207380:0:8435:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:3.0:1783952266.207382:0:8435:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff97b167c919c0) now 7 - find 00000100:00000040:3.0:1783952266.207825:0:8435:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:3.0:1783952266.207829:0:8435:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:3.0:1783952266.207832:0:8435:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.207853:0:8435:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff97b047acce00 x1870605465644544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952291 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.207873:0:8435:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 54 to 0@lo 00000100:00000040:3.0:1783952266.207878:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deba680 x1870605465644544/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783952286 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.207897:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1870605465644544:12345-0@lo:8:kworker.0 Request processed in 538us (777us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783952266.207905:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5044 00000100:00100000:3.0:1783952266.207922:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5045 00000100:00000040:3.0:1783952266.207925:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14deb8380 x1870605465645056/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952286 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.207933:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1870605465645056:12345-0@lo:8:kworker.0 00000020:00000040:3.0:1783952266.207941:0:8435:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 7 - find 00010000:00000040:3.0:1783952266.207944:0:8435:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:3.0:1783952266.207946:0:8435:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff97b167c919c0) now 7 - find 00000100:00000040:3.0:1783952266.207954:0:8435:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:3.0:1783952266.207956:0:8435:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:3.0:1783952266.207959:0:8435:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952266.207973:0:8435:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff97b049d76680 x1870605465645056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952291 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.207984:0:8435:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 54 to 0@lo 00000100:00000040:3.0:1783952266.207987:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8380 x1870605465645056/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783952286 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.207995:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1870605465645056:12345-0@lo:8:kworker.0 Request processed in 62us (802us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783952266.208000:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5045 00000100:00000040:3.0:1783952266.208067:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968956 00000100:00000040:3.0:1783952266.208073:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b047acce00 x1870605465644544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952291 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952266.208083:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952266.208086:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:3.0:1783952266.208095:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b047acce00 x1870605465644544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952291 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.208101:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465644544:0@lo:8:kworker.0 00000100:00000040:3.0:1783952266.208109:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968974 00000100:00000040:3.0:1783952266.208113:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049d76680 x1870605465645056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952291 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952266.208118:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783952266.208120:0:3641:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:3.0:1783952266.208123:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d76680 x1870605465645056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952291 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.208129:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465645056:0@lo:8:kworker.0 00000100:00000040:3.0:1783952266.208133:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b047acce00 x1870605465644544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952291 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.208141:0:3641:0:(genops.c:1244:class_import_put()) import ffff97b15f80e000 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1783952266.208147:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049d76680 x1870605465645056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783952291 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.208152:0:3641:0:(genops.c:1244:class_import_put()) import ffff97b143af6800 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1783952266.208263:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465644032 00000100:00100000:0.0:1783952266.208268:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465644032 00000020:00000040:0.0:1783952266.208270:0:83761:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:0.0:1783952266.208516:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00000040:0.0:1783952266.208522:0:83761:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14deb8e00 x1870605465644032/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1783952286 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.208530:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3641:x1870605465644032:12345-0@lo:38:llog_process_th.0 00000020:00000040:0.0:1783952266.208539:0:83761:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 14 - find 00010000:00000040:0.0:1783952266.208546:0:83761:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1783952266.208552:0:83761:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3981 last 0 00000020:00000040:0.0:1783952266.208561:0:83761:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b174b00800 with handle 0x22c73c7857bb6f61 to hash 00000020:00000040:0.0:1783952266.208584:0:83761:0:(genops.c:889:class_export_get()) GET export ffff97b174b00800 refcount=3 00000020:00000040:0.0:1783952266.208617:0:83761:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 15 - export 00000020:00000040:0.0:1783952266.208621:0:83761:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b00800 : new refcount 2 00000020:00000080:0.0:1783952266.208623:0:83761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x22c73c7857bb6f61 00000020:00000040:0.0:1783952266.208626:0:83761:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f61 00000020:00000040:0.0:1783952266.208628:0:83761:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b00800 refcount=3 00000001:00000040:0.0:1783952266.208637:0:83761:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.202.148@tcp 00000001:00000040:0.0:1783952266.208641:0:83761:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff97b164e4f800) : new refcount 17 00000020:00000040:0.0:1783952266.208645:0:83761:0:(genops.c:889:class_export_get()) GET export ffff97b174b00800 refcount=4 00000001:00000040:0.0:1783952266.208647:0:83761:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff97b164e4f800) : new refcount 18 00000001:00000040:0.0:1783952266.208651:0:83761:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff97b164e4f800) : new refcount 17 00000004:00100000:0.0:1783952266.208655:0:83761:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:0.0:1783952266.208670:0:83761:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff97b174388600 for nid 0@lo - ref 6 00000020:00000040:0.0:1783952266.208680:0:83761:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 16 - import 00000020:00000040:0.0:1783952266.208686:0:83761:0:(genops.c:1244:class_import_put()) import ffff97b176f0b800 refcount=1 obd=lustre-MDT0000 00000020:00000040:0.0:1783952266.208692:0:83761:0:(genops.c:889:class_export_get()) GET export ffff97b174b00800 refcount=5 00000100:00000040:0.0:1783952266.208694:0:83761:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff97b174b00800 : new rpc_count 1 00000100:00000040:0.0:1783952266.208697:0:83761:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000100:00000040:0.0:1783952266.208699:0:83761:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 55 to 0@lo 00000020:00000040:0.0:1783952266.208701:0:83761:0:(genops.c:889:class_export_get()) GET export ffff97b174b00800 refcount=6 00000100:00000040:0.0:1783952266.208706:0:83761:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 56 to 0@lo 00000100:00080000:0.0:1783952266.208713:0:83761:0:(import.c:65:import_set_state_nolock()) ffff97b176f0b800 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1783952266.208717:0:83761:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b00800 : new refcount 5 00000020:00000040:0.0:1783952266.208719:0:83761:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff97b0468a4d40) now 16 - find 00010000:00000040:0.0:1783952266.208731:0:83761:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465644032 00000100:00000040:0.0:1783952266.208736:0:83761:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 57 to 0@lo 00000100:00000040:0.0:1783952266.208739:0:83761:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.208761:0:83761:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff97b166fb2a00 x1870605465644032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783952276 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.208783:0:83761:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 56 to 0@lo 00000100:00000040:0.0:1783952266.208787:0:83761:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8e00 x1870605465644032/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783952286 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.208793:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870605465644032:12345-0@lo:38:llog_process_th.0 Request processed in 263us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952266.208799:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00000040:0.0:1783952266.208802:0:83761:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b00800 : new rpc_count 0 00000020:00000040:0.0:1783952266.208808:0:83761:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b00800 : new refcount 4 00000100:00100000:3.0:1783952266.209085:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:3.0:1783952266.209090:0:3641:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:3.0:1783952266.209097:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b166fb2a00 x1870605465644032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783952266.209107:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000020:00000040:3.0:1783952266.209109:0:3641:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f5a 00000020:00000040:3.0:1783952266.209112:0:3641:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174849000 refcount=4 00000100:00080000:3.0:1783952266.209118:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:3.0:1783952266.209128:0:3641:0:(genops.c:900:class_export_put()) PUTting export ffff97b174849000 : new refcount 3 00000100:00080000:3.0:1783952266.209132:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783952266.209135:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b04e288000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:3.0:1783952266.209141:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb2a00 x1870605465644032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952276 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.209149:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b166fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1870605465644032:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1783952266.209155:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b166fb2a00 x1870605465644032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952276 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.209163:0:3641:0:(genops.c:1244:class_import_put()) import ffff97b04e288000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1783952266.209486:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1783952266.209493:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b047aced80 x1870605465644416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.209501:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b047aced80 x1870605465644416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.209507:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465644416:0@lo:400:kworker.0 00000100:00000040:2.0:1783952266.209518:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968959 00000100:00000040:2.0:1783952266.209521:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049d77800 x1870605465645184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.209529:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d77800 x1870605465645184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.209536:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465645184:0@lo:400:kworker.0 00000100:00000040:2.0:1783952266.209549:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783952266.209554:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b047acc380 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.209561:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b047acc380 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.209569:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b047acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465644288:0@lo:400:kworker.0 00000100:00000040:2.0:1783952266.209580:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1783952266.209584:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049d77100 x1870605465644928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.209637:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d77100 x1870605465644928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.209644:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465644928:0@lo:400:kworker.0 00000100:00000040:2.0:1783952266.209649:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b047aced80 x1870605465644416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952266.209659:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b048caf800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1783952266.209665:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049d77800 x1870605465645184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952266.209673:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b14f00d800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1783952266.209678:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b047acc380 x1870605465644288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952266.209684:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b046a94800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1783952266.209688:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049d77100 x1870605465644928/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952266.209694:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b15036a000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:1.0:1783952266.210167:0:96995:0:(genops.c:889:class_export_get()) GET export ffff97b174849000 refcount=4 00000020:00000040:1.0:1783952266.210212:0:96995:0:(genops.c:889:class_export_get()) GET export ffff97b174849000 refcount=5 00000100:00000040:1.0:1783952266.210277:0:96995:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.202.148@tcp 192.168.202.148@tcp cnt=1 00000020:01000004:1.0:1783952266.210372:0:96995:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783952266.210390:0:96995:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff97b1447b8000) 00000020:00000040:1.0:1783952266.210395:0:96995:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b15036a800 with handle 0x22c73c7857bb6f68 to hash 00000020:00000040:1.0:1783952266.210402:0:96995:0:(genops.c:900:class_export_put()) PUTting export ffff97b15036a800 : new refcount 1 00000020:00000040:1.0:1783952266.210414:0:96995:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff97b1447b8000) now 2 - obd_device_list 00000020:00000080:1.0:1783952266.210420:0:96995:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1783952266.210777:0:96995:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97b17484c000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783952266.210782:0:96995:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97b17484c000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783952266.210784:0:96995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97b17484c000 3 00000020:00000040:1.0:1783952266.210799:0:96995:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff97b1447b8000) now 3 - import 00000020:00000040:1.0:1783952266.210803:0:96995:0:(genops.c:1244:class_import_put()) import ffff97b0478e7000 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:1.0:1783952266.210815:0:96995:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 57 to 0@lo 00000100:00000040:1.0:1783952266.210817:0:96995:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 57 to 0@lo 00000100:00000040:1.0:1783952266.210820:0:96995:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.148@tcp -> ffff97b142e66080 00010000:00080000:1.0:1783952266.210831:0:96995:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97b0478e7000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.148@tcp at head 00000020:00000040:0.0:1783952266.212411:0:96997:0:(genops.c:889:class_export_get()) GET export ffff97b174849000 refcount=6 00000020:00000040:0.0:1783952266.212418:0:96997:0:(genops.c:889:class_export_get()) GET export ffff97b174849000 refcount=7 00000020:00000040:0.0:1783952266.212422:0:96997:0:(genops.c:900:class_export_put()) PUTting export ffff97b174849000 : new refcount 6 00010000:00010000:1.0:1783952266.215053:0:96995:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:1.0:1783952266.215156:0:96995:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff97b1447b8000) now 4 - setup 00000020:00000080:1.0:1783952266.215161:0:96995:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1783952266.215204:0:96995:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:1.0:1783952266.215210:0:96995:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b146942800 with handle 0x22c73c7857bb6f6f to hash 00000020:00000040:1.0:1783952266.215217:0:96995:0:(genops.c:889:class_export_get()) GET export ffff97b146942800 refcount=3 00000020:00000040:1.0:1783952266.215221:0:96995:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff97b1447b8000) now 5 - export 00000020:00000040:1.0:1783952266.215224:0:96995:0:(genops.c:900:class_export_put()) PUTting export ffff97b146942800 : new refcount 2 00000020:00000080:1.0:1783952266.215227:0:96995:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x22c73c7857bb6f6f 00000020:00000040:1.0:1783952266.215229:0:96995:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f6f 00000020:00000040:1.0:1783952266.215232:0:96995:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b146942800 refcount=3 00000100:00080000:1.0:1783952266.215240:0:96995:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:1.0:1783952266.215245:0:96995:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 58 to 0@lo 00000020:00000040:1.0:1783952266.215247:0:96995:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f6f 00000020:00000040:1.0:1783952266.215249:0:96995:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b146942800 refcount=4 00000100:00000040:1.0:1783952266.215251:0:96995:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 59 to 0@lo 00000020:00000040:1.0:1783952266.215253:0:96995:0:(genops.c:900:class_export_put()) PUTting export ffff97b146942800 : new refcount 3 00000100:00080000:1.0:1783952266.215256:0:96995:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff97b0478e7000 using connection 192.168.202.148@tcp/0@lo 00000020:00000040:1.0:1783952266.215271:0:96995:0:(genops.c:1231:class_import_get()) import ffff97b0478e7000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:1.0:1783952266.215305:0:96995:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b177316680 x1870605465645440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952266.215320:0:96995:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000682e306f] to pc [ptlrpcd_rcv+-1] req@ffff97b177316680 x1870605465645440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952266.215346:0:96995:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:1.0:1783952266.215349:0:96995:0:(genops.c:1231:class_import_get()) import ffff97b0478e7000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:1.0:1783952266.215385:0:86521:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3986) 00000100:00000040:0.0:1783952266.215930:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177316680 x1870605465645440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.215949:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1870605465645440:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1783952266.215978:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177316680 x1870605465645440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783952276 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.215985:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.216021:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d76d80 x1870605465645440 msgsize 520 00000100:00100000:0.0:1783952266.216025:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.216054:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177316680 x1870605465645440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783952276 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.216066:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00100000:2.0:1783952266.216282:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465645440 00000100:00100000:2.0:1783952266.216299:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465645440 00000020:00000040:2.0:1783952266.216301:0:67035:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:2.0:1783952266.216371:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00000040:2.0:1783952266.216379:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d76d80 x1870605465645440/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1783952286 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.216390:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1870605465645440:12345-0@lo:38:llog_process_th.0 00000020:00000040:2.0:1783952266.216403:0:67035:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 10 - find 00010000:00000040:2.0:1783952266.216412:0:67035:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1783952266.216417:0:67035:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3981 last 0 00000020:00000040:2.0:1783952266.216428:0:67035:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b176bcc000 with handle 0x22c73c7857bb6f76 to hash 00000020:00000040:2.0:1783952266.218557:0:67035:0:(genops.c:889:class_export_get()) GET export ffff97b176bcc000 refcount=3 00000020:00000040:2.0:1783952266.218567:0:67035:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 11 - export 00000020:00000040:2.0:1783952266.218571:0:67035:0:(genops.c:900:class_export_put()) PUTting export ffff97b176bcc000 : new refcount 2 00000020:00000080:2.0:1783952266.218573:0:67035:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x22c73c7857bb6f76 00000020:00000040:2.0:1783952266.218576:0:67035:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f76 00000020:00000040:2.0:1783952266.218579:0:67035:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b176bcc000 refcount=3 00000001:00000040:2.0:1783952266.218615:0:67035:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.202.148@tcp 00000001:00000040:2.0:1783952266.218620:0:67035:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff97b164e4f800) : new refcount 18 00000020:00000040:2.0:1783952266.218624:0:67035:0:(genops.c:889:class_export_get()) GET export ffff97b176bcc000 refcount=4 00000001:00000040:2.0:1783952266.218626:0:67035:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff97b164e4f800) : new refcount 19 00000001:00000040:2.0:1783952266.218629:0:67035:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff97b164e4f800) : new refcount 18 00000004:00100000:2.0:1783952266.218634:0:67035:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:2.0:1783952266.218646:0:67035:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff97b0496532a0 for nid 0@lo - ref 4 00000020:00000040:2.0:1783952266.218749:0:67035:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 12 - import 00000020:00000040:2.0:1783952266.218756:0:67035:0:(genops.c:1244:class_import_put()) import ffff97b176bcd000 refcount=1 obd=lustre-MDT0001 00000020:00000040:2.0:1783952266.218767:0:67035:0:(genops.c:889:class_export_get()) GET export ffff97b176bcc000 refcount=5 00000100:00000040:2.0:1783952266.218770:0:67035:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff97b176bcc000 : new rpc_count 1 00000100:00000040:2.0:1783952266.218775:0:67035:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 60 to 0@lo 00000100:00000040:2.0:1783952266.218778:0:67035:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 60 to 0@lo 00000020:00000040:2.0:1783952266.218781:0:67035:0:(genops.c:889:class_export_get()) GET export ffff97b176bcc000 refcount=6 00000100:00000040:2.0:1783952266.218788:0:67035:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 61 to 0@lo 00000100:00080000:2.0:1783952266.218798:0:67035:0:(import.c:65:import_set_state_nolock()) ffff97b176bcd000 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1783952266.218803:0:67035:0:(genops.c:900:class_export_put()) PUTting export ffff97b176bcc000 : new refcount 5 00000020:00000040:2.0:1783952266.218806:0:67035:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff97b167c13380) now 12 - find 00010000:00000040:2.0:1783952266.218820:0:67035:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465645440 00000100:00000040:2.0:1783952266.218830:0:67035:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:2.0:1783952266.218836:0:67035:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.218888:0:67035:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff97b177316680 x1870605465645440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783952276 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.218943:0:67035:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 61 to 0@lo 00000100:00000040:2.0:1783952266.218949:0:67035:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d76d80 x1870605465645440/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783952286 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.218958:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870605465645440:12345-0@lo:38:llog_process_th.0 Request processed in 2568us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.218967:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00000040:2.0:1783952266.218971:0:67035:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b176bcc000 : new rpc_count 0 00000020:00000040:2.0:1783952266.218981:0:67035:0:(genops.c:900:class_export_put()) PUTting export ffff97b176bcc000 : new refcount 4 00000100:00100000:1.0:1783952266.219222:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:1.0:1783952266.219228:0:3641:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:1.0:1783952266.219240:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177316680 x1870605465645440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952266.219252:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 18 00000020:00000040:1.0:1783952266.219255:0:3641:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f6f 00000020:00000040:1.0:1783952266.219257:0:3641:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b146942800 refcount=4 00000100:00080000:1.0:1783952266.219263:0:3641:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:1.0:1783952266.219266:0:3641:0:(genops.c:900:class_export_put()) PUTting export ffff97b146942800 : new refcount 3 00000100:00080000:1.0:1783952266.219270:0:3641:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783952266.219272:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b0478e7000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:1.0:1783952266.219279:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177316680 x1870605465645440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952276 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.219287:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1870605465645440:0@lo:38:llog_process_th.0 00000100:00000040:1.0:1783952266.219305:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177316680 x1870605465645440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783952276 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952266.219315:0:3641:0:(genops.c:1244:class_import_put()) import ffff97b0478e7000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000020:00000040:1.0:1783952266.224580:0:96995:0:(genops.c:889:class_export_get()) GET export ffff97b146942800 refcount=4 00000020:00000040:1.0:1783952266.224629:0:96995:0:(genops.c:889:class_export_get()) GET export ffff97b146942800 refcount=5 00000040:00080000:1.0:1783952266.224732:0:96995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:01000000:1.0:1783952266.224851:0:96984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:1.0:1783952266.224882:0:96984:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:1.0:1783952266.224896:0:96984:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b1414a3800 refcount=3 00010000:00010000:1.0:1783952266.224903:0:96984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b1414a3800/0x22c73c7857bb6f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f4c expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.224914:0:96984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b1414a3800/0x22c73c7857bb6f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f4c expref: -99 pid: 96984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783952266.224973:0:96984:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783952266.224980:0:96984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783952266.224981:0:96984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783952266.224983:0:96984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783952266.224984:0:96984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783952266.224985:0:96984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783952266.224986:0:96984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783952266.224988:0:96984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783952266.224990:0:96984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783952266.224993:0:96984:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1783952266.224996:0:96984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783952266.224997:0:96984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783952266.224998:0:96984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783952266.224999:0:96984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783952266.225000:0:96984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783952266.225001:0:96984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783952266.225002:0:96984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783952266.225002:0:96984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783952266.225003:0:96984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:1.0:1783952266.225009:0:96984:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 10000000:01000000:1.0:1783952266.225029:0:96984:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:1.0:1783952266.225047:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177316680 x1870605465645568/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.225060:0:96984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177316680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465645568:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1783952266.225089:0:96984:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177316680 x1870605465645568/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952266.225097:0:96984:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.225136:0:96984:0:(events.c:337:request_in_callback()) incoming req@ffff97b16588c450 x1870605465645568 msgsize 4848 00000100:00100000:1.0:1783952266.225142:0:96984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952266.225143:0:96984:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783952266.225157:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b177316680 x1870605465645568/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.225179:0:96984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf540 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.225413:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465645568 00000100:00100000:2.0:1783952266.225421:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465645568 00000020:00000040:2.0:1783952266.225423:0:94415:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952266.225426:0:94415:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=24 00000100:00000040:2.0:1783952266.225453:0:94415:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952266.225482:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00000040:2.0:1783952266.225485:0:94415:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952266.225490:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16588c450 x1870605465645568/t0(0) o253->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 4848/0 e 0 to 0 dl 1783952277 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.225501:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465645568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783952266.225525:0:94415:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783952266.225534:0:94415:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000040:2.0:1783952266.225669:0:96999:0:(genops.c:900:class_export_put()) PUTting export ffff97b146942800 : new refcount 4 20000000:01000000:2.0:1783952266.233885:0:94415:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783952266.233904:0:94415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:2.0:1783952266.234095:0:94415:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465645568 00000100:00000040:2.0:1783952266.234113:0:94415:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:2.0:1783952266.234123:0:94415:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.234178:0:94415:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff97b177316680 x1870605465645568/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952266.234239:0:94415:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 61 to 0@lo 00000100:00000040:2.0:1783952266.234246:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16588c450 x1870605465645568/t0(0) o253->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 4848/4768 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952266.234255:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:96984:x1870605465645568:12345-0@lo:253:mount.lustre.0 Request processed in 8755us (9117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.234266:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00000040:2.0:1783952266.234270:0:94415:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952266.234284:0:94415:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00000040:3.0:1783952266.234416:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177316680 x1870605465645568/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952266.234427:0:96984:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177316680 x1870605465645568/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952266.234445:0:96984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177316680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:96984:1870605465645568:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1783952266.234455:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177316680 x1870605465645568/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783952266.234467:0:96984:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783952266.234471:0:96984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783952266.234473:0:96984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783952266.234474:0:96984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783952266.234476:0:96984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783952266.234477:0:96984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783952266.234478:0:96984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783952266.234480:0:96984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783952266.234483:0:96984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783952266.234484:0:96984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:3.0:1783952266.234487:0:96984:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177316680 x1870605465645568/t0(0) o253->MGC192.168.202.148@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952266.234507:0:96984:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000020:02000000:3.0:1783952266.234520:0:96984:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00002000:00000040:3.0:1783952266.234699:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:3.0:1783952266.234726:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:3.0:1783952266.234777:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:3.0:1783952266.234816:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:3.0:1783952266.234857:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:3.0:1783952266.234889:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:3.0:1783952266.234911:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:3.0:1783952266.234936:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:3.0:1783952266.234973:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:3.0:1783952266.235015:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 20000000:01000000:1.0:1783952266.235548:0:94413:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783952266.235554:0:94413:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:1.0:1783952266.235571:0:94413:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b176e56d00 count: 4 00000020:00000040:1.0:1783952266.235578:0:94413:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b17499ca00 with handle 0x22c73c7857bb6f7d to hash 00010000:00010000:1.0:1783952266.235671:0:94413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.235687:0:94413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb606c expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.235696:0:94413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6088 expref: 23 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.235782:0:94413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f8 expref: 9 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.235790:0:94413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783952266.235796:0:94413:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff97b176e56d00) refcount = 4 00010000:00000040:1.0:1783952266.235798:0:94413:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1783952266.235802:0:94413:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f8 expref: 9 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783952266.235808:0:94413:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x22c73c7857bb6088 expref: 23 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783952266.235813:0:94413:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x22c73c7857bb606c expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783952266.235818:0:94413:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:1.0:1783952266.235821:0:94413:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783952266.235838:0:94413:0:(genops.c:1231:class_import_get()) import ffff97b0497f4800 refcount=2 obd=MGS 00010000:00010000:1.0:1783952266.235862:0:94413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f8 expref: 9 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.235877:0:94413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f8 expref: 9 pid: 94411 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783952266.235890:0:94413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177315500 x1870605465645696/t0(0) o104->MGS@192.168.202.48@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952266.235900:0:94413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177315500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94413:1870605465645696:192.168.202.48@tcp:104: 00000100:00000040:1.0:1783952266.235921:0:94413:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff97b177315500 x1870605465645696/t0(0) o104->MGS@192.168.202.48@tcp:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952266.235929:0:94413:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000020:00000040:1.0:1783952266.235990:0:94413:0:(genops.c:1231:class_import_get()) import ffff97b1445c2000 refcount=2 obd=MGS 00010000:00010000:1.0:1783952266.235998:0:94413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb6088 expref: 23 pid: 94415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.236006:0:94413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb6088 expref: 23 pid: 94415 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783952266.236014:0:94413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177314700 x1870605465645824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952266.236022:0:94413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177314700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94413:1870605465645824:0@lo:104: 00000100:00000040:1.0:1783952266.236031:0:94413:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff97b177314700 x1870605465645824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952266.236038:0:94413:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.236064:0:94413:0:(events.c:337:request_in_callback()) incoming req@ffff97b177315c00 x1870605465645824 msgsize 328 00000100:00100000:1.0:1783952266.236068:0:94413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000040:3.0:1783952266.236205:0:96984:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:3.0:1783952266.236323:0:96984:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294968978 00000100:00000040:0.0:1783952266.236481:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177315500 x1870605465645696/t0(0) o104->MGS@192.168.202.48@tcp:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952266.236685:0:94413:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177314700 x1870605465645824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1783952266.236731:0:94413:0:(genops.c:1231:class_import_get()) import ffff97b1445c2000 refcount=3 obd=MGS 00010000:00010000:1.0:1783952266.236743:0:94413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22c73c7857bb606c expref: 23 pid: 94412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.236752:0:94413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22c73c7857bb606c expref: 23 pid: 94412 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783952266.236760:0:94413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177314e00 x1870605465645952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952266.236768:0:94413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177314e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94413:1870605465645952:0@lo:104: 00000100:00000040:1.0:1783952266.236782:0:94413:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff97b177314e00 x1870605465645952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952266.236788:0:94413:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952266.236807:0:94413:0:(events.c:337:request_in_callback()) incoming req@ffff97b165b66c50 x1870605465645952 msgsize 328 00000100:00100000:1.0:1783952266.236810:0:94413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952266.236812:0:94413:0:(events.c:349:request_in_callback()) Buffer complete: 1 buffers still posted 00010000:00080000:3.0:1783952266.237223:0:97001:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-OST0000: started recovery thread pid 97001 00010000:02000000:3.0:1783952266.237233:0:97001:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00000020:01000004:3.0:1783952266.237274:0:96984:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:3.0:1783952266.237281:0:96984:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff97b17496d900 : new refcount 2 00000040:00000040:3.0:1783952266.237285:0:96984:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff97b17496d900 : new refcount 1 00000020:00000040:3.0:1783952266.237309:0:96984:0:(genops.c:900:class_export_put()) PUTting export ffff97b17484b800 : new refcount 1 00000020:00000040:3.0:1783952266.237321:0:96984:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.202.148@tcp (ffff97b167c90000) now 6 - mgc_fs 10000000:01000000:3.0:1783952266.237324:0:96984:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783952266.237341:0:96984:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783952266.237370:0:96984:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1783952266.238163:0:96984:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783952266.238392:0:96984:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00000040:1.0:1783952266.241869:0:94413:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177314e00 x1870605465645952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783952266.241907:0:94413:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf600 going to sleep for 11 seconds 00000100:00100000:2.0:1783952266.244888:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465645824 00000100:00100000:2.0:1783952266.244902:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465645824 00000020:00000040:2.0:1783952266.244906:0:6500:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857b6fa68 00000020:00000040:2.0:1783952266.244911:0:6500:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b166f54000 refcount=3 00000100:00000040:2.0:1783952266.244943:0:6500:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:2.0:1783952266.244973:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465645952 00000100:00100000:2.0:1783952266.244976:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465645952 00000020:00000040:2.0:1783952266.244979:0:6500:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857b6fa68 00000020:00000040:2.0:1783952266.244982:0:6500:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b166f54000 refcount=4 00000100:00100000:2.0:1783952266.245001:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00000040:2.0:1783952266.245005:0:6500:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b166f54000 : new rpc_count 1 00000100:00000040:2.0:1783952266.245013:0:6500:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177315c00 x1870605465645824/t0(0) o104->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/0 e 0 to 0 dl 1783952277 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952266.245025:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:94413:x1870605465645824:12345-0@lo:104: 00000020:00000040:2.0:1783952266.245036:0:6500:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b047b2c400 refcount=2 00010000:00010000:2.0:1783952266.245045:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783952266.245069:0:6500:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:2.0:1783952266.245083:0:6500:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.245129:0:6500:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff97b177314700 x1870605465645824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783952266.245332:0:6500:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 61 to 0@lo 00010000:00010000:2.0:1783952266.245347:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:2.0:1783952266.245351:0:6500:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177315c00 x1870605465645824/t0(0) o104->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952266.245360:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+4:94413:x1870605465645824:12345-0@lo:104: Request processed in 336us (9295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.245367:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00000040:2.0:1783952266.245370:0:6500:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b166f54000 : new rpc_count 0 00000020:00000040:2.0:1783952266.245378:0:6500:0:(genops.c:900:class_export_put()) PUTting export ffff97b166f54000 : new refcount 3 00000100:00100000:2.0:1783952266.245386:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00000040:2.0:1783952266.245389:0:6500:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b166f54000 : new rpc_count 1 00000100:00000040:2.0:1783952266.245392:0:6500:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b165b66c50 x1870605465645952/t0(0) o104->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/0 e 0 to 0 dl 1783952277 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952266.245402:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b165b66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:94413:x1870605465645952:12345-0@lo:104: 00000020:00000040:2.0:1783952266.245407:0:6500:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b175a14200 refcount=2 00010000:00010000:2.0:1783952266.245412:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783952266.245423:0:6500:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:2.0:1783952266.245426:0:6500:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952266.245452:0:6500:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff97b177314e00 x1870605465645952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783952266.245463:0:6500:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 61 to 0@lo 00010000:00010000:2.0:1783952266.245470:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00000040:2.0:1783952266.245474:0:6500:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b165b66c50 x1870605465645952/t0(0) o104->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783952266.245487:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b165b66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+3:94413:x1870605465645952:12345-0@lo:104: Request processed in 87us (8679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952266.245493:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00000040:2.0:1783952266.245495:0:6500:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b166f54000 : new rpc_count 0 00000020:00000040:2.0:1783952266.245500:0:6500:0:(genops.c:900:class_export_put()) PUTting export ffff97b166f54000 : new refcount 2 00010000:00080000:0.0:1783952266.248676:0:97001:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1783952266.248685:0:97001:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:0.0:1783952266.250622:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783952266.250636:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.250647:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b047b2c400 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952266.250652:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1783952266.250661:0:7459:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b047b2c400 refcount=3 00010000:00010000:0.0:1783952266.250666:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952266.250674:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952266.250697:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:0.0:1783952266.250711:0:7459:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:0.0:1783952266.250713:0:7459:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:0.0:1783952266.250734:0:7459:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff97b14776a400) refs 2 00000020:00000040:0.0:1783952266.250743:0:7459:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff97b047b2c400 with handle 0x22c73c7857bb6088 from hash 00000020:00000040:0.0:1783952266.250756:0:7459:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00010000:00010000:0.0:1783952266.250778:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.250784:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:0.0:1783952266.250800:0:7459:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006d7aa292] to pc [ptlrpcd_00_03+3] req@ffff97b049d75f80 x1870605465646080/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783952266.250825:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.250832:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b047b2c400/0x22c73c7857bb6088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb608f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.250845:0:7459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783952266.250849:0:7459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.250855:0:7459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b175a14200 already unused, calling callback (ffffffffc13acc20) 10000000:00010000:0.0:1783952266.250858:0:7459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1783952266.250863:0:7459:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b175a14200 refcount=3 00010000:00010000:0.0:1783952266.250866:0:7459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783952266.250881:0:7459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783952266.250886:0:7459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:0.0:1783952266.250888:0:7459:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=3) 10000000:00000040:0.0:1783952266.250890:0:7459:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:0.0:1783952266.250892:0:7459:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff97b1741b8800) refs 2 00000020:00000040:0.0:1783952266.250895:0:7459:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff97b175a14200 with handle 0x22c73c7857bb606c from hash 00000020:00000040:0.0:1783952266.250901:0:7459:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00010000:00010000:0.0:1783952266.250909:0:7459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.250915:0:7459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:0.0:1783952266.250920:0:7459:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007f15a89d] to pc [ptlrpcd_00_00+0] req@ffff97b049d77100 x1870605465646208/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783952266.250938:0:7459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.250944:0:7459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.148@tcp lock: ffff97b175a14200/0x22c73c7857bb606c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22c73c7857bb6073 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.250950:0:7459:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff97b176ee0f00 count: 0 00010000:00010000:0.0:1783952266.250962:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952266.250964:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783952266.250966:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1783952266.250983:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049d75f80 x1870605465646080/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.250995:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465646080:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1783952266.251045:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049d75f80 x1870605465646080/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.251055:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.251089:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d77800 x1870605465646080 msgsize 328 00000100:00100000:0.0:1783952266.251094:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.251111:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049d75f80 x1870605465646080/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.251156:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:0.0:1783952266.251163:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049d77100 x1870605465646208/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.251172:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465646208:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1783952266.251182:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049d77100 x1870605465646208/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.251190:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.251202:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b14ef41050 x1870605465646208 msgsize 328 00000100:00100000:0.0:1783952266.251206:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952266.251208:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783952266.251219:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049d77100 x1870605465646208/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.251240:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465646080 00000100:00100000:0.0:1783952266.251247:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465646080 00000020:00000040:0.0:1783952266.251249:0:6503:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:0.0:1783952266.251252:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=24 00000100:00000040:0.0:1783952266.251269:0:6503:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:0.0:1783952266.251276:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b04db70e00 refcount=5 00010000:00010000:0.0:1783952266.251281:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6088 expref: 24 pid: 94415 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952266.251303:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465646208 00000100:00100000:0.0:1783952266.251311:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465646208 00000020:00000040:0.0:1783952266.251313:0:6503:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:0.0:1783952266.251315:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=25 00000020:00000040:0.0:1783952266.251324:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b1762ae600 refcount=5 00010000:00010000:0.0:1783952266.251328:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb606c expref: 25 pid: 94412 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783952266.251348:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00000040:0.0:1783952266.251352:0:6503:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:0.0:1783952266.251356:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d77800 x1870605465646080/t0(0) o103->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/0 e 0 to 0 dl 1783952277 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.251367:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3645:x1870605465646080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952266.251380:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1783952266.251382:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b04db70e00 refcount=5 00010000:00000040:0.0:1783952266.251385:0:6503:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b176e56d00 count: 5 00010000:00010000:0.0:1783952266.251388:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb6088 expref: 25 pid: 94415 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.251399:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb6088 expref: 25 pid: 94415 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1783952266.251412:0:6503:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff97b04db70e00 with handle 0x22c73c7857bb608f from hash 00010000:00000040:0.0:1783952266.251416:0:6503:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff97b17499ca00 00010000:00010000:0.0:1783952266.251421:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1783952266.251428:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:0.0:1783952266.251432:0:6503:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.251462:0:6503:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049d75f80 x1870605465646080/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.251479:0:6503:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 61 to 0@lo 00000100:00000040:0.0:1783952266.251483:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d77800 x1870605465646080/t0(0) o103->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.251497:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+25:3645:x1870605465646080:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952266.251504:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00000040:0.0:1783952266.251508:0:6503:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:0.0:1783952266.251517:0:6503:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 24 00000100:00100000:0.0:1783952266.251526:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00000040:0.0:1783952266.251529:0:6503:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:0.0:1783952266.251533:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14ef41050 x1870605465646208/t0(0) o103->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/0 e 0 to 0 dl 1783952277 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.251543:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ef41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465646208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783952266.251551:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1783952266.251554:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b1762ae600 refcount=5 00010000:00000040:0.0:1783952266.251556:0:6503:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b176e56d00 count: 5 00010000:00010000:0.0:1783952266.251559:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22c73c7857bb606c expref: 24 pid: 94412 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.251567:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22c73c7857bb606c expref: 24 pid: 94412 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1783952266.251574:0:6503:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff97b1762ae600 with handle 0x22c73c7857bb6073 from hash 00010000:00000040:0.0:1783952266.251577:0:6503:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff97b17499ca00 00010000:00010000:0.0:1783952266.251579:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1783952266.251582:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:0.0:1783952266.251619:0:6503:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952266.251634:0:6503:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049d77100 x1870605465646208/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.251650:0:6503:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 61 to 0@lo 00000100:00000040:0.0:1783952266.251660:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14ef41050 x1870605465646208/t0(0) o103->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:527/0 lens 328/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.251668:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ef41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465646208:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952266.251674:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00000040:0.0:1783952266.251676:0:6503:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:0.0:1783952266.251682:0:6503:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00000040:0.0:1783952266.251742:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049d77100 x1870605465646208/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.251751:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d77100 x1870605465646208/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.251758:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465646208:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1783952266.251766:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049d77100 x1870605465646208/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.251776:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000100:00000040:0.0:1783952266.251987:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049d75f80 x1870605465646080/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952266.251995:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d75f80 x1870605465646080/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952266.252001:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465646080:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1783952266.252006:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049d75f80 x1870605465646080/t0(0) o103->MGC192.168.202.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952266.252014:0:3645:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000100:00000040:1.0:1783952266.253104:0:3635:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff97b177315500 x1870605465645696/t0(0) o104->MGS@192.168.202.48@tcp:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952266.253880:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b177315180 x1870605447847680 msgsize 328 00000100:00100000:1.0:1783952266.253889:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952266.253932:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447847680 00000100:00100000:1.0:1783952266.253940:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447847680 00000020:00000040:1.0:1783952266.253943:0:6502:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6065 00000020:00000040:1.0:1783952266.253947:0:6502:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f5000 refcount=10 00000100:00000040:1.0:1783952266.253969:0:6502:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:1.0:1783952266.253978:0:6502:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b1762af400 refcount=5 00010000:00010000:1.0:1783952266.253994:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f8 expref: 10 pid: 94411 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783952266.254029:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2606 00000100:00000040:1.0:1783952266.254033:0:6502:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f5000 : new rpc_count 1 00000100:00000040:1.0:1783952266.254040:0:6502:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177315180 x1870605447847680/t0(0) o103->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:527/0 lens 328/0 e 0 to 0 dl 1783952277 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.254053:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177315180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447847680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783952266.254068:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1783952266.254071:0:6502:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b1762af400 refcount=5 00010000:00000040:1.0:1783952266.254074:0:6502:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b176e56d00 count: 5 00010000:00010000:1.0:1783952266.254078:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f8 expref: 10 pid: 94411 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.254090:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f8 expref: 10 pid: 94411 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783952266.254104:0:6502:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff97b1762af400 with handle 0x22c73c7857bb6130 from hash 00010000:00000040:1.0:1783952266.254109:0:6502:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff97b17499ca00 00010000:00010000:1.0:1783952266.254115:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783952266.254123:0:6502:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff97b176e56d00) refcount = 5 00010000:00010000:1.0:1783952266.254127:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783952266.254142:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018588960s 00000020:00000040:1.0:1783952266.254146:0:6502:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b17499ca00 refcount=5 00010000:00010000:1.0:1783952266.254149:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.254162:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.254169:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.254175:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.254181:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97b17499ca00 already unused, calling callback (ffffffffc0db1360) 00010000:00010000:1.0:1783952266.254186:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783952266.254191:0:6502:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b17499ca00 refcount=6 00010000:00010000:1.0:1783952266.254195:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783952266.254201:0:6502:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff97b17499ca00 with handle 0x22c73c7857bb6f7d from hash 00010000:00010000:1.0:1783952266.254206:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952266.254218:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:1.0:1783952266.254226:0:6502:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952266.254231:0:6502:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952266.254268:0:6502:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952266.254274:0:6502:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177315180 x1870605447847680/t0(0) o103->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:527/0 lens 328/224 e 0 to 0 dl 1783952277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952266.254282:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177315180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e617e28a-7c0f-459e-8765-f628898cec50+10:2401:x1870605447847680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 231us (400us total) trans 0 rc 0/0 00000100:00000040:0.0:1783952266.254661:0:94413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177315500 x1870605465645696/t0(0) o104->MGS@192.168.202.48@tcp:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783952266.254684:0:94413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762af400/0x22c73c7857bb6130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a4f8 expref: 10 pid: 94411 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.254691:0:94413:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff97b0497f5000 : new locks_count 3 00000020:00000040:0.0:1783952266.254693:0:94413:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f5000 : new refcount 9 00000100:00000040:0.0:1783952266.254836:0:94413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177315500 x1870605465645696/t0(0) o104->MGS@192.168.202.48@tcp:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952266.254846:0:94413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177315500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94413:1870605465645696:192.168.202.48@tcp:104: 00000100:00000040:0.0:1783952266.254864:0:94413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177314700 x1870605465645824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783952266.254873:0:94413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b04db70e00/0x22c73c7857bb608f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb6088 expref: 23 pid: 94415 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.254878:0:94413:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff97b1445c4000 : new locks_count 17 00000020:00000040:0.0:1783952266.254880:0:94413:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 22 00000100:00000040:0.0:1783952266.254885:0:94413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177314700 x1870605465645824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952266.254891:0:94413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177314700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94413:1870605465645824:0@lo:104: 00000100:00000040:0.0:1783952266.254901:0:94413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177314e00 x1870605465645952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783952266.254908:0:94413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b1762ae600/0x22c73c7857bb6073 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22c73c7857bb606c expref: 22 pid: 94412 timeout: 4081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.254913:0:94413:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff97b1445c4000 : new locks_count 16 00000020:00000040:0.0:1783952266.254914:0:94413:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 21 00000100:00000040:0.0:1783952266.254918:0:94413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177314e00 x1870605465645952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783952266.254932:0:94413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177314e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94413:1870605465645952:0@lo:104: 00000100:00000040:0.0:1783952266.254939:0:94413:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177315500 x1870605465645696/t0(0) o104->MGS@192.168.202.48@tcp:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1783952266.254950:0:94413:0:(genops.c:1244:class_import_put()) import ffff97b0497f4800 refcount=1 obd=MGS 00000100:00000040:0.0:1783952266.254956:0:94413:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177314700 x1870605465645824/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1783952266.254962:0:94413:0:(genops.c:1244:class_import_put()) import ffff97b1445c2000 refcount=2 obd=MGS 00000100:00000040:0.0:1783952266.254966:0:94413:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177314e00 x1870605465645952/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783952282 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1783952266.254971:0:94413:0:(genops.c:1244:class_import_put()) import ffff97b1445c2000 refcount=1 obd=MGS 00010000:00010000:0.0:1783952266.254979:0:94413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.254987:0:94413:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.254992:0:94413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952266.254997:0:94413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97b17499ca00/0x22c73c7857bb6f7d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783952266.255002:0:94413:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff97b176e56d00 count: 0 00000100:00100000:1.0:1783952266.255400:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2606 00000100:00000040:1.0:1783952266.255407:0:6502:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f5000 : new rpc_count 0 00000020:00000040:1.0:1783952266.255418:0:6502:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f5000 : new refcount 8 00010000:00010000:3.0:1783952266.267858:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783952266.785114:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783952267.358843:0:97051:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783952267.359101:0:97051:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00000040:0.0:1783952267.568523:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b16588c050 x1870605447847808 msgsize 328 00000100:00100000:0.0:1783952267.568538:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:0.0:1783952267.568541:0:3636:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1783952267.572799:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447847808 00000100:00100000:3.0:1783952267.572815:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447847808 00000020:00000040:3.0:1783952267.572827:0:94411:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6065 00000020:00000040:3.0:1783952267.572833:0:94411:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f5000 refcount=9 00000100:00000040:3.0:1783952267.572861:0:94411:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783952267.572904:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 209 00000100:00000040:3.0:1783952267.572909:0:94411:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f5000 : new rpc_count 1 00000100:00000040:3.0:1783952267.572917:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16588c050 x1870605447847808/t0(0) o101->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:528/0 lens 328/0 e 0 to 0 dl 1783952278 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952267.572930:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+9:70975:x1870605447847808:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952267.572948:0:94411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:3.0:1783952267.572967:0:94411:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b176d23600 with handle 0x22c73c7857bb6f84 to hash 00010000:00010000:3.0:1783952267.572972:0:94411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d23600/0x22c73c7857bb6f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a98f3bf84a6a86a expref: -99 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952267.572981:0:94411:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff97b0497f5000 : new locks_count 4 00000020:00000040:3.0:1783952267.572983:0:94411:0:(genops.c:889:class_export_get()) GET export ffff97b0497f5000 refcount=10 00010000:00000040:3.0:1783952267.573003:0:94411:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff97b041093d00) refcount = 1 00010000:00010000:3.0:1783952267.573009:0:94411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d23600/0x22c73c7857bb6f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a86a expref: 10 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952267.573020:0:94411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d23600/0x22c73c7857bb6f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a86a expref: 10 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952267.573029:0:94411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d23600, rc 0) 00010000:00000040:3.0:1783952267.573032:0:94411:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605447847808 00000100:00000040:3.0:1783952267.573044:0:94411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952267.573050:0:94411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952267.573113:0:94411:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952267.573118:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16588c050 x1870605447847808/t0(0) o101->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:528/0 lens 328/344 e 0 to 0 dl 1783952278 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952267.573139:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447847808:12345-192.168.202.48@tcp:101:ll_cfg_requeue.0 Request processed in 209us (4615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952267.573146:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 209 00000100:00000040:3.0:1783952267.573150:0:94411:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f5000 : new rpc_count 0 00000020:00000040:3.0:1783952267.573160:0:94411:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f5000 : new refcount 9 00000100:00000040:1.0:1783952267.579071:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b16588d450 x1870605447847936 msgsize 304 00000100:00100000:1.0:1783952267.579090:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:1.0:1783952267.579092:0:3637:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1783952267.579176:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447847936 00000100:00100000:3.0:1783952267.579187:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447847936 00000020:00000040:3.0:1783952267.579190:0:94410:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6065 00000020:00000040:3.0:1783952267.579195:0:94410:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f5000 refcount=10 00000100:00000040:3.0:1783952267.579220:0:94410:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783952267.579257:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 210 00000100:00000040:3.0:1783952267.579261:0:94410:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f5000 : new rpc_count 1 00000100:00000040:3.0:1783952267.579269:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16588d450 x1870605447847936/t0(0) o256->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:528/0 lens 304/0 e 0 to 0 dl 1783952278 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952267.579282:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447847936:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783952267.579310:0:94410:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:3.0:1783952267.579322:0:94410:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1783952267.579329:0:94410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783952267.579331:0:94410:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:3.0:1783952267.579338:0:94410:0:(genops.c:889:class_export_get()) GET export ffff97b0497f5000 refcount=11 00000020:00000040:0.0:1783952267.581812:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f5000 : new refcount 10 00010000:00000040:0.0:1783952267.581838:0:94410:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605447847936 00000100:00000040:0.0:1783952267.581853:0:94410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952267.581866:0:94410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952267.581910:0:94410:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 8 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952267.581919:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16588d450 x1870605447847936/t0(0) o256->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:528/0 lens 304/240 e 0 to 0 dl 1783952278 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952267.581930:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:70975:x1870605447847936:12345-192.168.202.48@tcp:256:ll_cfg_requeue.0 Request processed in 2650us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952267.581940:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 210 00000100:00000040:0.0:1783952267.581944:0:94410:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f5000 : new rpc_count 0 00000020:00000040:0.0:1783952267.581954:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f5000 : new refcount 9 00000100:00000040:1.0:1783952267.585812:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b177315f80 x1870605447848064 msgsize 520 00000100:00100000:1.0:1783952267.585828:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952267.585906:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447848064 00000100:00100000:0.0:1783952267.585917:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447848064 00000020:00000040:0.0:1783952267.585920:0:26199:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6360 00000100:00100000:0.0:1783952267.585968:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5046 00000100:00000040:0.0:1783952267.585978:0:26199:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177315f80 x1870605447848064/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952287 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952267.585990:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2397:x1870605447848064:12345-192.168.202.48@tcp:8:ll_cfg_requeue.0 00000020:00000040:0.0:1783952267.586011:0:26199:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 7 - find 00010000:00000040:0.0:1783952267.586024:0:26199:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1783952267.586032:0:26199:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'd33551be-a709-4ba2-a74c-f4d7b53c6817' at ffff97b0497f3000, cookie 0x22c73c7857bb6f30 00010000:00080000:0.0:1783952267.586037:0:26199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp recovering/t4294968958 exp ffff97b0497f3000 cur 3982 last 1783952266 00010000:02000400:0.0:1783952267.586044:0:26199:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:0.0:1783952267.586051:0:26199:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:0.0:1783952267.586059:0:26199:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff97b164e4f800) : new refcount 19 00000020:00000040:0.0:1783952267.586064:0:26199:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=4 00000001:00000040:0.0:1783952267.586066:0:26199:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff97b164e4f800) : new refcount 20 00000001:00000040:0.0:1783952267.586069:0:26199:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff97b164e4f800) : new refcount 19 00002000:00100000:0.0:1783952267.586081:0:26199:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d33551be-a709-4ba2-a74c-f4d7b53c6817/ffff97b0497f3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783952267.586092:0:26199:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:0.0:1783952267.586102:0:26199:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff97b045a62ea0 for nid 192.168.202.48@tcp - ref 2 00000020:00000040:0.0:1783952267.586197:0:26199:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 8 - import 00000020:00000040:0.0:1783952267.586207:0:26199:0:(genops.c:1244:class_import_put()) import ffff97b176f08800 refcount=1 obd=lustre-OST0000 00000020:00000040:0.0:1783952267.586215:0:26199:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=5 00000100:00000040:0.0:1783952267.586217:0:26199:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:0.0:1783952267.586226:0:26199:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952267.586229:0:26199:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b046b5c800 refcount 9 to 192.168.202.48@tcp 00000020:00000040:0.0:1783952267.586231:0:26199:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=6 00000100:00000040:0.0:1783952267.586237:0:26199:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00000100:00080000:0.0:1783952267.586246:0:26199:0:(import.c:65:import_set_state_nolock()) ffff97b176f08800 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1783952267.586251:0:26199:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 5 00000020:00000040:0.0:1783952267.586254:0:26199:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff97b167c919c0) now 8 - find 00010000:00000040:0.0:1783952267.586265:0:26199:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 0, xid 1870605447848064 00000100:00000040:0.0:1783952267.586272:0:26199:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952267.586278:0:26199:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952267.586323:0:26199:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952267.586329:0:26199:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177315f80 x1870605447848064/t0(0) o8->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:0/0 lens 520/416 e 0 to 0 dl 1783952287 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952267.586340:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447848064:12345-192.168.202.48@tcp:8:ll_cfg_requeue.0 Request processed in 349us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952267.586347:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5046 00000100:00000040:0.0:1783952267.586351:0:26199:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:0.0:1783952267.586361:0:26199:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 4 00000100:00000040:3.0:1783952267.592064:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b14deb8a80 x1870605447818880 msgsize 440 00000100:00100000:3.0:1783952267.592079:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952267.592144:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447818880 00000100:00100000:0.0:1783952267.592155:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447818880 00000020:00000040:0.0:1783952267.592158:0:24883:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:0.0:1783952267.592176:0:24883:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=5 00000100:00000040:0.0:1783952267.592199:0:24883:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783952267.592247:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1048 00000100:00000040:0.0:1783952267.592251:0:24883:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:0.0:1783952267.592259:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14deb8a80 x1870605447818880/t0(4294968979) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:528/0 lens 440/0 e 0 to 0 dl 1783952278 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952267.592273:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447818880:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:0.0:1783952267.592285:0:24883:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14deb8a80 x1870605447818880/t0(4294968979) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:528/0 lens 440/0 e 0 to 0 dl 1783952278 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783952267.592294:0:24883:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968979, current: 4294968979, replaying 00010000:00000040:0.0:1783952267.592297:0:24883:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:0.0:1783952267.592368:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14deb8a80 x1870605447818880/t0(4294968979) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:528/0 lens 440/0 e 0 to 0 dl 1783952278 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952267.592378:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447818880:12345-192.168.202.48@tcp:10:dd.0 Request processed in 107us (315us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783952267.592385:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1048 00000100:00000040:0.0:1783952267.592389:0:24883:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:1.0:1783952267.592429:0:97001:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:2.0:1783952267.809116:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00000040:1.0:1783952268.068836:0:6514:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff97b1741b8800) refs 2 10000000:01000000:1.0:1783952268.068849:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783952268.068852:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b04661c800 from 128 10000000:01000000:1.0:1783952268.068856:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:1.0:1783952268.068865:0:6514:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952268.068897:0:6514:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b17499ca00 with handle 0x22c73c7857bb6f8b to hash 00010000:00010000:1.0:1783952268.068906:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b17499ca00/0x22c73c7857bb6f8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952268.068917:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b17499ca00/0x22c73c7857bb6f8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952268.068927:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b17499ca00/0x22c73c7857bb6f8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783952268.068954:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177317800 x1870605465646336/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.068968:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465646336:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1783952268.068996:0:6514:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177317800 x1870605465646336/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.069011:0:6514:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952268.069054:0:6514:0:(events.c:337:request_in_callback()) incoming req@ffff97b16588e850 x1870605465646336 msgsize 328 00000100:00100000:1.0:1783952268.069059:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952268.069062:0:6514:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783952268.069093:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b177317800 x1870605465646336/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.069121:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf000 going to sleep for 11 seconds 00000100:00100000:3.0:1783952268.069219:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465646336 00000100:00100000:3.0:1783952268.069228:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465646336 00000020:00000040:3.0:1783952268.069231:0:94411:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:3.0:1783952268.069234:0:94411:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=22 00000100:00000040:3.0:1783952268.069261:0:94411:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783952268.069308:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00000040:3.0:1783952268.069319:0:94411:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:3.0:1783952268.069325:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16588e850 x1870605465646336/t0(0) o101->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952268.069337:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+22:6514:x1870605465646336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783952268.069350:0:94411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1783952268.069359:0:94411:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b041093d00 count: 2 00000020:00000040:3.0:1783952268.069364:0:94411:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b176d22a00 with handle 0x22c73c7857bb6f92 to hash 00010000:00010000:3.0:1783952268.069368:0:94411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b176d22a00/0x22c73c7857bb6f92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6f8b expref: -99 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783952268.069376:0:94411:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff97b1445c4000 : new locks_count 17 00000020:00000040:3.0:1783952268.069378:0:94411:0:(genops.c:889:class_export_get()) GET export ffff97b1445c4000 refcount=23 00010000:00000040:3.0:1783952268.069395:0:94411:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff97b041093d00) refcount = 2 00010000:00000040:3.0:1783952268.069398:0:94411:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783952268.069404:0:94411:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b176d23600/0x22c73c7857bb6f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a86a expref: 9 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952268.069411:0:94411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b176d22a00/0x22c73c7857bb6f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6f8b expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952268.069420:0:94411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b176d22a00/0x22c73c7857bb6f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6f8b expref: 23 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783952268.069430:0:94411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b176d22a00, rc 0) 00010000:00000040:3.0:1783952268.069433:0:94411:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465646336 00000100:00000040:3.0:1783952268.069442:0:94411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:3.0:1783952268.069447:0:94411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952268.069468:0:94411:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff97b177317800 x1870605465646336/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952268.069510:0:94411:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 61 to 0@lo 00000100:00000040:3.0:1783952268.069515:0:94411:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16588e850 x1870605465646336/t0(0) o101->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:529/0 lens 328/344 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952268.069523:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465646336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952268.069529:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00000040:3.0:1783952268.069532:0:94411:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:3.0:1783952268.069542:0:94411:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 22 00000100:00000040:2.0:1783952268.069644:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177317800 x1870605465646336/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952268.069654:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177317800 x1870605465646336/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952268.069661:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465646336:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1783952268.069668:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177317800 x1870605465646336/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952268.069679:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b17499ca00 refcount=4 00010000:00000040:2.0:1783952268.069684:0:6514:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff97b17499ca00, remote cookie: 0x22c73c7857bb6f92, flags: 0x0 00010000:00000040:2.0:1783952268.069688:0:6514:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff97b176696500) refcount = 1 00010000:00010000:2.0:1783952268.069692:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b17499ca00/0x22c73c7857bb6f8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f92 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952268.069701:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b17499ca00/0x22c73c7857bb6f8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6f92 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783952268.069709:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177317800 x1870605465646336/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952268.069720:0:6514:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 10000000:00000040:2.0:1783952268.069732:0:6514:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff97b1741b8800) refs 3 00000020:00000040:2.0:1783952268.069735:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b17499ca00 refcount=3 00000020:00000040:2.0:1783952268.069751:0:6514:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:2.0:1783952268.069765:0:6514:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:2.0:1783952268.069777:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b1447b1180 x1870605465646464/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952268.069786:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1447b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465646464:0@lo:256:ll_cfg_requeue.0 00000100:00000040:2.0:1783952268.069806:0:6514:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b1447b1180 x1870605465646464/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952268.069813:0:6514:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952268.069829:0:6514:0:(events.c:337:request_in_callback()) incoming req@ffff97b16588c850 x1870605465646464 msgsize 304 00000100:00100000:2.0:1783952268.069834:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952268.069835:0:6514:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1783952268.069851:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b1447b1180 x1870605465646464/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952268.069868:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b1460ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1783952268.069980:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465646464 00000100:00100000:1.0:1783952268.069985:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465646464 00000020:00000040:1.0:1783952268.069987:0:94412:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:1.0:1783952268.069989:0:94412:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=23 00000100:00000040:1.0:1783952268.070002:0:94412:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783952268.070026:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00000040:1.0:1783952268.070029:0:94412:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:1.0:1783952268.070034:0:94412:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16588c850 x1870605465646464/t0(0) o256->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:529/0 lens 304/0 e 0 to 0 dl 1783952279 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.070045:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465646464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783952268.070061:0:94412:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:1.0:1783952268.070073:0:94412:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1783952268.070080:0:94412:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783952268.070082:0:94412:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:1.0:1783952268.070090:0:94412:0:(genops.c:889:class_export_get()) GET export ffff97b1445c4000 refcount=24 00000020:00000040:1.0:1783952268.070135:0:94412:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00010000:00000040:1.0:1783952268.070149:0:94412:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465646464 00000100:00000040:1.0:1783952268.070155:0:94412:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:1.0:1783952268.070159:0:94412:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952268.070174:0:94412:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff97b1447b1180 x1870605465646464/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.070186:0:94412:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 61 to 0@lo 00000100:00000040:1.0:1783952268.070195:0:94412:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16588c850 x1870605465646464/t0(0) o256->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:529/0 lens 304/240 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.070203:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465646464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952268.070210:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00000040:1.0:1783952268.070212:0:94412:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:1.0:1783952268.070218:0:94412:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 22 00000100:00000040:1.0:1783952268.070244:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff97b1447b1180 x1870605465646464/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.070251:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff97b1447b1180 x1870605465646464/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.070259:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b1180 x1870605465646464/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.070265:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1447b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465646464:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1783952268.070284:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b1447b1180 x1870605465646464/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1783952268.070292:0:6514:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:1.0:1783952268.070303:0:6514:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1783952268.070317:0:6514:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.202.148@tcp has 192.168.202.148@tcp. 10000000:00000040:1.0:1783952268.070332:0:6514:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:1.0:1783952268.070336:0:6514:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff97b143af6800 already not connected (conn 6, was 0): DISCONN 00000100:00000040:1.0:1783952268.070346:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:1.0:1783952268.070349:0:6514:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:1.0:1783952268.070351:0:6514:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.148@tcp -> ffff97b142e66080 00010000:00080000:1.0:1783952268.070354:0:6514:0:(ldlm_lib.c:85:import_set_conn()) imp ffff97b143af6800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.202.148@tcp, moved to head 00010000:00000040:1.0:1783952268.070357:0:6514:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 61 to 0@lo 00000100:00080000:1.0:1783952268.070367:0:6514:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:1.0:1783952268.070371:0:6514:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 60 to 0@lo 00000100:00000040:1.0:1783952268.070373:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 61 to 0@lo 00000020:00000040:1.0:1783952268.070375:0:6514:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5ffc 00000020:00000040:1.0:1783952268.070378:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04e288800 refcount=4 00000100:00000040:1.0:1783952268.070380:0:6514:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 60 to 0@lo 00000100:00000040:1.0:1783952268.070382:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 61 to 0@lo 00000020:00000040:1.0:1783952268.070384:0:6514:0:(genops.c:900:class_export_put()) PUTting export ffff97b04e288800 : new refcount 3 00000100:00080000:1.0:1783952268.070387:0:6514:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97b143af6800 using connection 192.168.202.148@tcp/0@lo 00000020:00000040:1.0:1783952268.070398:0:6514:0:(genops.c:1231:class_import_get()) import ffff97b143af6800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1783952268.070409:0:6514:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b177316d80 x1870605465646592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952268.070419:0:6514:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000983123ae] to pc [ptlrpcd_rcv+-1] req@ffff97b177316d80 x1870605465646592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1783952268.070435:0:6514:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1783952268.070441:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b1447b1180 x1870605465646464/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952268.070448:0:6514:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952268.070450:0:6514:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 10000000:01000000:1.0:1783952268.070467:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:1.0:1783952268.070471:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b17499ca00 refcount=3 00010000:00010000:1.0:1783952268.070476:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b17499ca00/0x22c73c7857bb6f8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f92 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952268.070484:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b17499ca00/0x22c73c7857bb6f8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6f92 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:1.0:1783952268.070492:0:6514:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff97b14776a400) refs 2 10000000:00000040:1.0:1783952268.070495:0:6514:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff97b1741b8800) refs 3 10000000:01000000:1.0:1783952268.070502:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783952268.070505:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97b151231000 from 128 10000000:01000000:1.0:1783952268.070507:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:1.0:1783952268.070511:0:6514:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00010000:00000040:1.0:1783952268.070522:0:6514:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b176696500 count: 2 00000020:00000040:1.0:1783952268.070527:0:6514:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b17499da00 with handle 0x22c73c7857bb6f99 to hash 00010000:00010000:1.0:1783952268.070532:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b17499da00/0x22c73c7857bb6f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952268.070539:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.148@tcp lock: ffff97b17499da00/0x22c73c7857bb6f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952268.070548:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.148@tcp lock: ffff97b17499da00/0x22c73c7857bb6f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783952268.070561:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177316a00 x1870605465646720/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.070569:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465646720:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1783952268.070616:0:6514:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177316a00 x1870605465646720/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.070622:0:6514:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952268.070638:0:6514:0:(events.c:337:request_in_callback()) incoming req@ffff97b16588d050 x1870605465646720 msgsize 328 00000100:00100000:1.0:1783952268.070642:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952268.070643:0:6514:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783952268.070653:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b177316a00 x1870605465646720/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.070663:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf840 going to sleep for 11 seconds 00000100:00000040:1.0:1783952268.070675:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177316d80 x1870605465646592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.070683:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465646592:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1783952268.070703:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177316d80 x1870605465646592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.070710:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952268.070725:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b177317800 x1870605465646592 msgsize 520 00000100:00100000:1.0:1783952268.070729:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952268.070741:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177316d80 x1870605465646592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.070750:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8822 usecs (9 jiffies) 00000100:00100000:1.0:1783952268.070773:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465646592 00000100:00100000:1.0:1783952268.070777:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465646592 00000020:00000040:1.0:1783952268.070779:0:26196:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6011 00000100:00100000:1.0:1783952268.070799:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5047 00000100:00000040:1.0:1783952268.070804:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177317800 x1870605465646592/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952288 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.070812:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3641:x1870605465646592:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:1.0:1783952268.070826:0:26196:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 8 - find 00010000:00000040:1.0:1783952268.070833:0:26196:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1783952268.070840:0:26196:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff97b0410d9000, cookie 0x22c73c7857bb6f29 00010000:00080000:1.0:1783952268.070844:0:26196:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff97b0410d9000 cur 3983 last 1783952266 00000001:00000040:1.0:1783952268.070854:0:26196:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.202.148@tcp 00000001:00000040:1.0:1783952268.070858:0:26196:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff97b164e4f800) : new refcount 20 00000020:00000040:1.0:1783952268.070861:0:26196:0:(genops.c:889:class_export_get()) GET export ffff97b0410d9000 refcount=4 00000001:00000040:1.0:1783952268.070863:0:26196:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff97b164e4f800) : new refcount 21 00000001:00000040:1.0:1783952268.070866:0:26196:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff97b164e4f800) : new refcount 20 00002000:00100000:1.0:1783952268.070869:0:26196:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97b0410d9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783952268.070873:0:26196:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783952268.070875:0:26196:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:1.0:1783952268.070888:0:26196:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff97b174a98a80 for nid 0@lo - ref 2 00000020:00000040:1.0:1783952268.070974:0:26196:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 9 - import 00000020:00000040:1.0:1783952268.070980:0:26196:0:(genops.c:1244:class_import_put()) import ffff97b174b33800 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1783952268.070985:0:26196:0:(genops.c:889:class_export_get()) GET export ffff97b0410d9000 refcount=5 00000100:00000040:1.0:1783952268.070987:0:26196:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff97b0410d9000 : new rpc_count 1 00000100:00000040:1.0:1783952268.070991:0:26196:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:1.0:1783952268.070993:0:26196:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 62 to 0@lo 00000020:00000040:1.0:1783952268.070995:0:26196:0:(genops.c:889:class_export_get()) GET export ffff97b0410d9000 refcount=6 00000100:00000040:1.0:1783952268.071001:0:26196:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 63 to 0@lo 00000100:00080000:1.0:1783952268.071008:0:26196:0:(import.c:65:import_set_state_nolock()) ffff97b174b33800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1783952268.071013:0:26196:0:(genops.c:900:class_export_put()) PUTting export ffff97b0410d9000 : new refcount 5 00000020:00000040:1.0:1783952268.071015:0:26196:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff97b167c919c0) now 9 - find 00010000:00000040:1.0:1783952268.071025:0:26196:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968974, transno 0, xid 1870605465646592 00000100:00000040:1.0:1783952268.071031:0:26196:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 64 to 0@lo 00000100:00000040:1.0:1783952268.071034:0:26196:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952268.071050:0:26196:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff97b177316d80 x1870605465646592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.071066:0:26196:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 63 to 0@lo 00000100:00000040:1.0:1783952268.071070:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177317800 x1870605465646592/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783952288 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.071077:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465646592:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 265us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952268.071083:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5047 00000100:00000040:1.0:1783952268.071086:0:26196:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0410d9000 : new rpc_count 0 00000020:00000040:1.0:1783952268.071091:0:26196:0:(genops.c:900:class_export_put()) PUTting export ffff97b0410d9000 : new refcount 4 00010000:00080000:1.0:1783952268.071112:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b177316d80 x1870605465646592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783952293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.071119:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968974 00000100:00000040:1.0:1783952268.071123:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177316d80 x1870605465646592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783952293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952268.071138:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:1.0:1783952268.071140:0:3641:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5ffc 00000020:00000040:1.0:1783952268.071142:0:3641:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04e288800 refcount=4 00000020:00000040:1.0:1783952268.071147:0:3641:0:(genops.c:900:class_export_put()) PUTting export ffff97b04e288800 : new refcount 3 00000100:00080000:1.0:1783952268.071151:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1783952268.071154:0:3641:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1783952268.071156:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968974 gen 2 00000100:00000040:1.0:1783952268.071159:0:3641:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:1.0:1783952268.071161:0:3641:0:(recover.c:53:ptlrpc_replay_next()) import ffff97b143af6800 from lustre-OST0000_UUID committed 4294968974 last 0 00000100:00080000:1.0:1783952268.071164:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:1.0:1783952268.071166:0:3641:0:(genops.c:1231:class_import_get()) import ffff97b143af6800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1783952268.071258:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177316d80 x1870605465646592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783952293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.071266:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465646592:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1783952268.071271:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177316d80 x1870605465646592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783952293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952268.071278:0:3641:0:(genops.c:1244:class_import_put()) import ffff97b143af6800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:1.0:1783952268.071292:0:97083:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:1.0:1783952268.071296:0:97083:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:1.0:1783952268.071301:0:97083:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:1.0:1783952268.071338:0:97083:0:(import.c:65:import_set_state_nolock()) ffff97b143af6800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:1.0:1783952268.071343:0:97083:0:(genops.c:1231:class_import_get()) import ffff97b143af6800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1783952268.071355:0:97083:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000983123ae] to pc [ptlrpcd_rcv+-1] req@ffff97b177316d80 x1870605465646848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952268.071379:0:97083:0:(genops.c:1244:class_import_put()) import ffff97b143af6800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1783952268.071389:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177316d80 x1870605465646848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.071396:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1870605465646848:0@lo:400:ldlm_lock_repla.0 00000100:00000040:1.0:1783952268.071410:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff97b177316d80 x1870605465646848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952284 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.071416:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952268.071430:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b177314e00 x1870605465646848 msgsize 224 00000100:00100000:1.0:1783952268.071434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952268.071444:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177316d80 x1870605465646848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952284 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.071453:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8573 usecs (9 jiffies) 00000100:00100000:2.0:1783952268.071674:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465646720 00000100:00100000:2.0:1783952268.071679:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465646720 00000020:00000040:2.0:1783952268.071681:0:94410:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952268.071684:0:94410:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=23 00000100:00000040:2.0:1783952268.071700:0:94410:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952268.071722:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00000040:2.0:1783952268.071726:0:94410:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952268.071730:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16588d050 x1870605465646720/t0(0) o101->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952268.071740:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+23:6514:x1870605465646720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783952268.071751:0:94410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1783952268.071759:0:94410:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff97b041093d00 count: 3 00000020:00000040:2.0:1783952268.071773:0:94410:0:(lustre_handles.c:93:class_handle_hash()) added object ffff97b1414a3200 with handle 0x22c73c7857bb6fa0 to hash 00010000:00010000:2.0:1783952268.071778:0:94410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97b1414a3200/0x22c73c7857bb6fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22c73c7857bb6f99 expref: -99 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952268.071785:0:94410:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff97b1445c4000 : new locks_count 18 00000020:00000040:2.0:1783952268.071787:0:94410:0:(genops.c:889:class_export_get()) GET export ffff97b1445c4000 refcount=24 00010000:00000040:2.0:1783952268.071803:0:94410:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff97b041093d00) refcount = 3 00010000:00000040:2.0:1783952268.071806:0:94410:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1783952268.071810:0:94410:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b176d22a00/0x22c73c7857bb6f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6f8b expref: 24 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783952268.071820:0:94410:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff97b176d23600/0x22c73c7857bb6f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x1a98f3bf84a6a86a expref: 9 pid: 94411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952268.071827:0:94410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97b1414a3200/0x22c73c7857bb6fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22c73c7857bb6f99 expref: 24 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952268.071838:0:94410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97b1414a3200/0x22c73c7857bb6fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22c73c7857bb6f99 expref: 24 pid: 94410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783952268.071845:0:94410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97b1414a3200, rc 0) 00010000:00000040:2.0:1783952268.071848:0:94410:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465646720 00000100:00000040:2.0:1783952268.071854:0:94410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 64 to 0@lo 00000100:00000040:2.0:1783952268.071858:0:94410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952268.071878:0:94410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff97b177316a00 x1870605465646720/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952268.071895:0:94410:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 63 to 0@lo 00000100:00000040:2.0:1783952268.071899:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16588d050 x1870605465646720/t0(0) o101->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:529/0 lens 328/344 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952268.071907:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465646720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952268.071919:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00000040:2.0:1783952268.071922:0:94410:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952268.071931:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00100000:2.0:1783952268.071956:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465646848 00000100:00100000:2.0:1783952268.071960:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465646848 00000020:00000040:2.0:1783952268.071962:0:8494:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f29 00000020:00000040:2.0:1783952268.071965:0:8494:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0410d9000 refcount=5 00000100:00000040:2.0:1783952268.071977:0:8494:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1783952268.071995:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936 00000100:00000040:2.0:1783952268.071997:0:8494:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0410d9000 : new rpc_count 1 00000100:00000040:2.0:1783952268.072002:0:8494:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177314e00 x1870605465646848/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:529/0 lens 224/0 e 0 to 0 dl 1783952279 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952268.072013:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465646848:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1783952268.072021:0:8494:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177314e00 x1870605465646848/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:529/0 lens 224/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783952268.072030:0:8494:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0410d9000 : new rpc_count 2 00010000:00080000:2.0:1783952268.072034:0:8494:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b177314e00 x1870605465646848/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:529/0 lens 224/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952268.072049:0:8494:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177314e00 x1870605465646848/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:529/0 lens 224/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952268.072057:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870605465646848:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 46us (625us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.072063:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936 00000100:00000040:2.0:1783952268.072065:0:8494:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0410d9000 : new rpc_count 1 00010000:00080000:2.0:1783952268.072084:0:97001:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:1.0:1783952268.072168:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b177316a00 x1870605465646720/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.072178:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177316a00 x1870605465646720/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.072185:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465646720:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1783952268.072192:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177316a00 x1870605465646720/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952268.072205:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b17499da00 refcount=4 00010000:00000040:1.0:1783952268.072209:0:6514:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff97b17499da00, remote cookie: 0x22c73c7857bb6fa0, flags: 0x0 00010000:00000040:1.0:1783952268.072214:0:6514:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff97b176696500) refcount = 2 00010000:00000040:1.0:1783952268.072216:0:6514:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1783952268.072219:0:6514:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.148@tcp lock: ffff97b17499ca00/0x22c73c7857bb6f8b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6f92 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952268.072235:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.148@tcp lock: ffff97b17499da00/0x22c73c7857bb6f99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6fa0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783952268.072243:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.148@tcp lock: ffff97b17499da00/0x22c73c7857bb6f99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22c73c7857bb6fa0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783952268.072252:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177316a00 x1870605465646720/t0(0) o101->MGC192.168.202.148@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783952284 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952268.072261:0:6514:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 10000000:00000040:1.0:1783952268.072268:0:6514:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff97b14776a400) refs 3 00000020:00000040:1.0:1783952268.072407:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b17499da00 refcount=3 00000020:00000040:1.0:1783952268.072427:0:6514:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:1.0:1783952268.072441:0:6514:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=5 obd=MGC192.168.202.148@tcp 00000100:00000040:1.0:1783952268.072453:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b177316a00 x1870605465646976/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.072462:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b177316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465646976:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1783952268.072480:0:6514:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b177316a00 x1870605465646976/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.072487:0:6514:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952268.072505:0:6514:0:(events.c:337:request_in_callback()) incoming req@ffff97b16588ec50 x1870605465646976 msgsize 304 00000100:00100000:1.0:1783952268.072509:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952268.072511:0:6514:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783952268.072568:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff97b177316a00 x1870605465646976/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.072623:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff97b049cdf840 going to sleep for 11 seconds 00000100:00100000:2.0:1783952268.078455:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465646976 00000100:00100000:2.0:1783952268.078486:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465646976 00000020:00000040:2.0:1783952268.078489:0:94410:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:2.0:1783952268.078495:0:94410:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=24 00000100:00000040:2.0:1783952268.078524:0:94410:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783952268.078560:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00000040:2.0:1783952268.078565:0:94410:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:2.0:1783952268.078572:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16588ec50 x1870605465646976/t0(0) o256->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:529/0 lens 304/0 e 0 to 0 dl 1783952279 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952268.078612:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465646976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783952268.078637:0:94410:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:2.0:1783952268.078650:0:94410:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1783952268.078656:0:94410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783952268.078659:0:94410:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:2.0:1783952268.078669:0:94410:0:(genops.c:889:class_export_get()) GET export ffff97b1445c4000 refcount=25 00000020:00000040:2.0:1783952268.078762:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 24 00010000:00000040:2.0:1783952268.078778:0:94410:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465646976 00000100:00000040:2.0:1783952268.078789:0:94410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 64 to 0@lo 00000100:00000040:2.0:1783952268.078794:0:94410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952268.078813:0:94410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff97b177316a00 x1870605465646976/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952268.078826:0:94410:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 63 to 0@lo 00000100:00000040:2.0:1783952268.078831:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16588ec50 x1870605465646976/t0(0) o256->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:529/0 lens 304/240 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952268.078839:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:6514:x1870605465646976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 230us (6331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952268.078847:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00000040:2.0:1783952268.078850:0:94410:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:2.0:1783952268.078858:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00000040:0.0:1783952268.079035:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff97b177316a00 x1870605465646976/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952268.079053:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff97b177316a00 x1870605465646976/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952268.079061:0:6514:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177316a00 x1870605465646976/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952268.079068:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b177316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:6514:1870605465646976:0@lo:256:ll_cfg_requeue.0 00000100:00000040:0.0:1783952268.079077:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b177316a00 x1870605465646976/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:0.0:1783952268.079095:0:6514:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:0.0:1783952268.079108:0:6514:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1783952268.079119:0:6514:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.202.148@tcp has 192.168.202.148@tcp. 10000000:00000040:0.0:1783952268.079134:0:6514:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:0.0:1783952268.079138:0:6514:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff97b15f80e000 already not connected (conn 6, was 0): DISCONN 00000100:00000040:0.0:1783952268.079148:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 64 to 0@lo 00000100:00000040:0.0:1783952268.079151:0:6514:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 64 to 0@lo 00000100:00000040:0.0:1783952268.079154:0:6514:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.148@tcp -> ffff97b142e66080 00010000:00080000:0.0:1783952268.079157:0:6514:0:(ldlm_lib.c:85:import_set_conn()) imp ffff97b15f80e000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.202.148@tcp, moved to head 00010000:00000040:0.0:1783952268.079160:0:6514:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 63 to 0@lo 00000100:00080000:0.0:1783952268.079165:0:6514:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:0.0:1783952268.079169:0:6514:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:0.0:1783952268.079171:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 63 to 0@lo 00000020:00000040:0.0:1783952268.079173:0:6514:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe49 00000020:00000040:0.0:1783952268.079176:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b14f00b000 refcount=4 00000100:00000040:0.0:1783952268.079179:0:6514:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 62 to 0@lo 00000100:00000040:0.0:1783952268.079181:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 63 to 0@lo 00000020:00000040:0.0:1783952268.079183:0:6514:0:(genops.c:900:class_export_put()) PUTting export ffff97b14f00b000 : new refcount 3 00000100:00080000:0.0:1783952268.079186:0:6514:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff97b15f80e000 using connection 192.168.202.148@tcp/0@lo 00000020:00000040:0.0:1783952268.079199:0:6514:0:(genops.c:1231:class_import_get()) import ffff97b15f80e000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1783952268.079216:0:6514:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97b049d75f80 x1870605465647104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783952268.079230:0:6514:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006d7aa292] to pc [ptlrpcd_rcv+-1] req@ffff97b049d75f80 x1870605465647104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:0.0:1783952268.079252:0:6514:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1783952268.079260:0:6514:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b177316a00 x1870605465646976/t0(0) o256->MGC192.168.202.148@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783952284 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952268.079290:0:6514:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000020:00000040:0.0:1783952268.079293:0:6514:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 10000000:01000000:0.0:1783952268.079311:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:0.0:1783952268.079316:0:6514:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff97b17499da00 refcount=3 00010000:00010000:0.0:1783952268.079321:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.148@tcp lock: ffff97b17499da00/0x22c73c7857bb6f99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6fa0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783952268.079330:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.148@tcp lock: ffff97b17499da00/0x22c73c7857bb6f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22c73c7857bb6fa0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:0.0:1783952268.079340:0:6514:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff97b14776a400) refs 3 00000100:00000040:1.0:1783952268.079435:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049d75f80 x1870605465647104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.079459:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465647104:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1783952268.079479:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049d75f80 x1870605465647104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.079486:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952268.079505:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b177314700 x1870605465647104 msgsize 520 00000100:00100000:1.0:1783952268.079509:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952268.079528:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049d75f80 x1870605465647104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.079539:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5591 usecs (6 jiffies) 00000100:00100000:0.0:1783952268.079874:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465647104 00000100:00100000:0.0:1783952268.079880:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465647104 00000020:00000040:0.0:1783952268.079882:0:26203:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe50 00000100:00100000:0.0:1783952268.079917:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5048 00000100:00000040:0.0:1783952268.079923:0:26203:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177314700 x1870605465647104/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783952288 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952268.079932:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3641:x1870605465647104:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:0.0:1783952268.079946:0:26203:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 9 - find 00010000:00000040:0.0:1783952268.079955:0:26203:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1783952268.079961:0:26203:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff97b1514bf800, cookie 0x22c73c7857bb6f22 00010000:00080000:0.0:1783952268.079966:0:26203:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff97b1514bf800 cur 3983 last 1783952266 00000001:00000040:0.0:1783952268.079978:0:26203:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.202.148@tcp 00000001:00000040:0.0:1783952268.079982:0:26203:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff97b164e4f800) : new refcount 21 00000020:00000040:0.0:1783952268.079985:0:26203:0:(genops.c:889:class_export_get()) GET export ffff97b1514bf800 refcount=4 00000001:00000040:0.0:1783952268.079987:0:26203:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff97b164e4f800) : new refcount 22 00000001:00000040:0.0:1783952268.079991:0:26203:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff97b164e4f800) : new refcount 21 00002000:00100000:0.0:1783952268.080001:0:26203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff97b1514bf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1783952268.080005:0:26203:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1783952268.080007:0:26203:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:0.0:1783952268.080015:0:26203:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff97b174a98a80 for nid 0@lo - ref 3 00000020:00000040:0.0:1783952268.080024:0:26203:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 10 - import 00000020:00000040:0.0:1783952268.080029:0:26203:0:(genops.c:1244:class_import_put()) import ffff97b046a97000 refcount=1 obd=lustre-OST0000 00000020:00000040:0.0:1783952268.080036:0:26203:0:(genops.c:889:class_export_get()) GET export ffff97b1514bf800 refcount=5 00000100:00000040:0.0:1783952268.080038:0:26203:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff97b1514bf800 : new rpc_count 1 00000100:00000040:0.0:1783952268.080042:0:26203:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 64 to 0@lo 00000100:00000040:0.0:1783952268.080044:0:26203:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff97b142e66080 refcount 64 to 0@lo 00000020:00000040:0.0:1783952268.080046:0:26203:0:(genops.c:889:class_export_get()) GET export ffff97b1514bf800 refcount=6 00000100:00000040:0.0:1783952268.080058:0:26203:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00080000:0.0:1783952268.080065:0:26203:0:(import.c:65:import_set_state_nolock()) ffff97b046a97000 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1783952268.080083:0:26203:0:(genops.c:900:class_export_put()) PUTting export ffff97b1514bf800 : new refcount 5 00000020:00000040:0.0:1783952268.080086:0:26203:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff97b167c919c0) now 10 - find 00010000:00000040:0.0:1783952268.080096:0:26203:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968956, transno 0, xid 1870605465647104 00000100:00000040:0.0:1783952268.080102:0:26203:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:0.0:1783952268.080106:0:26203:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952268.080126:0:26203:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff97b049d75f80 x1870605465647104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783952293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952268.080143:0:26203:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:0.0:1783952268.080149:0:26203:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177314700 x1870605465647104/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783952288 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952268.080157:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3641:x1870605465647104:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 225us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952268.080163:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5048 00000100:00000040:0.0:1783952268.080167:0:26203:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1514bf800 : new rpc_count 0 00000020:00000040:0.0:1783952268.080173:0:26203:0:(genops.c:900:class_export_put()) PUTting export ffff97b1514bf800 : new refcount 4 00010000:00080000:1.0:1783952268.080224:0:97001:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:1.0:1783952268.080229:0:97001:0:(ldlm_lib.c:2874:target_recovery_thread()) 1: request replay stage - 2 clients from t4294968979 00010000:00080000:1.0:1783952268.080231:0:97001:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 4294968979 00010000:00080000:1.0:1783952268.080236:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 4294968979, next_transno: 4294968979 00010000:00080000:1.0:1783952268.080239:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968979) 00010000:00080000:1.0:1783952268.080248:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447818880 t4294968979 from 192.168.202.48@tcp req@ffff97b14deb8a80 x1870605447818880/t0(4294968979) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:528/0 lens 440/0 e 0 to 0 dl 1783952278 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.080264:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14deb8a80 x1870605447818880/t0(4294968979) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:528/0 lens 440/0 e 0 to 0 dl 1783952278 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783952268.080298:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x782:0x0] 00000001:00000040:1.0:1783952268.080971:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 1 00000020:00000040:1.0:1783952268.080975:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=6 00010000:00000040:1.0:1783952268.081027:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968979, xid 1870605447818880 00000100:00000040:1.0:1783952268.081037:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.081042:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.081090:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.081106:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.081119:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.081127:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 5 00010000:00080000:1.0:1783952268.081131:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294968980 00010000:00080000:1.0:1783952268.081134:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294968980 00010000:00080000:1.0:1783952268.081174:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97b049d75f80 x1870605465647104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783952293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.081183:0:3641:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968956 00000100:00000040:1.0:1783952268.081188:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049d75f80 x1870605465647104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783952293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952268.081199:0:3641:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:1.0:1783952268.081201:0:3641:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe49 00000020:00000040:1.0:1783952268.081204:0:3641:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b14f00b000 refcount=4 00000020:00000040:1.0:1783952268.081212:0:3641:0:(genops.c:900:class_export_put()) PUTting export ffff97b14f00b000 : new refcount 3 00000100:00080000:1.0:1783952268.081217:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1783952268.081221:0:3641:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1783952268.081223:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968956 gen 2 00000100:00000040:1.0:1783952268.081226:0:3641:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:1.0:1783952268.081229:0:3641:0:(recover.c:53:ptlrpc_replay_next()) import ffff97b15f80e000 from lustre-OST0000_UUID committed 4294968956 last 0 00000100:00080000:1.0:1783952268.081233:0:3641:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:1.0:1783952268.081236:0:3641:0:(genops.c:1231:class_import_get()) import ffff97b15f80e000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1783952268.090377:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b177315500 x1870605447820416 msgsize 440 00000100:00100000:1.0:1783952268.090393:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:1.0:1783952268.090713:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d75f80 x1870605465647104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783952293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.090724:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465647104:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1783952268.090733:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049d75f80 x1870605465647104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783952293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952268.090751:0:3641:0:(genops.c:1244:class_import_put()) import ffff97b15f80e000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1783952268.091001:0:25554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447820416 00000100:00100000:3.0:1783952268.091011:0:25554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447820416 00000020:00000040:3.0:1783952268.091014:0:25554:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.091019:0:25554:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=6 00000100:00000040:3.0:1783952268.091681:0:25554:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.091741:0:25554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1049 00000100:00000040:3.0:1783952268.091746:0:25554:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.091757:0:25554:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177315500 x1870605447820416/t0(4294968980) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.091773:0:25554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447820416:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:3.0:1783952268.091785:0:25554:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177315500 x1870605447820416/t0(4294968980) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.091793:0:25554:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968980, current: 4294968980, replaying 00010000:00000040:3.0:1783952268.091797:0:25554:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.091806:0:25554:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177315500 x1870605447820416/t0(4294968980) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.091815:0:25554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+6:2397:x1870605447820416:12345-192.168.202.48@tcp:10:dd.0 Request processed in 46us (1439us total) trans 0 rc 0/-999 00010000:00080000:1.0:1783952268.092204:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 4294968980, next_transno: 4294968980 00010000:00080000:1.0:1783952268.092209:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968980) 00010000:00080000:1.0:1783952268.092219:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447820416 t4294968980 from 192.168.202.48@tcp req@ffff97b177315500 x1870605447820416/t0(4294968980) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.092235:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177315500 x1870605447820416/t0(4294968980) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783952268.092267:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x783:0x0] 00000001:00000040:1.0:1783952268.092434:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 2 00000020:00000040:1.0:1783952268.092438:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=7 00010000:00000040:1.0:1783952268.092470:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968980, xid 1870605447820416 00000100:00000040:1.0:1783952268.092480:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.092487:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.092532:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.092541:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.092546:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:1.0:1783952268.092550:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294968981 00010000:00080000:1.0:1783952268.092553:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294968981 00000100:00100000:3.0:1783952268.101054:0:25554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1049 00000100:00000040:3.0:1783952268.101063:0:25554:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.101078:0:25554:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 6 00010000:00080000:3.0:1783952268.101232:0:97084:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1783952268.101237:0:97084:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:3.0:1783952268.101243:0:97084:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:3.0:1783952268.101283:0:97084:0:(import.c:65:import_set_state_nolock()) ffff97b15f80e000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:3.0:1783952268.101292:0:97084:0:(genops.c:1231:class_import_get()) import ffff97b15f80e000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1783952268.101317:0:97084:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004e45596e] to pc [ptlrpcd_rcv+-1] req@ffff97b14deba300 x1870605465647232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783952268.101352:0:97084:0:(genops.c:1244:class_import_put()) import ffff97b15f80e000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1783952268.101520:0:3641:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14deba300 x1870605465647232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952268.101536:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1870605465647232:0@lo:400:ldlm_lock_repla.0 00000100:00000040:0.0:1783952268.101564:0:3641:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff97b14deba300 x1870605465647232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952284 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952268.101573:0:3641:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952268.101636:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d77100 x1870605465647232 msgsize 224 00000100:00100000:0.0:1783952268.101640:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952268.101660:0:3641:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14deba300 x1870605465647232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952284 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952268.101673:0:3641:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5582 usecs (6 jiffies) 00000100:00100000:3.0:1783952268.103165:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465647232 00000100:00100000:3.0:1783952268.103178:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465647232 00000020:00000040:3.0:1783952268.103181:0:26197:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f22 00000020:00000040:3.0:1783952268.103185:0:26197:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1514bf800 refcount=5 00000100:00100000:3.0:1783952268.103251:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937 00000100:00000040:3.0:1783952268.103256:0:26197:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1514bf800 : new rpc_count 1 00000100:00000040:3.0:1783952268.103264:0:26197:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d77100 x1870605465647232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:529/0 lens 224/0 e 0 to 0 dl 1783952279 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952268.103276:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3641:x1870605465647232:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:3.0:1783952268.103291:0:26197:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049d77100 x1870605465647232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:529/0 lens 224/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783952268.103299:0:26197:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b1514bf800 : new rpc_count 2 00010000:00080000:3.0:1783952268.103303:0:26197:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff97b049d77100 x1870605465647232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:529/0 lens 224/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952268.103334:0:26197:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d77100 x1870605465647232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:529/0 lens 224/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952268.103343:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3641:x1870605465647232:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 69us (1706us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.103350:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937 00000100:00000040:3.0:1783952268.103353:0:26197:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1514bf800 : new rpc_count 1 00010000:00080000:3.0:1783952268.103379:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968981 00000100:00000040:0.0:1783952268.119458:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d77800 x1870605447820544 msgsize 440 00000100:00100000:0.0:1783952268.119476:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.119606:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447820544 00000100:00100000:3.0:1783952268.119617:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447820544 00000020:00000040:3.0:1783952268.119621:0:24878:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.119627:0:24878:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=7 00000100:00000040:3.0:1783952268.119656:0:24878:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.119718:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1050 00000100:00000040:3.0:1783952268.119723:0:24878:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.119731:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d77800 x1870605447820544/t0(4294968981) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.119745:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2397:x1870605447820544:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:3.0:1783952268.119758:0:24878:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049d77800 x1870605447820544/t0(4294968981) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.119767:0:24878:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968981, current: 4294968981, replaying 00010000:00000040:3.0:1783952268.119771:0:24878:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.119787:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d77800 x1870605447820544/t0(4294968981) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.119795:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2397:x1870605447820544:12345-192.168.202.48@tcp:10:dd.0 Request processed in 52us (338us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.119817:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1050 00000100:00000040:3.0:1783952268.119821:0:24878:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.119840:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968981, next_transno: 4294968981 00010000:00080000:3.0:1783952268.119844:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968981) 00010000:00080000:3.0:1783952268.119851:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447820544 t4294968981 from 192.168.202.48@tcp req@ffff97b049d77800 x1870605447820544/t0(4294968981) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.119867:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049d77800 x1870605447820544/t0(4294968981) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783952268.119898:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x787:0x0] 00000001:00000040:3.0:1783952268.120086:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 3 00000020:00000040:3.0:1783952268.120089:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=8 00010000:00000040:3.0:1783952268.120128:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968981, xid 1870605447820544 00000100:00000040:3.0:1783952268.120138:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.120144:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.120638:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.120650:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.120656:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.125510:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 7 00010000:00080000:3.0:1783952268.125532:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968982 00010000:00080000:3.0:1783952268.125538:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968982 00000100:00000040:1.0:1783952268.125770:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b177315c00 x1870605447821184 msgsize 440 00000100:00100000:1.0:1783952268.125782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.125818:0:24877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447821184 00000100:00100000:1.0:1783952268.125829:0:24877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447821184 00000020:00000040:1.0:1783952268.125833:0:24877:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.125837:0:24877:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=8 00000100:00000040:1.0:1783952268.125862:0:24877:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783952268.125909:0:24877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1051 00000100:00000040:1.0:1783952268.125914:0:24877:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:1.0:1783952268.125933:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177315c00 x1870605447821184/t0(4294968982) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.125948:0:24877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2397:x1870605447821184:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:1.0:1783952268.125962:0:24877:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177315c00 x1870605447821184/t0(4294968982) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783952268.125970:0:24877:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968982, current: 4294968982, replaying 00010000:00000040:1.0:1783952268.125973:0:24877:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:1.0:1783952268.125982:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177315c00 x1870605447821184/t0(4294968982) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.125990:0:24877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+8:2397:x1870605447821184:12345-192.168.202.48@tcp:10:dd.0 Request processed in 45us (220us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.125997:0:24877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1051 00000100:00000040:1.0:1783952268.126000:0:24877:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.126111:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968982, next_transno: 4294968982 00010000:00080000:3.0:1783952268.126115:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968982) 00010000:00080000:3.0:1783952268.126122:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447821184 t4294968982 from 192.168.202.48@tcp req@ffff97b177315c00 x1870605447821184/t0(4294968982) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.126139:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177315c00 x1870605447821184/t0(4294968982) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783952268.126180:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x784:0x0] 00000001:00000040:3.0:1783952268.126369:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 4 00000020:00000040:3.0:1783952268.126372:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=9 00010000:00000040:3.0:1783952268.126411:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968982, xid 1870605447821184 00000100:00000040:3.0:1783952268.126421:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.126427:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.126488:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.126497:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.126503:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.126514:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 8 00010000:00080000:3.0:1783952268.126517:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968983 00010000:00080000:3.0:1783952268.126521:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968983 00000100:00000040:1.0:1783952268.133655:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b177316680 x1870605447822848 msgsize 440 00000100:00100000:1.0:1783952268.133684:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.134186:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447822848 00000100:00100000:3.0:1783952268.134196:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447822848 00000020:00000040:3.0:1783952268.134199:0:25538:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.134204:0:25538:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=9 00000100:00000040:3.0:1783952268.134229:0:25538:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.134290:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1052 00000100:00000040:3.0:1783952268.134295:0:25538:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.134301:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177316680 x1870605447822848/t0(4294968983) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.134315:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2397:x1870605447822848:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:3.0:1783952268.134327:0:25538:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177316680 x1870605447822848/t0(4294968983) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.134336:0:25538:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968983, current: 4294968983, replaying 00010000:00000040:3.0:1783952268.134340:0:25538:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.134367:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177316680 x1870605447822848/t0(4294968983) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.134376:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+9:2397:x1870605447822848:12345-192.168.202.48@tcp:10:dd.0 Request processed in 63us (722us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.134383:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1052 00000100:00000040:3.0:1783952268.134387:0:25538:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.134402:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968983, next_transno: 4294968983 00010000:00080000:3.0:1783952268.134406:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968983) 00010000:00080000:3.0:1783952268.134413:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447822848 t4294968983 from 192.168.202.48@tcp req@ffff97b177316680 x1870605447822848/t0(4294968983) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.134428:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177316680 x1870605447822848/t0(4294968983) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783952268.134459:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x785:0x0] 00000001:00000040:3.0:1783952268.134661:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 5 00000020:00000040:3.0:1783952268.134665:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=10 00010000:00000040:3.0:1783952268.134878:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968983, xid 1870605447822848 00000100:00000040:3.0:1783952268.134890:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.134896:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.135296:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.135308:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.135314:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.135326:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 9 00010000:00080000:3.0:1783952268.135330:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968984 00010000:00080000:3.0:1783952268.135334:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968984 00000100:00000040:1.0:1783952268.152006:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b177314000 x1870605447824256 msgsize 440 00000100:00100000:1.0:1783952268.152027:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952268.155646:0:24881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447824256 00000100:00100000:2.0:1783952268.155665:0:24881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447824256 00000020:00000040:2.0:1783952268.155669:0:24881:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:2.0:1783952268.155727:0:24881:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=10 00000100:00000040:2.0:1783952268.155757:0:24881:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783952268.155814:0:24881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1053 00000100:00000040:2.0:1783952268.155819:0:24881:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:2.0:1783952268.155827:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177314000 x1870605447824256/t0(4294968984) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.155841:0:24881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2397:x1870605447824256:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:2.0:1783952268.155853:0:24881:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177314000 x1870605447824256/t0(4294968984) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783952268.155863:0:24881:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968984, current: 4294968984, replaying 00010000:00000040:2.0:1783952268.155867:0:24881:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:2.0:1783952268.155880:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177314000 x1870605447824256/t0(4294968984) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.155890:0:24881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+10:2397:x1870605447824256:12345-192.168.202.48@tcp:10:dd.0 Request processed in 52us (3884us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.155897:0:24881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1053 00000100:00000040:2.0:1783952268.155900:0:24881:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.156216:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968984, next_transno: 4294968984 00010000:00080000:3.0:1783952268.156221:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968984) 00010000:00080000:3.0:1783952268.156237:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447824256 t4294968984 from 192.168.202.48@tcp req@ffff97b177314000 x1870605447824256/t0(4294968984) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.156255:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177314000 x1870605447824256/t0(4294968984) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783952268.156789:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x786:0x0] 00000001:00000040:3.0:1783952268.156962:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 6 00000020:00000040:3.0:1783952268.156966:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=11 00010000:00000040:3.0:1783952268.156999:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968984, xid 1870605447824256 00000100:00000040:3.0:1783952268.157010:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.157016:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.158856:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.158877:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.158939:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.158952:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 10 00010000:00080000:2.0:1783952268.158957:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968985 00010000:00080000:2.0:1783952268.158962:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968985 00000100:00000040:2.0:1783952268.173971:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b1447b1180 x1870605447825152 msgsize 440 00000100:00100000:2.0:1783952268.173988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.174137:0:24880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447825152 00000100:00100000:3.0:1783952268.174148:0:24880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447825152 00000020:00000040:3.0:1783952268.174151:0:24880:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.174157:0:24880:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=11 00000100:00000040:3.0:1783952268.174189:0:24880:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.174293:0:24880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1054 00000100:00000040:3.0:1783952268.174298:0:24880:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.174306:0:24880:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1447b1180 x1870605447825152/t0(4294968985) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.174321:0:24880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447825152:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:3.0:1783952268.174334:0:24880:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b1447b1180 x1870605447825152/t0(4294968985) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.174344:0:24880:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968985, current: 4294968985, replaying 00010000:00000040:3.0:1783952268.174347:0:24880:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.174364:0:24880:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b1180 x1870605447825152/t0(4294968985) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.174382:0:24880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447825152:12345-192.168.202.48@tcp:10:dd.0 Request processed in 64us (411us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.174389:0:24880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1054 00000100:00000040:3.0:1783952268.174392:0:24880:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.174430:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968985, next_transno: 4294968985 00010000:00080000:2.0:1783952268.174440:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968985) 00010000:00080000:2.0:1783952268.174450:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447825152 t4294968985 from 192.168.202.48@tcp req@ffff97b1447b1180 x1870605447825152/t0(4294968985) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.174467:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b1447b1180 x1870605447825152/t0(4294968985) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783952268.174499:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x788:0x0] 00000001:00000040:2.0:1783952268.174858:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 7 00000020:00000040:2.0:1783952268.174862:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=12 00010000:00000040:2.0:1783952268.174911:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968985, xid 1870605447825152 00000100:00000040:2.0:1783952268.174922:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952268.174929:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952268.174981:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:2.0:1783952268.174991:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.174997:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.175009:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 11 00010000:00080000:2.0:1783952268.175014:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968986 00010000:00080000:2.0:1783952268.175018:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968986 00000100:00000040:2.0:1783952268.188726:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b1447b1c00 x1870605447827200 msgsize 440 00000100:00100000:2.0:1783952268.188742:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952268.191628:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447827200 00000100:00100000:0.0:1783952268.191647:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447827200 00000020:00000040:0.0:1783952268.191652:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:0.0:1783952268.191659:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=12 00000100:00000040:0.0:1783952268.191701:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783952268.191762:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1055 00000100:00000040:0.0:1783952268.191766:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:0.0:1783952268.191774:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1447b1c00 x1870605447827200/t0(4294968986) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952268.191789:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:2397:x1870605447827200:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:0.0:1783952268.191801:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b1447b1c00 x1870605447827200/t0(4294968986) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783952268.191809:0:8441:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968986, current: 4294968986, replaying 00010000:00000040:0.0:1783952268.191814:0:8441:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:0.0:1783952268.191838:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b1c00 x1870605447827200/t0(4294968986) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952268.191848:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+12:2397:x1870605447827200:12345-192.168.202.48@tcp:10:dd.0 Request processed in 61us (3122us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783952268.191855:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1055 00000100:00000040:0.0:1783952268.191860:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:0.0:1783952268.191879:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968986, next_transno: 4294968986 00010000:00080000:0.0:1783952268.191883:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968986) 00010000:00080000:0.0:1783952268.191890:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447827200 t4294968986 from 192.168.202.48@tcp req@ffff97b1447b1c00 x1870605447827200/t0(4294968986) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783952268.191906:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b1447b1c00 x1870605447827200/t0(4294968986) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783952268.191936:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x789:0x0] 00000001:00000040:0.0:1783952268.192112:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 8 00000020:00000040:0.0:1783952268.192115:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=13 00010000:00000040:0.0:1783952268.192151:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968986, xid 1870605447827200 00000100:00000040:0.0:1783952268.192160:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952268.192165:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952268.192211:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:0.0:1783952268.192219:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783952268.192224:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:0.0:1783952268.192231:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 12 00010000:00080000:0.0:1783952268.192235:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968987 00010000:00080000:0.0:1783952268.192238:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968987 00000100:00000040:1.0:1783952268.196264:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b177317b80 x1870605447828224 msgsize 440 00000100:00100000:1.0:1783952268.196289:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.198495:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447828224 00000100:00100000:3.0:1783952268.198510:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447828224 00000020:00000040:3.0:1783952268.198513:0:24878:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.198518:0:24878:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=13 00000100:00000040:3.0:1783952268.198544:0:24878:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.198625:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1056 00000100:00000040:3.0:1783952268.198630:0:24878:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.198639:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177317b80 x1870605447828224/t0(4294968987) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.198655:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:2397:x1870605447828224:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:3.0:1783952268.198668:0:24878:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177317b80 x1870605447828224/t0(4294968987) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.198690:0:24878:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968987, current: 4294968987, replaying 00010000:00000040:3.0:1783952268.198693:0:24878:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.198710:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177317b80 x1870605447828224/t0(4294968987) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.198719:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+13:2397:x1870605447828224:12345-192.168.202.48@tcp:10:dd.0 Request processed in 69us (2455us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.198726:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1056 00000100:00000040:3.0:1783952268.198729:0:24878:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.198868:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968987, next_transno: 4294968987 00010000:00080000:2.0:1783952268.198873:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968987) 00010000:00080000:2.0:1783952268.198882:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447828224 t4294968987 from 192.168.202.48@tcp req@ffff97b177317b80 x1870605447828224/t0(4294968987) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.198897:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177317b80 x1870605447828224/t0(4294968987) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783952268.198928:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78b:0x0] 00000001:00000040:2.0:1783952268.199112:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 9 00000020:00000040:2.0:1783952268.199116:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=14 00010000:00000040:2.0:1783952268.199151:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968987, xid 1870605447828224 00000100:00000040:2.0:1783952268.199162:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952268.199168:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952268.199226:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:2.0:1783952268.199235:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.199239:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.199248:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 13 00010000:00080000:2.0:1783952268.199252:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968988 00010000:00080000:2.0:1783952268.199255:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968988 00000100:00000040:3.0:1783952268.211313:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b14debb800 x1870605447828608 msgsize 440 00000100:00100000:3.0:1783952268.211338:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.213484:0:24877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447828608 00000100:00100000:1.0:1783952268.213498:0:24877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447828608 00000020:00000040:1.0:1783952268.213502:0:24877:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.213508:0:24877:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=14 00000100:00000040:1.0:1783952268.213537:0:24877:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783952268.213624:0:24877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1057 00000100:00000040:1.0:1783952268.213628:0:24877:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:1.0:1783952268.213636:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14debb800 x1870605447828608/t0(4294968988) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.213665:0:24877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14debb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:2397:x1870605447828608:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:1.0:1783952268.213688:0:24877:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14debb800 x1870605447828608/t0(4294968988) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783952268.213697:0:24877:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968988, current: 4294968988, replaying 00010000:00000040:1.0:1783952268.213701:0:24877:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:1.0:1783952268.213714:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14debb800 x1870605447828608/t0(4294968988) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.213723:0:24877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14debb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+14:2397:x1870605447828608:12345-192.168.202.48@tcp:10:dd.0 Request processed in 62us (2411us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.213730:0:24877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1057 00000100:00000040:1.0:1783952268.213734:0:24877:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.213921:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968988, next_transno: 4294968988 00010000:00080000:2.0:1783952268.213925:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968988) 00010000:00080000:2.0:1783952268.213935:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447828608 t4294968988 from 192.168.202.48@tcp req@ffff97b14debb800 x1870605447828608/t0(4294968988) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.213950:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14debb800 x1870605447828608/t0(4294968988) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783952268.213988:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78a:0x0] 00000001:00000040:2.0:1783952268.214176:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 10 00000020:00000040:2.0:1783952268.214180:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=15 00010000:00000040:2.0:1783952268.214214:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968988, xid 1870605447828608 00000100:00000040:2.0:1783952268.214225:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952268.214231:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952268.214308:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:2.0:1783952268.214317:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.214323:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.214331:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 14 00010000:00080000:2.0:1783952268.214336:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968989 00010000:00080000:2.0:1783952268.214347:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968989 00000100:00000040:2.0:1783952268.219169:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b1447b2a00 x1870605447830144 msgsize 440 00000100:00100000:2.0:1783952268.219183:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.219262:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447830144 00000100:00100000:1.0:1783952268.219284:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447830144 00000020:00000040:1.0:1783952268.219287:0:25538:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.219292:0:25538:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=15 00000100:00000040:1.0:1783952268.219319:0:25538:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783952268.219368:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1058 00000100:00000040:1.0:1783952268.219373:0:25538:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:1.0:1783952268.219381:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b1447b2a00 x1870605447830144/t0(4294968989) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.219395:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1447b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:2397:x1870605447830144:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:1.0:1783952268.219407:0:25538:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b1447b2a00 x1870605447830144/t0(4294968989) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783952268.219417:0:25538:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968989, current: 4294968989, replaying 00010000:00000040:1.0:1783952268.219431:0:25538:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:1.0:1783952268.219451:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b1447b2a00 x1870605447830144/t0(4294968989) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.219460:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1447b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+15:2397:x1870605447830144:12345-192.168.202.48@tcp:10:dd.0 Request processed in 69us (292us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.219467:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1058 00000100:00000040:1.0:1783952268.219470:0:25538:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.219621:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968989, next_transno: 4294968989 00010000:00080000:2.0:1783952268.219626:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968989) 00010000:00080000:2.0:1783952268.219635:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447830144 t4294968989 from 192.168.202.48@tcp req@ffff97b1447b2a00 x1870605447830144/t0(4294968989) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.219652:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b1447b2a00 x1870605447830144/t0(4294968989) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783952268.219691:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78c:0x0] 00000001:00000040:2.0:1783952268.219905:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 11 00000020:00000040:2.0:1783952268.219909:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=16 00010000:00000040:2.0:1783952268.219952:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968989, xid 1870605447830144 00000100:00000040:2.0:1783952268.219963:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952268.219970:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952268.220022:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:2.0:1783952268.220031:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.220037:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.220062:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 15 00010000:00080000:2.0:1783952268.220067:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968990 00010000:00080000:2.0:1783952268.220071:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968990 00000100:00000040:3.0:1783952268.226216:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b166fb2a00 x1870605447831552 msgsize 440 00000100:00100000:3.0:1783952268.226233:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952268.227312:0:24881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447831552 00000100:00100000:2.0:1783952268.227323:0:24881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447831552 00000020:00000040:2.0:1783952268.227326:0:24881:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:2.0:1783952268.227332:0:24881:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=16 00000100:00000040:2.0:1783952268.227359:0:24881:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783952268.227410:0:24881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1059 00000100:00000040:2.0:1783952268.227424:0:24881:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:2.0:1783952268.227440:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b166fb2a00 x1870605447831552/t0(4294968990) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.227453:0:24881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:2397:x1870605447831552:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:2.0:1783952268.227464:0:24881:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b166fb2a00 x1870605447831552/t0(4294968990) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783952268.227472:0:24881:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968990, current: 4294968990, replaying 00010000:00000040:2.0:1783952268.227475:0:24881:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:2.0:1783952268.227486:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b166fb2a00 x1870605447831552/t0(4294968990) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.227495:0:24881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b166fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+16:2397:x1870605447831552:12345-192.168.202.48@tcp:10:dd.0 Request processed in 44us (1279us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.227502:0:24881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1059 00000100:00000040:2.0:1783952268.227505:0:24881:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.227521:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968990, next_transno: 4294968990 00010000:00080000:2.0:1783952268.227525:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968990) 00010000:00080000:2.0:1783952268.227531:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447831552 t4294968990 from 192.168.202.48@tcp req@ffff97b166fb2a00 x1870605447831552/t0(4294968990) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.227545:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b166fb2a00 x1870605447831552/t0(4294968990) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783952268.227569:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78d:0x0] 00000001:00000040:2.0:1783952268.228124:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 12 00000020:00000040:2.0:1783952268.228129:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=17 00010000:00000040:2.0:1783952268.228161:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968990, xid 1870605447831552 00000100:00000040:2.0:1783952268.228171:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952268.228177:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952268.228231:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:2.0:1783952268.228241:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.228247:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.228256:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 16 00010000:00080000:2.0:1783952268.228261:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968991 00010000:00080000:2.0:1783952268.228264:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968991 00000100:00000040:0.0:1783952268.233880:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d76680 x1870605447832704 msgsize 440 00000100:00100000:0.0:1783952268.233898:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.234020:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447832704 00000100:00100000:3.0:1783952268.234032:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447832704 00000020:00000040:3.0:1783952268.234036:0:24883:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.234051:0:24883:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=17 00000100:00000040:3.0:1783952268.234075:0:24883:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.234122:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1060 00000100:00000040:3.0:1783952268.234127:0:24883:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.234134:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d76680 x1870605447832704/t0(4294968991) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.234146:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:2397:x1870605447832704:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:3.0:1783952268.234158:0:24883:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049d76680 x1870605447832704/t0(4294968991) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.234166:0:24883:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968991, current: 4294968991, replaying 00010000:00000040:3.0:1783952268.234170:0:24883:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.234187:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d76680 x1870605447832704/t0(4294968991) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.234196:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+17:2397:x1870605447832704:12345-192.168.202.48@tcp:10:dd.0 Request processed in 52us (316us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.234202:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1060 00000100:00000040:3.0:1783952268.234205:0:24883:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.234423:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968991, next_transno: 4294968991 00010000:00080000:2.0:1783952268.234428:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968991) 00010000:00080000:2.0:1783952268.234436:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447832704 t4294968991 from 192.168.202.48@tcp req@ffff97b049d76680 x1870605447832704/t0(4294968991) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.234452:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049d76680 x1870605447832704/t0(4294968991) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783952268.234481:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78e:0x0] 00000001:00000040:2.0:1783952268.235865:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 13 00000020:00000040:2.0:1783952268.235872:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=18 00010000:00000040:2.0:1783952268.235915:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968991, xid 1870605447832704 00000100:00000040:2.0:1783952268.235929:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952268.235936:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952268.235986:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:2.0:1783952268.235997:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.236006:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.236015:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 17 00010000:00080000:2.0:1783952268.236022:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968992 00010000:00080000:2.0:1783952268.236026:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968992 00000100:00000040:2.0:1783952268.239530:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de1c000 x1870605447834624 msgsize 440 00000100:00100000:2.0:1783952268.239544:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.239657:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447834624 00000100:00100000:3.0:1783952268.239666:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447834624 00000020:00000040:3.0:1783952268.239678:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.239683:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=18 00000100:00000040:3.0:1783952268.239718:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.239770:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1061 00000100:00000040:3.0:1783952268.239774:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.239782:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de1c000 x1870605447834624/t0(4294968992) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.239796:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+18:2397:x1870605447834624:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:3.0:1783952268.239808:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de1c000 x1870605447834624/t0(4294968992) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.239817:0:8441:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968992, current: 4294968992, replaying 00010000:00000040:3.0:1783952268.239820:0:8441:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.239831:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de1c000 x1870605447834624/t0(4294968992) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.239839:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+18:2397:x1870605447834624:12345-192.168.202.48@tcp:10:dd.0 Request processed in 46us (310us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.239845:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1061 00000100:00000040:3.0:1783952268.239848:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:1.0:1783952268.239949:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968992, next_transno: 4294968992 00010000:00080000:1.0:1783952268.239954:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968992) 00010000:00080000:1.0:1783952268.239962:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447834624 t4294968992 from 192.168.202.48@tcp req@ffff97b14de1c000 x1870605447834624/t0(4294968992) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.239977:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de1c000 x1870605447834624/t0(4294968992) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783952268.240004:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x790:0x0] 00000001:00000040:1.0:1783952268.240166:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 14 00000020:00000040:1.0:1783952268.240170:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=19 00010000:00000040:1.0:1783952268.240201:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968992, xid 1870605447834624 00000100:00000040:1.0:1783952268.240211:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.240217:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.240266:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.240282:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.240286:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.240294:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 18 00010000:00080000:1.0:1783952268.240297:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968993 00010000:00080000:1.0:1783952268.240301:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968993 00000100:00000040:0.0:1783952268.247947:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b049d75f80 x1870605447834752 msgsize 440 00000100:00100000:0.0:1783952268.247977:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.248099:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447834752 00000100:00100000:3.0:1783952268.248110:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447834752 00000020:00000040:3.0:1783952268.248114:0:24878:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.248119:0:24878:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=19 00000100:00000040:3.0:1783952268.248145:0:24878:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.248195:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1062 00000100:00000040:3.0:1783952268.248199:0:24878:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.248207:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049d75f80 x1870605447834752/t0(4294968993) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.248221:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:2397:x1870605447834752:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:3.0:1783952268.248241:0:24878:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049d75f80 x1870605447834752/t0(4294968993) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.248250:0:24878:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968993, current: 4294968993, replaying 00010000:00000040:3.0:1783952268.248253:0:24878:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.248266:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049d75f80 x1870605447834752/t0(4294968993) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.248287:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+19:2397:x1870605447834752:12345-192.168.202.48@tcp:10:dd.0 Request processed in 68us (340us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.248295:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1062 00000100:00000040:3.0:1783952268.248297:0:24878:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.248313:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968993, next_transno: 4294968993 00010000:00080000:3.0:1783952268.248317:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968993) 00010000:00080000:3.0:1783952268.248324:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447834752 t4294968993 from 192.168.202.48@tcp req@ffff97b049d75f80 x1870605447834752/t0(4294968993) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.248339:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049d75f80 x1870605447834752/t0(4294968993) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783952268.248366:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x78f:0x0] 00000001:00000040:3.0:1783952268.248533:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 15 00000020:00000040:3.0:1783952268.248538:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=20 00010000:00000040:3.0:1783952268.248566:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968993, xid 1870605447834752 00000100:00000040:3.0:1783952268.248613:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.248619:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.248663:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.248848:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.248855:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.248864:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 19 00010000:00080000:3.0:1783952268.248874:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968994 00010000:00080000:3.0:1783952268.248877:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968994 00000100:00000040:0.0:1783952268.254196:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b16dd7aa00 x1870605447835392 msgsize 440 00000100:00100000:0.0:1783952268.254211:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.256619:0:24877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447835392 00000100:00100000:1.0:1783952268.256642:0:24877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447835392 00000020:00000040:1.0:1783952268.256646:0:24877:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.256651:0:24877:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=20 00000100:00000040:2.0:1783952268.256839:0:24877:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783952268.256892:0:24877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1063 00000100:00000040:2.0:1783952268.256897:0:24877:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:2.0:1783952268.256906:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16dd7aa00 x1870605447835392/t0(4294968994) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.256922:0:24877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+20:2397:x1870605447835392:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:2.0:1783952268.256936:0:24877:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b16dd7aa00 x1870605447835392/t0(4294968994) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783952268.256945:0:24877:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968994, current: 4294968994, replaying 00010000:00000040:2.0:1783952268.256949:0:24877:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:2.0:1783952268.256959:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16dd7aa00 x1870605447835392/t0(4294968994) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.256967:0:24877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+20:2397:x1870605447835392:12345-192.168.202.48@tcp:10:dd.0 Request processed in 49us (2773us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.256973:0:24877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1063 00000100:00000040:2.0:1783952268.256976:0:24877:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.257032:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968994, next_transno: 4294968994 00010000:00080000:3.0:1783952268.257036:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968994) 00010000:00080000:3.0:1783952268.257045:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447835392 t4294968994 from 192.168.202.48@tcp req@ffff97b16dd7aa00 x1870605447835392/t0(4294968994) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.257061:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b16dd7aa00 x1870605447835392/t0(4294968994) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783952268.257090:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x791:0x0] 00000001:00000040:3.0:1783952268.257261:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 16 00000020:00000040:3.0:1783952268.257265:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=21 00010000:00000040:3.0:1783952268.257315:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968994, xid 1870605447835392 00000100:00000040:3.0:1783952268.257324:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.257330:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.257388:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.257397:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.257402:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.257411:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 20 00010000:00080000:3.0:1783952268.257415:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968995 00010000:00080000:3.0:1783952268.257419:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968995 00000100:00000040:2.0:1783952268.260069:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de1fb80 x1870605447837184 msgsize 440 00000100:00100000:2.0:1783952268.260083:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.260148:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447837184 00000100:00100000:1.0:1783952268.260158:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447837184 00000020:00000040:1.0:1783952268.260161:0:25538:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.260166:0:25538:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=21 00000100:00000040:1.0:1783952268.260194:0:25538:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783952268.260251:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1064 00000100:00000040:1.0:1783952268.260255:0:25538:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:1.0:1783952268.260264:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de1fb80 x1870605447837184/t0(4294968995) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.260287:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+21:2397:x1870605447837184:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:1.0:1783952268.260300:0:25538:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de1fb80 x1870605447837184/t0(4294968995) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783952268.260309:0:25538:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968995, current: 4294968995, replaying 00010000:00000040:1.0:1783952268.260312:0:25538:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:1.0:1783952268.260332:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de1fb80 x1870605447837184/t0(4294968995) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.260341:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+21:2397:x1870605447837184:12345-192.168.202.48@tcp:10:dd.0 Request processed in 66us (273us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.260348:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1064 00000100:00000040:1.0:1783952268.260350:0:25538:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.260441:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968995, next_transno: 4294968995 00010000:00080000:2.0:1783952268.260445:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968995) 00010000:00080000:2.0:1783952268.260452:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447837184 t4294968995 from 192.168.202.48@tcp req@ffff97b14de1fb80 x1870605447837184/t0(4294968995) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.260470:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de1fb80 x1870605447837184/t0(4294968995) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783952268.260499:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x792:0x0] 00000001:00000040:2.0:1783952268.261661:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 17 00000020:00000040:2.0:1783952268.261735:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=22 00010000:00000040:2.0:1783952268.261776:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968995, xid 1870605447837184 00000100:00000040:2.0:1783952268.261787:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952268.261793:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952268.261843:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:2.0:1783952268.261854:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.261861:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.261870:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 21 00010000:00080000:2.0:1783952268.261875:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968996 00010000:00080000:2.0:1783952268.261880:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968996 00000100:00000040:2.0:1783952268.266091:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de1f480 x1870605447837568 msgsize 440 00000100:00100000:2.0:1783952268.266107:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.266176:0:24881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447837568 00000100:00100000:1.0:1783952268.266187:0:24881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447837568 00000020:00000040:1.0:1783952268.266190:0:24881:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.266195:0:24881:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=22 00000100:00000040:1.0:1783952268.266224:0:24881:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783952268.266300:0:24881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1065 00000100:00000040:1.0:1783952268.266304:0:24881:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:1.0:1783952268.266313:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de1f480 x1870605447837568/t0(4294968996) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.266327:0:24881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:2397:x1870605447837568:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:1.0:1783952268.266339:0:24881:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de1f480 x1870605447837568/t0(4294968996) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783952268.266347:0:24881:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968996, current: 4294968996, replaying 00010000:00000040:1.0:1783952268.266351:0:24881:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:1.0:1783952268.266370:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de1f480 x1870605447837568/t0(4294968996) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.266378:0:24881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+22:2397:x1870605447837568:12345-192.168.202.48@tcp:10:dd.0 Request processed in 55us (289us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.266384:0:24881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1065 00000100:00000040:1.0:1783952268.266387:0:24881:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.266433:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968996, next_transno: 4294968996 00010000:00080000:3.0:1783952268.266437:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968996) 00010000:00080000:3.0:1783952268.266446:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447837568 t4294968996 from 192.168.202.48@tcp req@ffff97b14de1f480 x1870605447837568/t0(4294968996) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.266462:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de1f480 x1870605447837568/t0(4294968996) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783952268.266502:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x793:0x0] 00000001:00000040:3.0:1783952268.266712:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 18 00000020:00000040:3.0:1783952268.266717:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=23 00010000:00000040:3.0:1783952268.266750:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968996, xid 1870605447837568 00000100:00000040:3.0:1783952268.266760:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.266765:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.266811:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.266820:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.266825:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.266834:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 22 00010000:00080000:3.0:1783952268.266837:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968997 00010000:00080000:3.0:1783952268.266841:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968997 00000100:00000040:1.0:1783952268.280303:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b177316a00 x1870605447838976 msgsize 440 00000100:00100000:1.0:1783952268.280319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.280411:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447838976 00000100:00100000:3.0:1783952268.280421:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447838976 00000020:00000040:3.0:1783952268.280424:0:24883:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.280429:0:24883:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=23 00000100:00000040:3.0:1783952268.280457:0:24883:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.280503:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1066 00000100:00000040:3.0:1783952268.280507:0:24883:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.280514:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b177316a00 x1870605447838976/t0(4294968997) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.280528:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:2397:x1870605447838976:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:3.0:1783952268.280542:0:24883:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177316a00 x1870605447838976/t0(4294968997) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.280551:0:24883:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968997, current: 4294968997, replaying 00010000:00000040:3.0:1783952268.280554:0:24883:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.280627:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b177316a00 x1870605447838976/t0(4294968997) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.280636:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+23:2397:x1870605447838976:12345-192.168.202.48@tcp:10:dd.0 Request processed in 111us (334us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.280643:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1066 00000100:00000040:3.0:1783952268.280646:0:24883:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:1.0:1783952268.280709:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968997, next_transno: 4294968997 00010000:00080000:1.0:1783952268.280714:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968997) 00010000:00080000:1.0:1783952268.280722:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447838976 t4294968997 from 192.168.202.48@tcp req@ffff97b177316a00 x1870605447838976/t0(4294968997) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.280738:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b177316a00 x1870605447838976/t0(4294968997) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783952268.280768:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x794:0x0] 00000001:00000040:1.0:1783952268.280951:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 19 00000020:00000040:1.0:1783952268.280962:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=24 00010000:00000040:1.0:1783952268.280997:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968997, xid 1870605447838976 00000100:00000040:1.0:1783952268.281006:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.281012:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.281062:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.281070:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.281075:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.281083:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 23 00010000:00080000:1.0:1783952268.281087:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968998 00010000:00080000:1.0:1783952268.281091:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968998 40000000:00000040:2.0:1783952268.285857:0:97101:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00000100:00000040:1.0:1783952268.298534:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e5bb80 x1870605447839488 msgsize 440 00000100:00100000:1.0:1783952268.298550:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952268.302218:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447839488 00000100:00100000:2.0:1783952268.302238:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447839488 00000020:00000040:2.0:1783952268.302242:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:2.0:1783952268.302247:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=24 00000100:00000040:2.0:1783952268.302297:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783952268.302354:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1067 00000100:00000040:2.0:1783952268.302360:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:2.0:1783952268.302368:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e5bb80 x1870605447839488/t0(4294968998) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.302383:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+24:2397:x1870605447839488:12345-192.168.202.48@tcp:10:dd.0 00000020:00000040:2.0:1783952268.302396:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e5bb80 x1870605447839488/t0(4294968998) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783952268.302405:0:8441:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968998, current: 4294968998, replaying 00010000:00000040:2.0:1783952268.302409:0:8441:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:2.0:1783952268.302419:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e5bb80 x1870605447839488/t0(4294968998) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.302443:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+24:2397:x1870605447839488:12345-192.168.202.48@tcp:10:dd.0 Request processed in 61us (3908us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.302450:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1067 00000100:00000040:2.0:1783952268.302453:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:1.0:1783952268.303073:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968998, next_transno: 4294968998 00010000:00080000:1.0:1783952268.303078:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968998) 00010000:00080000:1.0:1783952268.303089:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447839488 t4294968998 from 192.168.202.48@tcp req@ffff97b049e5bb80 x1870605447839488/t0(4294968998) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.303109:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e5bb80 x1870605447839488/t0(4294968998) o10->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 440/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783952268.303143:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x795:0x0] 00000001:00000040:1.0:1783952268.303470:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 20 00000020:00000040:1.0:1783952268.303476:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=25 00010000:00000040:1.0:1783952268.303512:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968998, xid 1870605447839488 00000100:00000040:1.0:1783952268.303521:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.303528:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.303627:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.303635:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.303641:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.303651:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 24 00010000:00080000:1.0:1783952268.303666:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968999 00010000:00080000:1.0:1783952268.303670:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968999 00000100:00000040:2.0:1783952268.312439:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de1dc00 x1870605447839872 msgsize 1512 00000100:00100000:2.0:1783952268.312455:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.312536:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447839872 00000100:00100000:1.0:1783952268.312546:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447839872 00000020:00000040:1.0:1783952268.312550:0:24878:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.312554:0:24878:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=25 00000100:00000040:1.0:1783952268.312608:0:24878:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783952268.312653:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1068 00000100:00000040:1.0:1783952268.312657:0:24878:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:1.0:1783952268.312664:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de1dc00 x1870605447839872/t0(4294968999) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.312693:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2397:x1870605447839872:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:1.0:1783952268.312705:0:24878:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de1dc00 x1870605447839872/t0(4294968999) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783952268.312713:0:24878:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968999, current: 4294968999, replaying 00010000:00000040:1.0:1783952268.312716:0:24878:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:1.0:1783952268.312728:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de1dc00 x1870605447839872/t0(4294968999) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.312736:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+25:2397:x1870605447839872:12345-192.168.202.48@tcp:4:dd.0 Request processed in 46us (297us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.312743:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1068 00000100:00000040:1.0:1783952268.312745:0:24878:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:1.0:1783952268.312760:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968999, next_transno: 4294968999 00010000:00080000:1.0:1783952268.312763:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968999) 00010000:00080000:1.0:1783952268.312770:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447839872 t4294968999 from 192.168.202.48@tcp req@ffff97b14de1dc00 x1870605447839872/t0(4294968999) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.312797:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de1dc00 x1870605447839872/t0(4294968999) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783952268.312835:0:97001:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:1.0:1783952268.312943:0:97001:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:1.0:1783952268.313005:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783952268.313033:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:1.0:1783952268.313036:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783952268.313293:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 21 00000020:00000040:1.0:1783952268.313297:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=26 00010000:00000040:1.0:1783952268.314108:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294968999, xid 1870605447839872 00000100:00000040:1.0:1783952268.314123:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.314132:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.314412:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.314423:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.314431:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.314442:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 25 00010000:00080000:1.0:1783952268.314447:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969000 00010000:00080000:1.0:1783952268.314451:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969000 00000100:00000040:1.0:1783952268.325966:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e58e00 x1870605447840128 msgsize 1512 00000100:00100000:1.0:1783952268.325982:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952268.326847:0:24877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840128 00000100:00100000:2.0:1783952268.326859:0:24877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840128 00000020:00000040:2.0:1783952268.326862:0:24877:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:2.0:1783952268.326867:0:24877:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=26 00000100:00000040:2.0:1783952268.326894:0:24877:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783952268.326946:0:24877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1069 00000100:00000040:2.0:1783952268.326951:0:24877:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:2.0:1783952268.326959:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e58e00 x1870605447840128/t0(4294969000) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.326973:0:24877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+26:2397:x1870605447840128:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:2.0:1783952268.326985:0:24877:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e58e00 x1870605447840128/t0(4294969000) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783952268.326993:0:24877:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969000, current: 4294969000, replaying 00010000:00000040:2.0:1783952268.326996:0:24877:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:2.0:1783952268.327009:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e58e00 x1870605447840128/t0(4294969000) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.327017:0:24877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+26:2397:x1870605447840128:12345-192.168.202.48@tcp:4:dd.0 Request processed in 48us (1052us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.327024:0:24877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1069 00000100:00000040:2.0:1783952268.327034:0:24877:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.327055:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969000, next_transno: 4294969000 00010000:00080000:2.0:1783952268.327058:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969000) 00010000:00080000:2.0:1783952268.327066:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447840128 t4294969000 from 192.168.202.48@tcp req@ffff97b049e58e00 x1870605447840128/t0(4294969000) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.327081:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e58e00 x1870605447840128/t0(4294969000) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.327177:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783952268.327204:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:2.0:1783952268.327207:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783952268.327432:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 22 00000020:00000040:2.0:1783952268.327436:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=27 00010000:00000040:1.0:1783952268.331132:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969000, xid 1870605447840128 00000100:00000040:1.0:1783952268.331166:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.331176:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.331237:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.331252:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.331261:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.331276:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 26 00010000:00080000:1.0:1783952268.331297:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969001 00010000:00080000:1.0:1783952268.331302:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969001 00000100:00000040:3.0:1783952268.351971:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de29880 x1870605447840384 msgsize 1512 00000100:00100000:3.0:1783952268.351987:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.352024:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840384 00000100:00100000:3.0:1783952268.352032:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840384 00000020:00000040:3.0:1783952268.352035:0:25538:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.352039:0:25538:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=27 00000100:00000040:3.0:1783952268.352063:0:25538:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.352106:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1070 00000100:00000040:3.0:1783952268.352110:0:25538:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.352119:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de29880 x1870605447840384/t0(4294969001) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.352131:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2397:x1870605447840384:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:3.0:1783952268.352143:0:25538:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de29880 x1870605447840384/t0(4294969001) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.352150:0:25538:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969001, current: 4294969001, replaying 00010000:00000040:3.0:1783952268.352154:0:25538:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.352165:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de29880 x1870605447840384/t0(4294969001) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.352173:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+27:2397:x1870605447840384:12345-192.168.202.48@tcp:4:dd.0 Request processed in 44us (202us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.352190:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1070 00000100:00000040:3.0:1783952268.352193:0:25538:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.352211:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969001, next_transno: 4294969001 00010000:00080000:3.0:1783952268.352215:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969001) 00010000:00080000:3.0:1783952268.352223:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447840384 t4294969001 from 192.168.202.48@tcp req@ffff97b14de29880 x1870605447840384/t0(4294969001) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.352238:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de29880 x1870605447840384/t0(4294969001) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.352341:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783952268.352370:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:3.0:1783952268.352373:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783952268.352767:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 23 00000020:00000040:3.0:1783952268.352771:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=28 00010000:00000040:3.0:1783952268.358323:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969001, xid 1870605447840384 00000100:00000040:3.0:1783952268.358345:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.358355:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.358410:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.358425:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.358434:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.358446:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 27 00010000:00080000:3.0:1783952268.358453:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969002 00010000:00080000:3.0:1783952268.358457:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969002 00000100:00000040:2.0:1783952268.371472:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de1df80 x1870605447840640 msgsize 1512 00000100:00100000:2.0:1783952268.371490:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.371581:0:24881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840640 00000100:00100000:1.0:1783952268.371634:0:24881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840640 00000020:00000040:1.0:1783952268.371638:0:24881:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.371644:0:24881:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=28 00000100:00000040:1.0:1783952268.371673:0:24881:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783952268.371735:0:24881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1071 00000100:00000040:1.0:1783952268.371740:0:24881:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:1.0:1783952268.371749:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de1df80 x1870605447840640/t0(4294969002) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.371770:0:24881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+28:2397:x1870605447840640:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:1.0:1783952268.371786:0:24881:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de1df80 x1870605447840640/t0(4294969002) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783952268.371795:0:24881:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969002, current: 4294969002, replaying 00010000:00000040:1.0:1783952268.371799:0:24881:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:1.0:1783952268.371810:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de1df80 x1870605447840640/t0(4294969002) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.371821:0:24881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d33551be-a709-4ba2-a74c-f4d7b53c6817+28:2397:x1870605447840640:12345-192.168.202.48@tcp:4:dd.0 Request processed in 56us (347us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.371833:0:24881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1071 00000100:00000040:1.0:1783952268.371838:0:24881:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.371844:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969002, next_transno: 4294969002 00010000:00080000:3.0:1783952268.371855:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969002) 00010000:00080000:3.0:1783952268.371872:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447840640 t4294969002 from 192.168.202.48@tcp req@ffff97b14de1df80 x1870605447840640/t0(4294969002) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.371924:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de1df80 x1870605447840640/t0(4294969002) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.372064:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783952268.372102:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:3.0:1783952268.372107:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783952268.372452:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 24 00000020:00000040:3.0:1783952268.372458:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=29 00010000:00000040:3.0:1783952268.373231:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969002, xid 1870605447840640 00000100:00000040:3.0:1783952268.373249:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.373258:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.373347:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.373364:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.373377:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.373393:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 28 00010000:00080000:3.0:1783952268.373400:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969003 00010000:00080000:3.0:1783952268.373405:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969003 00000100:00000040:1.0:1783952268.379443:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e58000 x1870605447840896 msgsize 1512 00000100:00100000:1.0:1783952268.379459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952268.379525:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447840896 00000100:00100000:2.0:1783952268.379535:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447840896 00000020:00000040:2.0:1783952268.379538:0:24883:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:2.0:1783952268.379542:0:24883:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=29 00000100:00000040:2.0:1783952268.379565:0:24883:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783952268.379662:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1072 00000100:00000040:2.0:1783952268.379667:0:24883:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:2.0:1783952268.379677:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e58000 x1870605447840896/t0(4294969003) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.379703:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2397:x1870605447840896:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:2.0:1783952268.379716:0:24883:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e58000 x1870605447840896/t0(4294969003) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783952268.379726:0:24883:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969003, current: 4294969003, replaying 00010000:00000040:2.0:1783952268.379741:0:24883:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:2.0:1783952268.379760:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e58000 x1870605447840896/t0(4294969003) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.379770:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+29:2397:x1870605447840896:12345-192.168.202.48@tcp:4:dd.0 Request processed in 70us (327us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.379780:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1072 00000100:00000040:2.0:1783952268.379785:0:24883:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.379818:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969003, next_transno: 4294969003 00010000:00080000:3.0:1783952268.379828:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969003) 00010000:00080000:3.0:1783952268.379846:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447840896 t4294969003 from 192.168.202.48@tcp req@ffff97b049e58000 x1870605447840896/t0(4294969003) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.379871:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e58000 x1870605447840896/t0(4294969003) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.380015:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783952268.380058:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:3.0:1783952268.380063:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783952268.380444:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 25 00000020:00000040:3.0:1783952268.380457:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=30 00010000:00000040:0.0:1783952268.383384:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969003, xid 1870605447840896 00000100:00000040:0.0:1783952268.383405:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952268.383413:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952268.383470:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:0.0:1783952268.383482:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783952268.383490:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:0.0:1783952268.383502:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 29 00010000:00080000:0.0:1783952268.383507:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969004 00010000:00080000:0.0:1783952268.383511:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969004 00000100:00000040:1.0:1783952268.393649:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e5a680 x1870605447841152 msgsize 1512 00000100:00100000:1.0:1783952268.393667:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.398839:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841152 00000100:00100000:3.0:1783952268.398864:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841152 00000020:00000040:3.0:1783952268.398868:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.398876:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=30 00000100:00000040:3.0:1783952268.398920:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.398993:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1073 00000100:00000040:3.0:1783952268.398999:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.399012:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e5a680 x1870605447841152/t0(4294969004) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.399029:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+30:2397:x1870605447841152:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:3.0:1783952268.399043:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e5a680 x1870605447841152/t0(4294969004) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.399054:0:8441:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969004, current: 4294969004, replaying 00010000:00000040:3.0:1783952268.399057:0:8441:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.399083:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e5a680 x1870605447841152/t0(4294969004) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.399092:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+30:2397:x1870605447841152:12345-192.168.202.48@tcp:4:dd.0 Request processed in 67us (5443us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.399100:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1073 00000100:00000040:3.0:1783952268.399104:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:1.0:1783952268.399139:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969004, next_transno: 4294969004 00010000:00080000:1.0:1783952268.399158:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969004) 00010000:00080000:1.0:1783952268.399176:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447841152 t4294969004 from 192.168.202.48@tcp req@ffff97b049e5a680 x1870605447841152/t0(4294969004) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.399200:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e5a680 x1870605447841152/t0(4294969004) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.399302:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783952268.399331:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:1.0:1783952268.399335:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000020:00000040:1.0:1783952268.399348:0:97001:0:(tgt_handler.c:2952:tgt_brw_write()) Checksum 1024 from 12345-192.168.202.48@tcp OK: 9c7d2c1d 00000001:00000040:1.0:1783952268.399584:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 26 00000020:00000040:1.0:1783952268.399624:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=31 00010000:00000040:1.0:1783952268.401455:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969004, xid 1870605447841152 00000100:00000040:1.0:1783952268.401477:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.401486:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.401547:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.401561:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.401581:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.401621:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 30 00010000:00080000:1.0:1783952268.401628:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969005 00010000:00080000:1.0:1783952268.401633:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969005 00000100:00000040:2.0:1783952268.408213:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b16dd4e300 x1870605447841408 msgsize 1512 00000100:00100000:2.0:1783952268.408230:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.408307:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841408 00000100:00100000:1.0:1783952268.408317:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841408 00000020:00000040:1.0:1783952268.408320:0:24878:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.408325:0:24878:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=31 00000100:00000040:1.0:1783952268.408349:0:24878:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783952268.408396:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1074 00000100:00000040:1.0:1783952268.408401:0:24878:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:1.0:1783952268.408408:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16dd4e300 x1870605447841408/t0(4294969005) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.408430:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:2397:x1870605447841408:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:1.0:1783952268.408444:0:24878:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b16dd4e300 x1870605447841408/t0(4294969005) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783952268.408453:0:24878:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969005, current: 4294969005, replaying 00010000:00000040:1.0:1783952268.408457:0:24878:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:1.0:1783952268.408480:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16dd4e300 x1870605447841408/t0(4294969005) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.408489:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+31:2397:x1870605447841408:12345-192.168.202.48@tcp:4:dd.0 Request processed in 61us (278us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.408496:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1074 00000100:00000040:1.0:1783952268.408499:0:24878:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.408654:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969005, next_transno: 4294969005 00010000:00080000:3.0:1783952268.408659:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969005) 00010000:00080000:3.0:1783952268.408668:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447841408 t4294969005 from 192.168.202.48@tcp req@ffff97b16dd4e300 x1870605447841408/t0(4294969005) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.408694:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b16dd4e300 x1870605447841408/t0(4294969005) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.408797:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783952268.408826:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:3.0:1783952268.408830:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783952268.409068:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 27 00000020:00000040:3.0:1783952268.409072:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=32 00010000:00000040:3.0:1783952268.409843:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969005, xid 1870605447841408 00000100:00000040:3.0:1783952268.409857:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.409864:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.409918:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.409929:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.409936:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.409945:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 31 00010000:00080000:3.0:1783952268.409950:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969006 00010000:00080000:3.0:1783952268.409954:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969006 00000100:00000040:3.0:1783952268.415002:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de28700 x1870605447841664 msgsize 1512 00000100:00100000:3.0:1783952268.415017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952268.415090:0:24877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841664 00000100:00100000:0.0:1783952268.415100:0:24877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841664 00000020:00000040:0.0:1783952268.415103:0:24877:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:0.0:1783952268.415107:0:24877:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=32 00000100:00000040:0.0:1783952268.415130:0:24877:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783952268.415177:0:24877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1075 00000100:00000040:0.0:1783952268.415182:0:24877:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:0.0:1783952268.415189:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de28700 x1870605447841664/t0(4294969006) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952268.415203:0:24877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+32:2397:x1870605447841664:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:0.0:1783952268.415215:0:24877:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de28700 x1870605447841664/t0(4294969006) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783952268.415223:0:24877:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969006, current: 4294969006, replaying 00010000:00000040:0.0:1783952268.415226:0:24877:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:0.0:1783952268.415245:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de28700 x1870605447841664/t0(4294969006) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952268.415266:0:24877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+32:2397:x1870605447841664:12345-192.168.202.48@tcp:4:dd.0 Request processed in 65us (265us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783952268.415274:0:24877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1075 00000100:00000040:0.0:1783952268.415277:0:24877:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.415378:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969006, next_transno: 4294969006 00010000:00080000:3.0:1783952268.415382:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969006) 00010000:00080000:3.0:1783952268.415389:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447841664 t4294969006 from 192.168.202.48@tcp req@ffff97b14de28700 x1870605447841664/t0(4294969006) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.415405:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de28700 x1870605447841664/t0(4294969006) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.415505:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783952268.415532:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:3.0:1783952268.415536:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783952268.416010:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 28 00000020:00000040:3.0:1783952268.416016:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=33 00010000:00000040:3.0:1783952268.418027:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969006, xid 1870605447841664 00000100:00000040:3.0:1783952268.418048:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.418057:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.418125:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.418139:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.418148:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.418159:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 32 00010000:00080000:3.0:1783952268.418164:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969007 00010000:00080000:3.0:1783952268.418168:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969007 00000100:00000040:1.0:1783952268.422635:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e59500 x1870605447841920 msgsize 1512 00000100:00100000:1.0:1783952268.422652:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.422786:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447841920 00000100:00100000:3.0:1783952268.422797:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447841920 00000020:00000040:3.0:1783952268.422800:0:25538:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.422805:0:25538:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=33 00000100:00000040:3.0:1783952268.422830:0:25538:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.422881:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1076 00000100:00000040:3.0:1783952268.422885:0:25538:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.422893:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e59500 x1870605447841920/t0(4294969007) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.422907:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:2397:x1870605447841920:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:3.0:1783952268.422919:0:25538:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e59500 x1870605447841920/t0(4294969007) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.422928:0:25538:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969007, current: 4294969007, replaying 00010000:00000040:3.0:1783952268.422932:0:25538:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.422946:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e59500 x1870605447841920/t0(4294969007) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.422955:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+33:2397:x1870605447841920:12345-192.168.202.48@tcp:4:dd.0 Request processed in 50us (320us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.422980:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1076 00000100:00000040:3.0:1783952268.422983:0:25538:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.423001:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969007, next_transno: 4294969007 00010000:00080000:3.0:1783952268.423006:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969007) 00010000:00080000:3.0:1783952268.423013:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447841920 t4294969007 from 192.168.202.48@tcp req@ffff97b049e59500 x1870605447841920/t0(4294969007) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.423028:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e59500 x1870605447841920/t0(4294969007) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.423121:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783952268.423149:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:3.0:1783952268.423153:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783952268.423390:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 29 00000020:00000040:3.0:1783952268.423394:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=34 00010000:00000040:3.0:1783952268.423784:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969007, xid 1870605447841920 00000100:00000040:3.0:1783952268.423798:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.423804:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.423903:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.423915:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.423921:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.423936:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 33 00010000:00080000:3.0:1783952268.423941:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969008 00010000:00080000:3.0:1783952268.423944:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969008 00000100:00000040:1.0:1783952268.442214:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e59880 x1870605447842176 msgsize 1512 00000100:00100000:1.0:1783952268.442228:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.442299:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842176 00000100:00100000:3.0:1783952268.442311:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842176 00000020:00000040:3.0:1783952268.442314:0:8440:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.442319:0:8440:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=34 00000100:00000040:3.0:1783952268.442347:0:8440:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.442419:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1077 00000100:00000040:3.0:1783952268.442424:0:8440:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.442433:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e59880 x1870605447842176/t0(4294969008) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.442447:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:2397:x1870605447842176:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:3.0:1783952268.442460:0:8440:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e59880 x1870605447842176/t0(4294969008) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.442468:0:8440:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969008, current: 4294969008, replaying 00010000:00000040:3.0:1783952268.442472:0:8440:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.442482:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e59880 x1870605447842176/t0(4294969008) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.442491:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+34:2397:x1870605447842176:12345-192.168.202.48@tcp:4:dd.0 Request processed in 46us (278us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.442498:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1077 00000100:00000040:3.0:1783952268.442501:0:8440:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.442516:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969008, next_transno: 4294969008 00010000:00080000:3.0:1783952268.442520:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969008) 00010000:00080000:3.0:1783952268.442527:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447842176 t4294969008 from 192.168.202.48@tcp req@ffff97b049e59880 x1870605447842176/t0(4294969008) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.442541:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e59880 x1870605447842176/t0(4294969008) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.442689:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783952268.442725:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:3.0:1783952268.442729:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783952268.442970:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 30 00000020:00000040:3.0:1783952268.442980:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=35 00010000:00000040:1.0:1783952268.444083:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969008, xid 1870605447842176 00000100:00000040:1.0:1783952268.444098:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.444105:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.444401:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.444415:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.444423:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.444435:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 34 00010000:00080000:1.0:1783952268.444440:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969009 00010000:00080000:1.0:1783952268.444443:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969009 00000100:00000040:0.0:1783952268.451407:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b047acc380 x1870605447842432 msgsize 1512 00000100:00100000:0.0:1783952268.451422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952268.455398:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842432 00000100:00100000:2.0:1783952268.455416:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842432 00000020:00000040:2.0:1783952268.455420:0:24883:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:2.0:1783952268.455425:0:24883:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=35 00000100:00000040:2.0:1783952268.455450:0:24883:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783952268.456750:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1078 00000100:00000040:2.0:1783952268.456756:0:24883:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:2.0:1783952268.456766:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b047acc380 x1870605447842432/t0(4294969009) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.456785:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+35:2397:x1870605447842432:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:2.0:1783952268.456800:0:24883:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b047acc380 x1870605447842432/t0(4294969009) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783952268.456809:0:24883:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969009, current: 4294969009, replaying 00010000:00000040:2.0:1783952268.456812:0:24883:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:2.0:1783952268.456825:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b047acc380 x1870605447842432/t0(4294969009) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.456834:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d33551be-a709-4ba2-a74c-f4d7b53c6817+35:2397:x1870605447842432:12345-192.168.202.48@tcp:4:dd.0 Request processed in 56us (5428us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.456849:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1078 00000100:00000040:2.0:1783952268.456853:0:24883:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:1.0:1783952268.460657:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969009, next_transno: 4294969009 00010000:00080000:1.0:1783952268.460673:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969009) 00010000:00080000:1.0:1783952268.460691:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447842432 t4294969009 from 192.168.202.48@tcp req@ffff97b047acc380 x1870605447842432/t0(4294969009) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.460717:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b047acc380 x1870605447842432/t0(4294969009) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.460812:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783952268.460840:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:1.0:1783952268.460843:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783952268.461092:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 31 00000020:00000040:1.0:1783952268.461097:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=36 00010000:00000040:1.0:1783952268.461964:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969009, xid 1870605447842432 00000100:00000040:1.0:1783952268.461979:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.461987:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.462042:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.462055:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.462064:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.462076:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 35 00010000:00080000:1.0:1783952268.462080:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969010 00010000:00080000:1.0:1783952268.462084:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969010 00000100:00000040:0.0:1783952268.472724:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b047aced80 x1870605447842688 msgsize 1512 00000100:00100000:0.0:1783952268.472741:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952268.472798:0:25554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842688 00000100:00100000:0.0:1783952268.472807:0:25554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842688 00000020:00000040:0.0:1783952268.472811:0:25554:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:0.0:1783952268.472815:0:25554:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=36 00000100:00000040:0.0:1783952268.472839:0:25554:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783952268.472895:0:25554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1079 00000100:00000040:0.0:1783952268.472900:0:25554:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:0.0:1783952268.472908:0:25554:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b047aced80 x1870605447842688/t0(4294969010) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952268.472922:0:25554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+36:2397:x1870605447842688:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:0.0:1783952268.472935:0:25554:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b047aced80 x1870605447842688/t0(4294969010) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783952268.472945:0:25554:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969010, current: 4294969010, replaying 00010000:00000040:0.0:1783952268.472949:0:25554:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:0.0:1783952268.472967:0:25554:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b047aced80 x1870605447842688/t0(4294969010) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952268.472976:0:25554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+36:2397:x1870605447842688:12345-192.168.202.48@tcp:4:dd.0 Request processed in 56us (253us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783952268.472993:0:25554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1079 00000100:00000040:0.0:1783952268.472997:0:25554:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:1.0:1783952268.473292:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969010, next_transno: 4294969010 00010000:00080000:1.0:1783952268.473297:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969010) 00010000:00080000:1.0:1783952268.473306:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447842688 t4294969010 from 192.168.202.48@tcp req@ffff97b047aced80 x1870605447842688/t0(4294969010) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.473321:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b047aced80 x1870605447842688/t0(4294969010) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.473417:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783952268.473453:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:1.0:1783952268.473463:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783952268.473785:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 32 00000020:00000040:1.0:1783952268.473789:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=37 00010000:00000040:1.0:1783952268.477904:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969010, xid 1870605447842688 00000100:00000040:1.0:1783952268.477926:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.477934:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.477993:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.478008:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.478017:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.478029:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 36 00010000:00080000:1.0:1783952268.478035:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969011 00010000:00080000:1.0:1783952268.478039:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969011 00000100:00000040:1.0:1783952268.485851:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b049e5aa00 x1870605447842944 msgsize 1512 00000100:00100000:1.0:1783952268.485867:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.485906:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447842944 00000100:00100000:1.0:1783952268.485917:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447842944 00000020:00000040:1.0:1783952268.485921:0:24878:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.485925:0:24878:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=37 00000100:00000040:1.0:1783952268.485947:0:24878:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783952268.485992:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1080 00000100:00000040:1.0:1783952268.485997:0:24878:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:1.0:1783952268.486005:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049e5aa00 x1870605447842944/t0(4294969011) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.486019:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+37:2397:x1870605447842944:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:1.0:1783952268.486032:0:24878:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e5aa00 x1870605447842944/t0(4294969011) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783952268.486041:0:24878:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969011, current: 4294969011, replaying 00010000:00000040:1.0:1783952268.486045:0:24878:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:1.0:1783952268.486061:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049e5aa00 x1870605447842944/t0(4294969011) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783952268.486069:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+37:2397:x1870605447842944:12345-192.168.202.48@tcp:4:dd.0 Request processed in 53us (220us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.486077:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1080 00000100:00000040:1.0:1783952268.486080:0:24878:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:1.0:1783952268.486100:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969011, next_transno: 4294969011 00010000:00080000:1.0:1783952268.486104:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969011) 00010000:00080000:1.0:1783952268.486111:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447842944 t4294969011 from 192.168.202.48@tcp req@ffff97b049e5aa00 x1870605447842944/t0(4294969011) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.486127:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049e5aa00 x1870605447842944/t0(4294969011) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783952268.486208:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783952268.486236:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:1.0:1783952268.486240:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783952268.486475:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 33 00000020:00000040:1.0:1783952268.486479:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=38 00010000:00000040:0.0:1783952268.493696:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969011, xid 1870605447842944 00000100:00000040:0.0:1783952268.493718:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952268.493728:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952268.493786:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:0.0:1783952268.493800:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783952268.493810:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:0.0:1783952268.493822:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 37 00010000:00080000:0.0:1783952268.493827:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969012 00010000:00080000:0.0:1783952268.493832:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969012 00000100:00000040:2.0:1783952268.505808:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b16dd4c000 x1870605447843200 msgsize 1512 00000100:00100000:2.0:1783952268.505823:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952268.505867:0:24877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843200 00000100:00100000:2.0:1783952268.506003:0:24877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843200 00000020:00000040:2.0:1783952268.506008:0:24877:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:2.0:1783952268.506013:0:24877:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=38 00000100:00000040:2.0:1783952268.506038:0:24877:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783952268.506085:0:24877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1081 00000100:00000040:2.0:1783952268.506090:0:24877:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:2.0:1783952268.506098:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16dd4c000 x1870605447843200/t0(4294969012) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.506112:0:24877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+38:2397:x1870605447843200:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:2.0:1783952268.506125:0:24877:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b16dd4c000 x1870605447843200/t0(4294969012) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783952268.506133:0:24877:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969012, current: 4294969012, replaying 00010000:00000040:2.0:1783952268.506137:0:24877:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:2.0:1783952268.506148:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16dd4c000 x1870605447843200/t0(4294969012) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.506156:0:24877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16dd4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+38:2397:x1870605447843200:12345-192.168.202.48@tcp:4:dd.0 Request processed in 47us (350us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.506163:0:24877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1081 00000100:00000040:2.0:1783952268.506166:0:24877:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.506184:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969012, next_transno: 4294969012 00010000:00080000:2.0:1783952268.506196:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969012) 00010000:00080000:2.0:1783952268.506205:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447843200 t4294969012 from 192.168.202.48@tcp req@ffff97b16dd4c000 x1870605447843200/t0(4294969012) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.506221:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b16dd4c000 x1870605447843200/t0(4294969012) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.506308:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783952268.506338:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:2.0:1783952268.506341:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783952268.506608:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 34 00000020:00000040:2.0:1783952268.506613:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=39 00010000:00000040:2.0:1783952268.513164:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969012, xid 1870605447843200 00000100:00000040:2.0:1783952268.513187:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952268.513196:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952268.513249:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:2.0:1783952268.513263:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.513272:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.513283:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 38 00010000:00080000:2.0:1783952268.513289:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969013 00010000:00080000:2.0:1783952268.513294:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969013 00000100:00000040:0.0:1783952268.523197:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b047acce00 x1870605447843456 msgsize 1512 00000100:00100000:0.0:1783952268.523213:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952268.524853:0:25538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843456 00000100:00100000:2.0:1783952268.524867:0:25538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843456 00000020:00000040:2.0:1783952268.524870:0:25538:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:2.0:1783952268.524875:0:25538:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=39 00000100:00000040:2.0:1783952268.524901:0:25538:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783952268.524947:0:25538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1082 00000100:00000040:2.0:1783952268.524951:0:25538:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:2.0:1783952268.524959:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b047acce00 x1870605447843456/t0(4294969013) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.524990:0:25538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+39:2397:x1870605447843456:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:2.0:1783952268.525002:0:25538:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b047acce00 x1870605447843456/t0(4294969013) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783952268.525010:0:25538:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969013, current: 4294969013, replaying 00010000:00000040:2.0:1783952268.525014:0:25538:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:2.0:1783952268.525025:0:25538:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b047acce00 x1870605447843456/t0(4294969013) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.525032:0:25538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+39:2397:x1870605447843456:12345-192.168.202.48@tcp:4:dd.0 Request processed in 45us (1836us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.525038:0:25538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1082 00000100:00000040:2.0:1783952268.525041:0:25538:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.525407:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969013, next_transno: 4294969013 00010000:00080000:2.0:1783952268.525412:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969013) 00010000:00080000:2.0:1783952268.525420:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447843456 t4294969013 from 192.168.202.48@tcp req@ffff97b047acce00 x1870605447843456/t0(4294969013) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.525436:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b047acce00 x1870605447843456/t0(4294969013) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.525540:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783952268.525567:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:2.0:1783952268.525583:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783952268.530756:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 35 00000020:00000040:2.0:1783952268.530768:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=40 00010000:00000040:2.0:1783952268.535475:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969013, xid 1870605447843456 00000100:00000040:2.0:1783952268.535496:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952268.535511:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952268.535560:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:2.0:1783952268.535603:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.535613:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.535626:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 39 00010000:00080000:2.0:1783952268.535631:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969014 00010000:00080000:2.0:1783952268.535636:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969014 00000100:00000040:1.0:1783952268.546481:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee7100 x1870605447843712 msgsize 1512 00000100:00100000:1.0:1783952268.546498:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.546660:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843712 00000100:00100000:3.0:1783952268.546671:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843712 00000020:00000040:3.0:1783952268.546674:0:8440:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.546678:0:8440:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=40 00000100:00000040:3.0:1783952268.546703:0:8440:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.546747:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1083 00000100:00000040:3.0:1783952268.546751:0:8440:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.546758:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee7100 x1870605447843712/t0(4294969014) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.546772:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+40:2397:x1870605447843712:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:3.0:1783952268.546784:0:8440:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee7100 x1870605447843712/t0(4294969014) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.546793:0:8440:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969014, current: 4294969014, replaying 00010000:00000040:3.0:1783952268.546797:0:8440:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.546807:0:8440:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee7100 x1870605447843712/t0(4294969014) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.546815:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+40:2397:x1870605447843712:12345-192.168.202.48@tcp:4:dd.0 Request processed in 45us (335us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.546822:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1083 00000100:00000040:3.0:1783952268.546825:0:8440:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.546843:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969014, next_transno: 4294969014 00010000:00080000:3.0:1783952268.546846:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969014) 00010000:00080000:3.0:1783952268.546854:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447843712 t4294969014 from 192.168.202.48@tcp req@ffff97b049ee7100 x1870605447843712/t0(4294969014) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.546869:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee7100 x1870605447843712/t0(4294969014) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.546967:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783952268.547066:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:3.0:1783952268.547069:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783952268.547295:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 36 00000020:00000040:3.0:1783952268.547299:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=41 00010000:00000040:1.0:1783952268.548803:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969014, xid 1870605447843712 00000100:00000040:1.0:1783952268.548820:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:1.0:1783952268.548827:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:1.0:1783952268.548877:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:1.0:1783952268.548887:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783952268.548894:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:1.0:1783952268.548904:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 40 00010000:00080000:1.0:1783952268.548908:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969015 00010000:00080000:1.0:1783952268.548920:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969015 00000100:00000040:3.0:1783952268.556328:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de28e00 x1870605447843968 msgsize 1512 00000100:00100000:3.0:1783952268.556343:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952268.556411:0:24880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447843968 00000100:00100000:0.0:1783952268.556422:0:24880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447843968 00000020:00000040:0.0:1783952268.556424:0:24880:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:0.0:1783952268.556430:0:24880:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=41 00000100:00000040:0.0:1783952268.556454:0:24880:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783952268.556506:0:24880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1084 00000100:00000040:0.0:1783952268.556511:0:24880:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:0.0:1783952268.556518:0:24880:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de28e00 x1870605447843968/t0(4294969015) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952268.556531:0:24880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+41:2397:x1870605447843968:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:0.0:1783952268.556542:0:24880:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de28e00 x1870605447843968/t0(4294969015) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783952268.556550:0:24880:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969015, current: 4294969015, replaying 00010000:00000040:0.0:1783952268.556561:0:24880:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:0.0:1783952268.556607:0:24880:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de28e00 x1870605447843968/t0(4294969015) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952268.556615:0:24880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d33551be-a709-4ba2-a74c-f4d7b53c6817+41:2397:x1870605447843968:12345-192.168.202.48@tcp:4:dd.0 Request processed in 86us (289us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783952268.556623:0:24880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1084 00000100:00000040:0.0:1783952268.556626:0:24880:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:0.0:1783952268.556642:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969015, next_transno: 4294969015 00010000:00080000:0.0:1783952268.556645:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969015) 00010000:00080000:0.0:1783952268.556652:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447843968 t4294969015 from 192.168.202.48@tcp req@ffff97b14de28e00 x1870605447843968/t0(4294969015) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783952268.556665:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de28e00 x1870605447843968/t0(4294969015) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783952268.556754:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783952268.556783:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:0.0:1783952268.556786:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783952268.557034:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 37 00000020:00000040:0.0:1783952268.557038:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=42 00010000:00000040:0.0:1783952268.557545:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969015, xid 1870605447843968 00000100:00000040:0.0:1783952268.557558:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952268.557565:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952268.557652:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:0.0:1783952268.557667:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:0.0:1783952268.557673:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:0.0:1783952268.557682:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 41 00010000:00080000:0.0:1783952268.557687:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969016 00010000:00080000:0.0:1783952268.557691:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969016 00000100:00000040:0.0:1783952268.561463:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b047acd180 x1870605447844224 msgsize 1512 00000100:00100000:0.0:1783952268.561478:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952268.561514:0:25554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844224 00000100:00100000:0.0:1783952268.561524:0:25554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844224 00000020:00000040:0.0:1783952268.561528:0:25554:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:0.0:1783952268.561532:0:25554:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=42 00000100:00000040:0.0:1783952268.561557:0:25554:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783952268.561946:0:25554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1085 00000100:00000040:0.0:1783952268.561951:0:25554:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:0.0:1783952268.561959:0:25554:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b047acd180 x1870605447844224/t0(4294969016) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952268.561974:0:25554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+42:2397:x1870605447844224:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:0.0:1783952268.562001:0:25554:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b047acd180 x1870605447844224/t0(4294969016) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783952268.562010:0:25554:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969016, current: 4294969016, replaying 00010000:00000040:0.0:1783952268.562015:0:25554:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:0.0:1783952268.562034:0:25554:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b047acd180 x1870605447844224/t0(4294969016) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783952268.562043:0:25554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d33551be-a709-4ba2-a74c-f4d7b53c6817+42:2397:x1870605447844224:12345-192.168.202.48@tcp:4:dd.0 Request processed in 74us (582us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783952268.562051:0:25554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1085 00000100:00000040:0.0:1783952268.562054:0:25554:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:2.0:1783952268.562094:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969016, next_transno: 4294969016 00010000:00080000:2.0:1783952268.562098:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969016) 00010000:00080000:2.0:1783952268.562107:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447844224 t4294969016 from 192.168.202.48@tcp req@ffff97b047acd180 x1870605447844224/t0(4294969016) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.562122:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b047acd180 x1870605447844224/t0(4294969016) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783952268.562218:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783952268.562247:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:2.0:1783952268.562250:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783952268.562486:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 38 00000020:00000040:2.0:1783952268.562490:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=43 00010000:00000040:3.0:1783952268.563676:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969016, xid 1870605447844224 00000100:00000040:3.0:1783952268.563693:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.563700:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.563751:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.563763:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.563771:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.563781:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 42 00010000:00080000:3.0:1783952268.563787:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969017 00010000:00080000:3.0:1783952268.563791:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969017 00000100:00000040:3.0:1783952268.580084:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de2b800 x1870605447844480 msgsize 1512 00000100:00100000:3.0:1783952268.580096:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.580127:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844480 00000100:00100000:3.0:1783952268.580136:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844480 00000020:00000040:3.0:1783952268.580139:0:24878:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.580142:0:24878:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=43 00000100:00000040:3.0:1783952268.580163:0:24878:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783952268.580206:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1086 00000100:00000040:3.0:1783952268.580210:0:24878:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.580217:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de2b800 x1870605447844480/t0(4294969017) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.580231:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+43:2397:x1870605447844480:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:3.0:1783952268.580250:0:24878:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de2b800 x1870605447844480/t0(4294969017) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783952268.580259:0:24878:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969017, current: 4294969017, replaying 00010000:00000040:3.0:1783952268.580262:0:24878:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.580271:0:24878:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de2b800 x1870605447844480/t0(4294969017) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783952268.580279:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+43:2397:x1870605447844480:12345-192.168.202.48@tcp:4:dd.0 Request processed in 51us (195us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.580287:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1086 00000100:00000040:3.0:1783952268.580290:0:24878:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.580309:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969017, next_transno: 4294969017 00010000:00080000:3.0:1783952268.580312:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969017) 00010000:00080000:3.0:1783952268.580319:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447844480 t4294969017 from 192.168.202.48@tcp req@ffff97b14de2b800 x1870605447844480/t0(4294969017) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.580334:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b14de2b800 x1870605447844480/t0(4294969017) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.580420:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783952268.580447:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:3.0:1783952268.580450:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783952268.580722:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 39 00000020:00000040:3.0:1783952268.580727:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=44 00010000:00000040:3.0:1783952268.581584:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969017, xid 1870605447844480 00000100:00000040:3.0:1783952268.581713:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.581720:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.581762:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.581772:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783952268.581785:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:3.0:1783952268.581794:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 43 00010000:00080000:3.0:1783952268.581798:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969018 00010000:00080000:3.0:1783952268.581802:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969018 00000100:00000040:1.0:1783952268.588243:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee6a00 x1870605447844736 msgsize 1512 00000100:00100000:1.0:1783952268.588260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952268.588438:0:24877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447844736 00000100:00100000:2.0:1783952268.588450:0:24877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447844736 00000020:00000040:2.0:1783952268.588453:0:24877:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:2.0:1783952268.588459:0:24877:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=44 00000100:00000040:2.0:1783952268.588486:0:24877:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783952268.588535:0:24877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1087 00000100:00000040:2.0:1783952268.588540:0:24877:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:2.0:1783952268.588547:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee6a00 x1870605447844736/t0(4294969018) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.588561:0:24877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+44:2397:x1870605447844736:12345-192.168.202.48@tcp:4:dd.0 00000020:00000040:2.0:1783952268.588617:0:24877:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee6a00 x1870605447844736/t0(4294969018) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783952268.588627:0:24877:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294969018, current: 4294969018, replaying 00010000:00000040:2.0:1783952268.588630:0:24877:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:2.0:1783952268.588641:0:24877:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee6a00 x1870605447844736/t0(4294969018) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783952268.588651:0:24877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+44:2397:x1870605447844736:12345-192.168.202.48@tcp:4:dd.0 Request processed in 92us (409us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783952268.588658:0:24877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1087 00000100:00000040:2.0:1783952268.588662:0:24877:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00010000:00080000:3.0:1783952268.589457:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969018, next_transno: 4294969018 00010000:00080000:3.0:1783952268.589462:0:97001:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294969018) 00010000:00080000:3.0:1783952268.589473:0:97001:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870605447844736 t4294969018 from 192.168.202.48@tcp req@ffff97b049ee6a00 x1870605447844736/t0(4294969018) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.589489:0:97001:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee6a00 x1870605447844736/t0(4294969018) o4->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 1512/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783952268.589605:0:97001:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783952268.589636:0:97001:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4619 MB/s 00000020:00000040:3.0:1783952268.589639:0:97001:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783952268.589871:0:97001:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff97b0497f3000 : new cb_count 40 00000020:00000040:3.0:1783952268.589875:0:97001:0:(genops.c:889:class_export_get()) GET export ffff97b0497f3000 refcount=45 00010000:00000040:3.0:1783952268.590620:0:97001:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968978, transno 4294969018, xid 1870605447844736 00000100:00000040:3.0:1783952268.590634:0:97001:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952268.590641:0:97001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952268.590695:0:97001:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00010000:00080000:3.0:1783952268.590707:0:97001:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783952268.590879:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.590891:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 44 00010000:00080000:2.0:1783952268.590896:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969019 00010000:00080000:2.0:1783952268.590900:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969019 00000100:00000040:1.0:1783952268.602745:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee4000 x1870605447848192 msgsize 328 00000100:00100000:1.0:1783952268.602760:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:1.0:1783952268.603033:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee4380 x1870605447848320 msgsize 328 00000100:00100000:1.0:1783952268.603039:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952268.603106:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447848192 00000100:00100000:3.0:1783952268.603117:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447848192 00000020:00000040:3.0:1783952268.603120:0:26208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.603125:0:26208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=45 00000100:00100000:3.0:1783952268.603169:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447848320 00000100:00100000:3.0:1783952268.603173:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447848320 00000020:00000040:3.0:1783952268.603174:0:26208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:3.0:1783952268.603176:0:26208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=46 00000100:00100000:3.0:1783952268.603201:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5049 00000100:00000040:3.0:1783952268.603213:0:26208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 1 00000100:00000040:3.0:1783952268.603222:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee4000 x1870605447848192/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952268.603236:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+46:2397:x1870605447848192:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1783952268.603249:0:26208:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee4000 x1870605447848192/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783952268.603259:0:26208:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00010000:00080000:3.0:1783952268.603263:0:26208:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049ee4000 x1870605447848192/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952268.603275:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee4000 x1870605447848192/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952268.603284:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+46:2397:x1870605447848192:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 50us (539us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.603291:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5049 00000100:00000040:3.0:1783952268.603294:0:26208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00000100:00100000:3.0:1783952268.603302:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5050 00000100:00000040:3.0:1783952268.603304:0:26208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 2 00000100:00000040:3.0:1783952268.603308:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee4380 x1870605447848320/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952268.603317:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+46:2397:x1870605447848320:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1783952268.603323:0:26208:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee4380 x1870605447848320/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783952268.603329:0:26208:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 3 00010000:00080000:3.0:1783952268.603336:0:26208:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049ee4380 x1870605447848320/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783952268.603345:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee4380 x1870605447848320/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952268.603354:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+46:2397:x1870605447848320:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 37us (319us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783952268.603360:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5050 00000100:00000040:3.0:1783952268.603362:0:26208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 2 00010000:00080000:2.0:1783952268.604627:0:97001:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294969019 00010000:00080000:2.0:1783952268.604633:0:97001:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00010000:00000040:2.0:1783952268.604640:0:97001:0:(ldlm_lib.c:2881:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:2.0:1783952268.604642:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783952268.604645:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783952268.604656:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049ee4000 x1870605447848192/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783952268.604665:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00000100:00000040:1.0:1783952268.605072:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee5180 x1870605447848448 msgsize 328 00000100:00100000:1.0:1783952268.605079:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:1.0:1783952268.605111:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee5500 x1870605447848576 msgsize 328 00000100:00100000:1.0:1783952268.605116:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:1.0:1783952268.605140:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee5c00 x1870605447848704 msgsize 328 00000100:00100000:1.0:1783952268.605145:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.605167:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447848448 00000100:00100000:1.0:1783952268.605174:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447848448 00000020:00000040:1.0:1783952268.605177:0:8435:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.605181:0:8435:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=47 00000100:00100000:1.0:1783952268.605216:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447848576 00000100:00100000:1.0:1783952268.605219:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447848576 00000020:00000040:1.0:1783952268.605221:0:8435:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.605223:0:8435:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=48 00000100:00100000:1.0:1783952268.605240:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447848704 00000100:00100000:1.0:1783952268.605243:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447848704 00000020:00000040:1.0:1783952268.605245:0:8435:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.605247:0:8435:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=49 00000100:00100000:1.0:1783952268.605268:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5051 00000100:00000040:1.0:1783952268.605272:0:8435:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 3 00000100:00000040:1.0:1783952268.605277:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee5180 x1870605447848448/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.605289:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+49:2397:x1870605447848448:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783952268.605308:0:8435:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee5180 x1870605447848448/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783952268.605318:0:8435:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 4 00010000:00080000:1.0:1783952268.605321:0:8435:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049ee5180 x1870605447848448/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.605330:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee5180 x1870605447848448/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.605339:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+49:2397:x1870605447848448:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 52us (266us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.605345:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5051 00000100:00000040:1.0:1783952268.605348:0:8435:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 3 00000100:00100000:1.0:1783952268.605357:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5052 00000100:00000040:1.0:1783952268.605359:0:8435:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 4 00000100:00000040:1.0:1783952268.605363:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee5500 x1870605447848576/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.605373:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+49:2397:x1870605447848576:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783952268.605380:0:8435:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee5500 x1870605447848576/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783952268.605387:0:8435:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 5 00010000:00080000:1.0:1783952268.605390:0:8435:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049ee5500 x1870605447848576/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.605398:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee5500 x1870605447848576/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.605418:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+49:2397:x1870605447848576:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 45us (304us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.605423:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5052 00000100:00000040:1.0:1783952268.605425:0:8435:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 4 00000100:00100000:1.0:1783952268.605433:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5053 00000100:00000040:1.0:1783952268.605435:0:8435:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 5 00000100:00000040:1.0:1783952268.605439:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee5c00 x1870605447848704/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.605449:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+49:2397:x1870605447848704:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783952268.605456:0:8435:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee5c00 x1870605447848704/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783952268.605462:0:8435:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 6 00010000:00080000:1.0:1783952268.605466:0:8435:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049ee5c00 x1870605447848704/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.605474:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee5c00 x1870605447848704/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.605481:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+49:2397:x1870605447848704:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 33us (339us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.605486:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5053 00000100:00000040:1.0:1783952268.605488:0:8435:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 5 00000100:00000040:1.0:1783952268.611161:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee7480 x1870605447848832 msgsize 328 00000100:00100000:1.0:1783952268.611179:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:1.0:1783952268.611210:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee4700 x1870605447848960 msgsize 328 00000100:00100000:1.0:1783952268.611226:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:1.0:1783952268.611265:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee5880 x1870605447849088 msgsize 328 00000100:00100000:1.0:1783952268.611270:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952268.611300:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447848832 00000100:00100000:1.0:1783952268.611311:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447848832 00000020:00000040:1.0:1783952268.611314:0:26196:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.611319:0:26196:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=50 00000100:00100000:1.0:1783952268.611366:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447848960 00000100:00100000:1.0:1783952268.611370:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447848960 00000020:00000040:1.0:1783952268.611371:0:26196:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.611372:0:26196:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=51 00000100:00100000:1.0:1783952268.611387:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447849088 00000100:00100000:1.0:1783952268.611390:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447849088 00000020:00000040:1.0:1783952268.611391:0:26196:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f30 00000020:00000040:1.0:1783952268.611392:0:26196:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f3000 refcount=52 00000100:00100000:1.0:1783952268.611419:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5054 00000100:00000040:1.0:1783952268.611424:0:26196:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 6 00000100:00000040:1.0:1783952268.611432:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee7480 x1870605447848832/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.611445:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+52:2397:x1870605447848832:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783952268.611461:0:26196:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee7480 x1870605447848832/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783952268.611472:0:26196:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 7 00010000:00080000:1.0:1783952268.611476:0:26196:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049ee7480 x1870605447848832/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.611487:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee7480 x1870605447848832/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.611508:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+52:2397:x1870605447848832:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 64us (346us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.611514:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5054 00000100:00000040:1.0:1783952268.611517:0:26196:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 6 00000100:00100000:1.0:1783952268.611528:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5055 00000100:00000040:1.0:1783952268.611530:0:26196:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 7 00000100:00000040:1.0:1783952268.611534:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee4700 x1870605447848960/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.611546:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+52:2397:x1870605447848960:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783952268.611553:0:26196:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee4700 x1870605447848960/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783952268.611560:0:26196:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 8 00010000:00080000:1.0:1783952268.611563:0:26196:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049ee4700 x1870605447848960/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.611585:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee4700 x1870605447848960/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.611614:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+52:2397:x1870605447848960:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 70us (401us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.611619:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5055 00000100:00000040:1.0:1783952268.611621:0:26196:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 7 00000100:00100000:1.0:1783952268.611630:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5056 00000100:00000040:1.0:1783952268.611632:0:26196:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 8 00000100:00000040:1.0:1783952268.611636:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee5880 x1870605447849088/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.611656:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+52:2397:x1870605447849088:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783952268.611663:0:26196:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff97b049ee5880 x1870605447849088/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783952268.611670:0:26196:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff97b0497f3000 : new rpc_count 9 00010000:00080000:1.0:1783952268.611673:0:26196:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049ee5880 x1870605447849088/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952268.611682:0:26196:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee5880 x1870605447849088/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952268.611690:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+52:2397:x1870605447849088:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 37us (424us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952268.611695:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5056 00000100:00000040:1.0:1783952268.611697:0:26196:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f3000 : new rpc_count 8 00010000:00000040:2.0:1783952268.613205:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 7 00000020:00000040:2.0:1783952268.613224:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 51 00010000:00080000:2.0:1783952268.613229:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783952268.613232:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783952268.613244:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049ee4380 x1870605447848320/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783952268.613312:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1783952268.613314:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 6 00000020:00000040:2.0:1783952268.613320:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 50 00010000:00080000:2.0:1783952268.613322:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783952268.613324:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783952268.613329:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049ee5180 x1870605447848448/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783952268.613337:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1783952268.613339:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 5 00000020:00000040:2.0:1783952268.613346:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 49 00010000:00080000:2.0:1783952268.613347:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783952268.613348:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783952268.613353:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049ee5500 x1870605447848576/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783952268.613360:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1783952268.613362:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 4 00000020:00000040:2.0:1783952268.613367:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 48 00010000:00080000:2.0:1783952268.613368:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783952268.613369:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783952268.613373:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049ee5c00 x1870605447848704/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783952268.613379:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1783952268.613381:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 3 00000020:00000040:2.0:1783952268.613386:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 47 00010000:00080000:2.0:1783952268.613388:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783952268.613389:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783952268.613393:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049ee7480 x1870605447848832/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783952268.613410:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1783952268.613411:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 2 00000020:00000040:2.0:1783952268.613417:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 46 00010000:00080000:2.0:1783952268.613418:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783952268.613419:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783952268.613424:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049ee4700 x1870605447848960/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783952268.613430:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1783952268.613431:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 1 00000020:00000040:2.0:1783952268.613435:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 45 00010000:00080000:2.0:1783952268.613437:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783952268.613438:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783952268.613442:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049ee5880 x1870605447849088/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:529/0 lens 328/0 e 0 to 0 dl 1783952279 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783952268.613448:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1783952268.613449:0:97001:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff97b0497f3000 : new rpc_count 0 00000020:00000040:2.0:1783952268.613454:0:97001:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 44 00010000:00080000:2.0:1783952268.613456:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00010000:0.0:1783952268.836110:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1783952269.091157:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff97b0465d3380) now 10 - health_check_show 00000020:00000040:1.0:1783952269.091170:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff97b0465d3380) now 10 - health_check_show 00000020:00000040:1.0:1783952269.091174:0:97149:0:(obd_config.c:994:class_incref()) incref MDS (ffff97b145458000) now 4 - health_check_show 00000020:00000040:1.0:1783952269.091182:0:97149:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff97b145458000) now 4 - health_check_show 00000020:00000040:1.0:1783952269.091184:0:97149:0:(obd_config.c:994:class_incref()) incref MGC192.168.202.148@tcp (ffff97b167c90000) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091187:0:97149:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.202.148@tcp (ffff97b167c90000) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091189:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff97b1454599c0) now 12 - health_check_show 00000020:00000040:1.0:1783952269.091192:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff97b1454599c0) now 12 - health_check_show 00000020:00000040:1.0:1783952269.091194:0:97149:0:(obd_config.c:994:class_incref()) incref MGS (ffff97b14545cd40) now 8 - health_check_show 00000020:00000040:1.0:1783952269.091198:0:97149:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff97b14545cd40) now 8 - health_check_show 00000020:00000040:1.0:1783952269.091200:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff97b1447bb380) now 5 - health_check_show 00000020:00000040:1.0:1783952269.091203:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff97b1447bb380) now 5 - health_check_show 00000020:00000040:1.0:1783952269.091210:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 12 - health_check_show 00000020:00000040:1.0:1783952269.091213:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff97b167c13380) now 12 - health_check_show 00000020:00000040:1.0:1783952269.091215:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff97b167c10000) now 5 - health_check_show 00000020:00000040:1.0:1783952269.091217:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff97b167c10000) now 5 - health_check_show 00000020:00000040:1.0:1783952269.091219:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff97b167c93380) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091221:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff97b167c93380) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091223:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff97b176280000) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091225:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff97b176280000) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091227:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff97b1449b19c0) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091229:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff97b1449b19c0) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091231:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff97b1762819c0) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091233:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff97b1762819c0) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091235:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff97b0468a0000) now 5 - health_check_show 00000020:00000040:1.0:1783952269.091237:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff97b0468a0000) now 5 - health_check_show 00000020:00000040:1.0:1783952269.091239:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 16 - health_check_show 00000020:00000040:1.0:1783952269.091241:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff97b0468a4d40) now 16 - health_check_show 00000020:00000040:1.0:1783952269.091243:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff97b0468a3380) now 5 - health_check_show 00000020:00000040:1.0:1783952269.091244:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff97b0468a3380) now 5 - health_check_show 00000020:00000040:1.0:1783952269.091246:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff97b0489b8000) now 5 - health_check_show 00000020:00000040:1.0:1783952269.091249:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff97b0489b8000) now 5 - health_check_show 00000020:00000040:1.0:1783952269.091250:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff97b0489bcd40) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091253:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff97b0489bcd40) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091255:0:97149:0:(obd_config.c:994:class_incref()) incref OSS (ffff97b167c119c0) now 4 - health_check_show 00000020:00000040:1.0:1783952269.091260:0:97149:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff97b167c119c0) now 4 - health_check_show 00000020:00000040:1.0:1783952269.091261:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff97b167c919c0) now 10 - health_check_show 00000020:00000040:1.0:1783952269.091318:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff97b167c919c0) now 10 - health_check_show 00000020:00000040:1.0:1783952269.091322:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff97b048b5cd40) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091324:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff97b048b5cd40) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091333:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff97b1447b8000) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091335:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff97b1447b8000) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091337:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff97b048b5b380) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091339:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff97b048b5b380) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091341:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff97b0489bb380) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091343:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff97b0489bb380) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091345:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff97b0468a19c0) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091348:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff97b0468a19c0) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091350:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff97b0465d0000) now 10 - health_check_show 00000020:00000040:1.0:1783952269.091369:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff97b0465d0000) now 10 - health_check_show 00000020:00000040:1.0:1783952269.091372:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff97b1449b0000) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091375:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff97b1449b0000) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091377:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff97b0476ab380) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091379:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff97b0476ab380) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091381:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff97b0489b99c0) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091383:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff97b0489b99c0) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091385:0:97149:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff97b1447b99c0) now 6 - health_check_show 00000020:00000040:1.0:1783952269.091387:0:97149:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff97b1447b99c0) now 6 - health_check_show 00000020:00000040:1.0:1783952269.409613:0:94421:0:(genops.c:1231:class_import_get()) import ffff97b15036a000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1783952269.409658:0:94421:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b36344cb] to pc [ptlrpcd_00_01+1] req@ffff97b049ee4a80 x1870605465647360/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952269.409768:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1783952269.409784:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049ee4a80 x1870605465647360/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952269.409798:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465647360:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1783952269.409825:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049ee4a80 x1870605465647360/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952269.409833:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952269.409928:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b144732d80 x1870605465647360 msgsize 224 00000100:00100000:2.0:1783952269.409933:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952269.409960:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049ee4a80 x1870605465647360/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952269.409984:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5937 usecs (6 jiffies) 00000100:00100000:1.0:1783952269.410086:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465647360 00000100:00100000:1.0:1783952269.410094:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465647360 00000020:00000040:1.0:1783952269.410097:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5fe7 00000020:00000040:1.0:1783952269.410101:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04965f000 refcount=5 00000100:00000040:1.0:1783952269.410123:0:8445:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1783952269.410155:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00000040:1.0:1783952269.410160:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b04965f000 : new rpc_count 1 00000100:00000040:1.0:1783952269.410172:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b144732d80 x1870605465647360/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:530/0 lens 224/0 e 0 to 0 dl 1783952280 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952269.410183:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465647360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783952269.410218:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00010000:00000040:1.0:1783952269.410228:0:8445:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465647360 00000100:00000040:1.0:1783952269.410237:0:8445:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:1.0:1783952269.410242:0:8445:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952269.410261:0:8445:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b049ee4a80 x1870605465647360/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952269.410285:0:8445:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:1.0:1783952269.410289:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b144732d80 x1870605465647360/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:530/0 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952269.410297:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465647360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952269.410303:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00000040:1.0:1783952269.410307:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b04965f000 : new rpc_count 0 00000020:00000040:1.0:1783952269.410316:0:8445:0:(genops.c:900:class_export_put()) PUTting export ffff97b04965f000 : new refcount 4 00000100:00000040:0.0:1783952269.410414:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1783952269.410421:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049ee4a80 x1870605465647360/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1783952269.410444:0:3642:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352909 avail=317206 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023681 state=0: rc = 0 00000100:00000040:0.0:1783952269.410452:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee4a80 x1870605465647360/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952269.410460:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465647360:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1783952269.410466:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049ee4a80 x1870605465647360/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952269.410477:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b15036a000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1783952269.807651:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b16588dc50 x1870605447849216 msgsize 224 00000100:00100000:3.0:1783952269.807670:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:3.0:1783952269.807672:0:3637:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783952269.807702:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de29500 x1870605447849344 msgsize 224 00000100:00100000:3.0:1783952269.807707:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952269.807816:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447849216 00000100:00100000:0.0:1783952269.807827:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447849216 00000020:00000040:0.0:1783952269.807830:0:94415:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6065 00000020:00000040:0.0:1783952269.807835:0:94415:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f5000 refcount=10 00000100:00000040:0.0:1783952269.807860:0:94415:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783952269.807889:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 215 00000100:00000040:0.0:1783952269.807893:0:94415:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f5000 : new rpc_count 1 00000100:00000040:0.0:1783952269.807901:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16588dc50 x1870605447849216/t0(0) o400->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:530/0 lens 224/0 e 0 to 0 dl 1783952280 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952269.807915:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447849216:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:0.0:1783952269.807936:0:94415:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605447849216 00000100:00000040:0.0:1783952269.807946:0:94415:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952269.807952:0:94415:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:0.0:1783952269.807991:0:94415:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00000100:00000040:0.0:1783952269.807997:0:94415:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16588dc50 x1870605447849216/t0(0) o400->e617e28a-7c0f-459e-8765-f628898cec50@192.168.202.48@tcp:530/0 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952269.808006:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447849216:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 94us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952269.808028:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 215 00000100:00000040:0.0:1783952269.808031:0:94415:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f5000 : new rpc_count 0 00000020:00000040:0.0:1783952269.808041:0:94415:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f5000 : new refcount 9 00000100:00000040:3.0:1783952269.809621:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de2aa00 x1870605447849600 msgsize 224 00000100:00100000:3.0:1783952269.809637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00000040:3.0:1783952269.809668:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff97b14de28000 x1870605447849472 msgsize 224 00000100:00100000:3.0:1783952269.809673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952269.816578:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447849600 00000100:00100000:3.0:1783952269.816606:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447849600 00000020:00000040:3.0:1783952269.816610:0:8433:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6367 00000020:00000040:3.0:1783952269.816616:0:8433:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1746c9000 refcount=7 00000020:00000040:3.0:1783952269.816637:0:8433:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00100000:3.0:1783952269.816694:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2938 00000100:00000040:3.0:1783952269.816698:0:8433:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1746c9000 : new rpc_count 1 00000100:00000040:3.0:1783952269.816706:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de2aa00 x1870605447849600/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:530/0 lens 224/0 e 0 to 0 dl 1783952280 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952269.816720:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2401:x1870605447849600:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:3.0:1783952269.816756:0:8433:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605447849600 00000100:00000040:3.0:1783952269.816765:0:8433:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952269.816770:0:8433:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:3.0:1783952269.816813:0:8433:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00000100:00000040:3.0:1783952269.816818:0:8433:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de2aa00 x1870605447849600/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:530/0 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952269.816826:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2401:x1870605447849600:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 109us (7206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952269.816833:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2938 00000100:00000040:3.0:1783952269.816836:0:8433:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1746c9000 : new rpc_count 0 00000020:00000040:3.0:1783952269.816845:0:8433:0:(genops.c:900:class_export_put()) PUTting export ffff97b1746c9000 : new refcount 6 00000100:00080000:0.0:1783952269.817399:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1783952269.817405:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00100000:2.0:1783952269.818519:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447849344 00000100:00100000:2.0:1783952269.818528:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447849344 00000020:00000040:2.0:1783952269.818531:0:66237:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5fb6 00000020:00000040:2.0:1783952269.818535:0:66237:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c3800 refcount=51 00000020:00000040:2.0:1783952269.818550:0:66237:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 16 - evictor 00000100:00000040:2.0:1783952269.818603:0:66237:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1783952269.818631:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447849472 00000100:00100000:2.0:1783952269.818635:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447849472 00000020:00000040:2.0:1783952269.818637:0:66237:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb55c2 00000020:00000040:2.0:1783952269.818640:0:66237:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0410df000 refcount=11 00000020:00000040:2.0:1783952269.818647:0:66237:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 12 - evictor 00000100:00100000:2.0:1783952269.818668:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1503 00000100:00000040:2.0:1783952269.818672:0:66237:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c3800 : new rpc_count 1 00000100:00000040:2.0:1783952269.818679:0:66237:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de29500 x1870605447849344/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:530/0 lens 224/0 e 0 to 0 dl 1783952280 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952269.818694:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2400:x1870605447849344:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:2.0:1783952269.818717:0:66237:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1870605447849344 00000100:00000040:2.0:1783952269.818725:0:66237:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952269.818731:0:66237:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952269.818766:0:66237:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952269.818772:0:66237:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de29500 x1870605447849344/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:530/0 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952269.818783:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2400:x1870605447849344:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 92us (11078us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952269.818790:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1503 00000100:00000040:2.0:1783952269.818793:0:66237:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c3800 : new rpc_count 0 00000020:00000040:2.0:1783952269.818812:0:66237:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c3800 : new refcount 50 00000100:00100000:2.0:1783952269.818822:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1504 00000100:00000040:2.0:1783952269.818825:0:66237:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0410df000 : new rpc_count 1 00000100:00000040:2.0:1783952269.818829:0:66237:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b14de28000 x1870605447849472/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:530/0 lens 224/0 e 0 to 0 dl 1783952280 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952269.818840:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2401:x1870605447849472:12345-192.168.202.48@tcp:400:kworker.0 00010000:00000040:2.0:1783952269.818850:0:66237:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 77309411471, transno 0, xid 1870605447849472 00000100:00000040:2.0:1783952269.818855:0:66237:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b046b5c800 refcount 11 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952269.818859:0:66237:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.48@tcp 00000100:00000040:2.0:1783952269.818873:0:66237:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b046b5c800 refcount 10 to 192.168.202.48@tcp 00000100:00000040:2.0:1783952269.818878:0:66237:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de28000 x1870605447849472/t0(0) o400->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:530/0 lens 224/224 e 0 to 0 dl 1783952280 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952269.818887:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2401:x1870605447849472:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 48us (9217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952269.818893:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1504 00000100:00000040:2.0:1783952269.818896:0:66237:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0410df000 : new rpc_count 0 00000020:00000040:2.0:1783952269.818901:0:66237:0:(genops.c:900:class_export_put()) PUTting export ffff97b0410df000 : new refcount 10 00000100:00080000:0.0:1783952269.819619:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1783952269.819625:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff97b167c13380) now 12 - evictor 00000100:00080000:0.0:1783952269.819629:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1783952269.819631:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff97b0468a4d40) now 16 - evictor 00010000:00010000:3.0:1783952269.856869:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1783952269.923552:0:94425:0:(genops.c:1231:class_import_get()) import ffff97b14f00d800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1783952269.923665:0:94425:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000092f13ca6] to pc [ptlrpcd_00_02+2] req@ffff97b14de2b480 x1870605465647488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952269.923721:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b14de2b480 x1870605465647488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952269.923736:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465647488:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1783952269.923764:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b14de2b480 x1870605465647488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952285 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952269.923772:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952269.923809:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b047acc000 x1870605465647488 msgsize 224 00000100:00100000:0.0:1783952269.923815:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952269.923837:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b14de2b480 x1870605465647488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952285 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952269.923851:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8258 usecs (9 jiffies) 00000100:00100000:3.0:1783952269.923903:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465647488 00000100:00100000:3.0:1783952269.923910:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465647488 00000020:00000040:3.0:1783952269.923913:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb601f 00000020:00000040:3.0:1783952269.923917:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b11800 refcount=5 00000020:00000040:3.0:1783952269.923928:0:8438:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:3.0:1783952269.923953:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1783952269.923979:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291 00000100:00000040:3.0:1783952269.923983:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b11800 : new rpc_count 1 00000100:00000040:3.0:1783952269.923989:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b047acc000 x1870605465647488/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:530/0 lens 224/0 e 0 to 0 dl 1783952280 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952269.924001:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b047acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465647488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952269.924029:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:3.0:1783952269.924051:0:8438:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968959, transno 0, xid 1870605465647488 00000100:00000040:3.0:1783952269.924061:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:3.0:1783952269.924066:0:8438:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783952269.924084:0:8438:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b14de2b480 x1870605465647488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783952269.924145:0:75701:0:(genops.c:1231:class_import_get()) import ffff97b048caf800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1783952269.924161:0:75701:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000faf7ae07] to pc [ptlrpcd_00_03+3] req@ffff97b144731500 x1870605465647616/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952269.931004:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1783952269.931015:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:1.0:1783952269.931036:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b144731500 x1870605465647616/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952269.931052:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465647616:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1783952269.931087:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b144731500 x1870605465647616/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952269.931095:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952269.931133:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff97b049ee6300 x1870605465647616 msgsize 224 00000100:00100000:1.0:1783952269.931137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952269.931179:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b144731500 x1870605465647616/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952269.931192:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1605101 usecs (1606 jiffies) 00000100:00100000:1.0:1783952269.931224:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465647616 00000100:00100000:1.0:1783952269.931232:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465647616 00000020:00000040:1.0:1783952269.931235:0:8444:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5faf 00000020:00000040:1.0:1783952269.931239:0:8444:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c5000 refcount=7 00000100:00000040:1.0:1783952269.931259:0:8444:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:3.0:1783952269.931609:0:8438:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:3.0:1783952269.931620:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b047acc000 x1870605465647488/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:530/0 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783952269.931630:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b047acc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465647488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7630us (7818us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952269.931639:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291 00000100:00000040:3.0:1783952269.931643:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b11800 : new rpc_count 0 00000020:00000040:3.0:1783952269.931655:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b11800 : new refcount 4 00000100:00100000:1.0:1783952269.931807:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00000040:1.0:1783952269.931811:0:8444:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c5000 : new rpc_count 1 00000100:00000040:1.0:1783952269.931816:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049ee6300 x1870605465647616/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:530/0 lens 224/0 e 0 to 0 dl 1783952280 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952269.931831:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465647616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783952269.931865:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00010000:00000040:1.0:1783952269.931875:0:8444:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870605465647616 00000100:00000040:1.0:1783952269.931884:0:8444:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:1.0:1783952269.931889:0:8444:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952269.931909:0:8444:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b144731500 x1870605465647616/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952269.931928:0:8444:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:1.0:1783952269.931933:0:8444:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee6300 x1870605465647616/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:530/0 lens 224/368 e 0 to 0 dl 1783952280 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952269.931942:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465647616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952269.931949:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00000040:1.0:1783952269.931951:0:8444:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c5000 : new rpc_count 0 00000020:00000040:1.0:1783952269.931957:0:8444:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c5000 : new refcount 6 00000100:00000040:1.0:1783952269.931984:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:1.0:1783952269.931998:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b144731500 x1870605465647616/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1783952269.932011:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352834 avail=317131 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023577 state=0: rc = 0 00000100:00000040:1.0:1783952269.932018:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b144731500 x1870605465647616/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952269.932026:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465647616:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1783952269.932031:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b144731500 x1870605465647616/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952269.932041:0:3645:0:(genops.c:1244:class_import_put()) import ffff97b048caf800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1783952269.933482:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968959 00000100:00000040:0.0:1783952269.933495:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b14de2b480 x1870605465647488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1783952269.933508:0:3644:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1783952269.933511:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1783952269.933521:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b14de2b480 x1870605465647488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952269.933541:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465647488:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1783952269.933548:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b14de2b480 x1870605465647488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952285 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952269.933569:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b14f00d800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:2.0:1783952270.883240:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1783952270.947072:0:75705:0:(genops.c:1231:class_import_get()) import ffff97b166f50000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1783952270.947111:0:75705:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000021a4d586] to pc [ptlrpcd_00_00+0] req@ffff97b174af4a80 x1870605465647744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952270.947201:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b174af4a80 x1870605465647744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783952270.947217:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465647744:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1783952270.947261:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b174af4a80 x1870605465647744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952286 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952270.947280:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783952270.947330:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff97b144730e00 x1870605465647744 msgsize 224 00000100:00100000:2.0:1783952270.947335:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783952270.947363:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b174af4a80 x1870605465647744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952286 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783952270.947397:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5533 usecs (6 jiffies) 00000100:00100000:0.0:1783952270.947538:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465647744 00000100:00100000:0.0:1783952270.947546:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465647744 00000020:00000040:0.0:1783952270.947558:0:8437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe7a 00000020:00000040:0.0:1783952270.947562:0:8437:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b143cde000 refcount=5 00000020:00000040:0.0:1783952270.947578:0:8437:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:0.0:1783952270.947626:0:8437:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1783952270.947654:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292 00000100:00000040:0.0:1783952270.947666:0:8437:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b143cde000 : new rpc_count 1 00000100:00000040:0.0:1783952270.947671:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b144730e00 x1870605465647744/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:531/0 lens 224/0 e 0 to 0 dl 1783952281 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952270.947683:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465647744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952270.947705:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1783952270.947714:0:8437:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870605465647744 00000100:00000040:0.0:1783952270.947724:0:8437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:0.0:1783952270.947728:0:8437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952270.947746:0:8437:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff97b174af4a80 x1870605465647744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952286 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952270.947764:0:8437:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:0.0:1783952270.947769:0:8437:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b144730e00 x1870605465647744/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:531/0 lens 224/368 e 0 to 0 dl 1783952281 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952270.947783:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465647744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952270.947790:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292 00000100:00000040:0.0:1783952270.947793:0:8437:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b143cde000 : new rpc_count 0 00000020:00000040:0.0:1783952270.947802:0:8437:0:(genops.c:900:class_export_put()) PUTting export ffff97b143cde000 : new refcount 4 00000100:00000040:0.0:1783952270.947833:0:3642:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:0.0:1783952270.947838:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b174af4a80 x1870605465647744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1783952270.947848:0:3642:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1783952270.947851:0:3642:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1783952270.947858:0:3642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174af4a80 x1870605465647744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952286 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952270.947865:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465647744:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1783952270.947871:0:3642:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b174af4a80 x1870605465647744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783952286 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952270.947880:0:3642:0:(genops.c:1244:class_import_put()) import ffff97b166f50000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00080000:2.0:1783952270.948380:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1783952270.948386:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:1.0:1783952271.456731:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.456755:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b1476fa000 refcount=4 obd=MGC192.168.202.148@tcp 00000100:00000040:1.0:1783952271.456784:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 75da5dc4-aa7e-42cf-a965-1b5f01232c6f->MGS req@ffff97b049ee4e00 x1870605465647872/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.456802:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000017ba8c20] to pc [ptlrpcd_00_01+1] req@ffff97b049ee4e00 x1870605465647872/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.456833:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.456839:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b046b43800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1783952271.456846:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff97b049ee6680 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.456856:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001f4005b2] to pc [ptlrpcd_00_02+2] req@ffff97b049ee6680 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.456873:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.456879:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b046a94800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1783952271.456885:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff97b049ee5f80 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.456910:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f1fd5f24] to pc [ptlrpcd_00_03+3] req@ffff97b049ee5f80 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.456918:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.456923:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b048caf800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1783952271.456931:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff97b049ee6d80 x1870605465648256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.456940:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004ce75983] to pc [ptlrpcd_00_00+0] req@ffff97b049ee6d80 x1870605465648256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952271.456948:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952271.456952:0:86521:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:1.0:1783952271.456955:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.456959:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b166f50000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783952271.456965:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff97b049ee7800 x1870605465648384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.456973:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009e259606] to pc [ptlrpcd_00_01+1] req@ffff97b049ee7800 x1870605465648384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.456982:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.456988:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b0410da800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1783952271.456994:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff97b049ee4a80 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.457003:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b36344cb] to pc [ptlrpcd_00_02+2] req@ffff97b049ee4a80 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.457022:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.457030:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b15036a000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1783952271.457038:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff97b049af7100 x1870605465648640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.457047:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000315d3d55] to pc [ptlrpcd_00_03+3] req@ffff97b049af7100 x1870605465648640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783952271.457054:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783952271.457058:0:86521:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:1.0:1783952271.457061:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.457065:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b14f00d800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1783952271.457070:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff97b049af6300 x1870605465648768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.457078:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000aa049c77] to pc [ptlrpcd_00_00+0] req@ffff97b049af6300 x1870605465648768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.457084:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.457089:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b176be7000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1783952271.457095:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff97b049af7800 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.457104:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003ff2c8f7] to pc [ptlrpcd_00_01+1] req@ffff97b049af7800 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.457111:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.457115:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b04e288000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1783952271.457127:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff97b049af6680 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.457136:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fed2d2a4] to pc [ptlrpcd_00_02+2] req@ffff97b049af6680 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.457142:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1783952271.457147:0:86521:0:(genops.c:1231:class_import_get()) import ffff97b0478e7000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:1.0:1783952271.457153:0:86521:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff97b049af5c00 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1783952271.457160:0:86521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000062cb90b7] to pc [ptlrpcd_00_03+3] req@ffff97b049af5c00 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.457171:0:86521:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 2 (3991) 00000100:00000040:1.0:1783952271.457189:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049ee5f80 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.457201:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465648128:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.457347:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049ee4e00 x1870605465647872/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.457356:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465647872:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.457372:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049ee4e00 x1870605465647872/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457380:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.457424:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b16588f450 x1870605465647872 msgsize 224 00000100:00100000:0.0:1783952271.457428:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952271.457436:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783952271.457458:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049ee4e00 x1870605465647872/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457486:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049ee7800 x1870605465648384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.457494:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465648384:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.457507:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049ee7800 x1870605465648384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457514:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.457529:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b174af4a80 x1870605465648384 msgsize 224 00000100:00100000:0.0:1783952271.457533:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952271.457558:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049ee7800 x1870605465648384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457569:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5521 usecs (6 jiffies) 00000100:00000040:0.0:1783952271.457574:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049af7800 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.457581:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465648896:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.457618:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049af7800 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457624:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.457638:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b174af6300 x1870605465648896 msgsize 224 00000100:00100000:0.0:1783952271.457642:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952271.457722:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049af7800 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457777:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 9362 usecs (10 jiffies) 00000100:00100000:0.0:1783952271.457792:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000040:0.0:1783952271.457796:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049ee6d80 x1870605465648256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.457816:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465648256:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.457828:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049ee6d80 x1870605465648256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457835:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.457849:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b174af5c00 x1870605465648256 msgsize 224 00000100:00100000:0.0:1783952271.457852:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952271.457866:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049ee6d80 x1870605465648256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457875:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1600657 usecs (1601 jiffies) 00000100:00000040:0.0:1783952271.457880:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049af6300 x1870605465648768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.457888:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465648768:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.457898:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049af6300 x1870605465648768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457904:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.457914:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff97b174af5880 x1870605465648768 msgsize 224 00000100:00100000:0.0:1783952271.457917:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952271.457928:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049af6300 x1870605465648768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457935:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8375 usecs (9 jiffies) 00000100:00000040:0.0:1783952271.457954:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049ee6680 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.457962:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465648000:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.457973:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049ee6680 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.457990:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.458003:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b174af4380 x1870605465648000 msgsize 224 00000100:00100000:0.0:1783952271.458007:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952271.458019:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049ee6680 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.458028:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8968 usecs (9 jiffies) 00000100:00000040:0.0:1783952271.458034:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049ee4a80 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.458041:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465648512:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.458055:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049ee4a80 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.458061:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.458071:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b174af6a00 x1870605465648512 msgsize 224 00000100:00100000:0.0:1783952271.458075:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952271.458087:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049ee4a80 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.458098:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 126432 usecs (127 jiffies) 00000100:00000040:0.0:1783952271.458103:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049af6680 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.458111:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465649024:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.458128:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049af6680 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.458135:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.458146:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff97b174af7b80 x1870605465649024 msgsize 224 00000100:00100000:0.0:1783952271.458150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783952271.458162:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049af6680 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.458182:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 16770 usecs (17 jiffies) 00000100:00100000:0.0:1783952271.458205:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465647872 00000100:00100000:0.0:1783952271.458213:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465647872 00000020:00000040:0.0:1783952271.458216:0:94410:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5f46 00000020:00000040:0.0:1783952271.458220:0:94410:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c4000 refcount=24 00000100:00000040:0.0:1783952271.458320:0:94410:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783952271.458350:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00000040:0.0:1783952271.458355:0:94410:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c4000 : new rpc_count 1 00000100:00000040:0.0:1783952271.458361:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b16588f450 x1870605465647872/t0(0) o400->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.458373:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465647872:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952271.458393:0:94410:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465647872 00000100:00000040:0.0:1783952271.458402:0:94410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:0.0:1783952271.458406:0:94410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.458423:0:94410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049ee4e00 x1870605465647872/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.458441:0:94410:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:0.0:1783952271.458446:0:94410:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b16588f450 x1870605465647872/t0(0) o400->75da5dc4-aa7e-42cf-a965-1b5f01232c6f@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.458455:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3643:x1870605465647872:12345-0@lo:400:kworker.0 Request processed in 84us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952271.458462:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00000040:0.0:1783952271.458465:0:94410:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c4000 : new rpc_count 0 00000020:00000040:0.0:1783952271.458474:0:94410:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c4000 : new refcount 23 00000100:00100000:0.0:1783952271.458499:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465648384 00000100:00100000:0.0:1783952271.458503:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465648384 00000020:00000040:0.0:1783952271.458504:0:26197:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafe7a 00000020:00000040:0.0:1783952271.458512:0:26197:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b143cde000 refcount=5 00000100:00100000:0.0:1783952271.458537:0:26197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465648768 00000100:00100000:0.0:1783952271.458541:0:26197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465648768 00000020:00000040:0.0:1783952271.458551:0:26197:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb601f 00000020:00000040:0.0:1783952271.458554:0:26197:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b11800 refcount=5 00000020:00000040:0.0:1783952271.458561:0:26197:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00100000:0.0:1783952271.458585:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00000040:0.0:1783952271.458608:0:26197:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b143cde000 : new rpc_count 1 00000100:00000040:0.0:1783952271.458612:0:26197:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174af4a80 x1870605465648384/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.458623:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465648384:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952271.458633:0:26197:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968945, transno 0, xid 1870605465648384 00000100:00000040:0.0:1783952271.458637:0:26197:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:0.0:1783952271.458640:0:26197:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.458723:0:26197:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049ee7800 x1870605465648384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.458738:0:26197:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:0.0:1783952271.458742:0:26197:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174af4a80 x1870605465648384/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.458750:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465648384:12345-0@lo:400:kworker.0 Request processed in 130us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952271.458757:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00000040:0.0:1783952271.458759:0:26197:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b143cde000 : new rpc_count 0 00000020:00000040:0.0:1783952271.458765:0:26197:0:(genops.c:900:class_export_put()) PUTting export ffff97b143cde000 : new refcount 4 00000100:00100000:0.0:1783952271.458774:0:26197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00000040:0.0:1783952271.458777:0:26197:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b11800 : new rpc_count 1 00000100:00000040:0.0:1783952271.458780:0:26197:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174af5880 x1870605465648768/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.458803:0:26197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465648768:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952271.458813:0:26197:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968959, transno 0, xid 1870605465648768 00000100:00000040:0.0:1783952271.458818:0:26197:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:0.0:1783952271.458821:0:26197:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.458836:0:26197:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049af6300 x1870605465648768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.458849:0:26197:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:0.0:1783952271.458853:0:26197:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174af5880 x1870605465648768/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.458862:0:26197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465648768:12345-0@lo:400:kworker.0 Request processed in 62us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952271.458868:0:26197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00000100:00000040:0.0:1783952271.458871:0:26197:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b11800 : new rpc_count 0 00000020:00000040:0.0:1783952271.458876:0:26197:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b11800 : new refcount 4 00000100:00100000:0.0:1783952271.458891:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465648896 00000100:00100000:0.0:1783952271.458894:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465648896 00000020:00000040:0.0:1783952271.458896:0:66236:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6161 00000020:00000040:0.0:1783952271.458899:0:66236:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f2800 refcount=5 00000100:00000040:0.0:1783952271.458909:0:66236:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1783952271.458924:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465648000 00000100:00100000:0.0:1783952271.458927:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465648000 00000020:00000040:0.0:1783952271.458929:0:66236:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6153 00000020:00000040:0.0:1783952271.458931:0:66236:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f6800 refcount=5 00000020:00000040:0.0:1783952271.458938:0:66236:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff97b0468a4d40) now 16 - evictor 00000100:00100000:0.0:1783952271.458953:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465648512 00000100:00100000:0.0:1783952271.458956:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465648512 00000020:00000040:0.0:1783952271.458957:0:66236:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb615a 00000020:00000040:0.0:1783952271.458959:0:66236:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b0497f7800 refcount=5 00000100:00100000:0.0:1783952271.458978:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465649024 00000100:00100000:0.0:1783952271.458981:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465649024 00000020:00000040:0.0:1783952271.458983:0:66236:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f61 00000020:00000040:0.0:1783952271.458985:0:66236:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b00800 refcount=5 00000100:00100000:0.0:1783952271.459000:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00000040:0.0:1783952271.459002:0:66236:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f2800 : new rpc_count 1 00000100:00000040:0.0:1783952271.459006:0:66236:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174af6300 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.459016:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465648896:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952271.459027:0:66236:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465648896 00000100:00000040:0.0:1783952271.459031:0:66236:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:0.0:1783952271.459034:0:66236:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.459050:0:66236:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049af7800 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.459062:0:66236:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:0.0:1783952271.459065:0:66236:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174af6300 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.459072:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1870605465648896:12345-0@lo:400:kworker.0 Request processed in 58us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952271.459077:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00000040:0.0:1783952271.459079:0:66236:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f2800 : new rpc_count 0 00000020:00000040:0.0:1783952271.459084:0:66236:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f2800 : new refcount 4 00000100:00100000:0.0:1783952271.459091:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00000040:0.0:1783952271.459093:0:66236:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f6800 : new rpc_count 1 00000100:00000040:0.0:1783952271.459095:0:66236:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174af4380 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.459104:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465648000:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952271.459119:0:66236:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465648000 00000100:00000040:0.0:1783952271.459123:0:66236:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:0.0:1783952271.459126:0:66236:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783952271.459140:0:66236:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049ee6680 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.459156:0:66236:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:0.0:1783952271.459161:0:66236:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174af4380 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.459168:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870605465648000:12345-0@lo:400:kworker.0 Request processed in 65us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952271.459174:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00000040:0.0:1783952271.459176:0:66236:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f6800 : new rpc_count 0 00000020:00000040:0.0:1783952271.459181:0:66236:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f6800 : new refcount 4 00000100:00100000:0.0:1783952271.459189:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00000040:0.0:1783952271.459190:0:66236:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b0497f7800 : new rpc_count 1 00000100:00000040:0.0:1783952271.459194:0:66236:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174af6a00 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.459203:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465648512:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1783952271.459210:0:66236:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465648512 00000100:00000040:0.0:1783952271.459214:0:66236:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:0.0:1783952271.459216:0:66236:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952271.459325:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049ee5f80 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.459335:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952271.459351:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff97b049af4000 x1870605465648128 msgsize 224 00000100:00100000:1.0:1783952271.459355:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952271.459363:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049ee5f80 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.459373:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8320 usecs (9 jiffies) 00000100:00000040:1.0:1783952271.459381:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049af7100 x1870605465648640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.459392:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465648640:0@lo:400:kworker.0 00000100:00000040:1.0:1783952271.459414:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049af7100 x1870605465648640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.459420:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952271.459431:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff97b049af4380 x1870605465648640 msgsize 224 00000100:00100000:1.0:1783952271.459435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952271.459448:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049af7100 x1870605465648640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.459457:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5780 usecs (6 jiffies) 00000100:00000040:1.0:1783952271.459463:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff97b049af5c00 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.459471:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465649152:0@lo:400:kworker.0 00000100:00000040:1.0:1783952271.459483:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff97b049af5c00 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.459489:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952271.459500:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff97b049af5500 x1870605465649152 msgsize 224 00000100:00100000:1.0:1783952271.459503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783952271.459509:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff97b049af5c00 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.459518:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 4842 usecs (5 jiffies) 00000100:00100000:1.0:1783952271.459552:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465648128 00000100:00100000:1.0:1783952271.459556:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465648128 00000020:00000040:1.0:1783952271.459558:0:68591:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bafef1 00000020:00000040:1.0:1783952271.459561:0:68591:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b174b32800 refcount=5 00000020:00000040:1.0:1783952271.459569:0:68591:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff97b167c13380) now 12 - evictor 00000100:00100000:1.0:1783952271.459601:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465649152 00000100:00100000:1.0:1783952271.459604:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465649152 00000020:00000040:1.0:1783952271.459605:0:68591:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb6f76 00000020:00000040:1.0:1783952271.459607:0:68591:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b176bcc000 refcount=5 00000100:00100000:1.0:1783952271.459624:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00000040:1.0:1783952271.459632:0:68591:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b00800 : new rpc_count 1 00000100:00000040:1.0:1783952271.459637:0:68591:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174af7b80 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.459648:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465649024:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952271.459727:0:68591:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465649024 00000100:00000040:1.0:1783952271.459733:0:68591:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 67 to 0@lo 00000100:00000040:1.0:1783952271.459737:0:68591:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952271.459754:0:68591:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049af6680 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.459768:0:68591:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:1.0:1783952271.459772:0:68591:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174af7b80 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.459779:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870605465649024:12345-0@lo:400:kworker.0 Request processed in 134us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952271.459785:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00000040:1.0:1783952271.459787:0:68591:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b00800 : new rpc_count 0 00000020:00000040:1.0:1783952271.459793:0:68591:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b00800 : new refcount 4 00000100:00100000:1.0:1783952271.459803:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00000040:1.0:1783952271.459805:0:68591:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b174b32800 : new rpc_count 1 00000100:00000040:1.0:1783952271.459809:0:68591:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049af4000 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.459820:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465648128:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952271.459828:0:68591:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465648128 00000100:00000040:1.0:1783952271.459833:0:68591:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 67 to 0@lo 00000100:00000040:1.0:1783952271.459836:0:68591:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952271.459850:0:68591:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049ee5f80 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.459878:0:68591:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:1.0:1783952271.459883:0:68591:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049af4000 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.459891:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870605465648128:12345-0@lo:400:kworker.0 Request processed in 73us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952271.459897:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00000040:1.0:1783952271.459900:0:68591:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b174b32800 : new rpc_count 0 00000020:00000040:1.0:1783952271.459906:0:68591:0:(genops.c:900:class_export_put()) PUTting export ffff97b174b32800 : new refcount 4 00000100:00100000:1.0:1783952271.459915:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00000040:1.0:1783952271.459917:0:68591:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b176bcc000 : new rpc_count 1 00000100:00000040:1.0:1783952271.459921:0:68591:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049af5500 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.459932:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465649152:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952271.459941:0:68591:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465649152 00000100:00000040:1.0:1783952271.459945:0:68591:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 67 to 0@lo 00000100:00000040:1.0:1783952271.459948:0:68591:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952271.459962:0:68591:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049af5c00 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.459974:0:68591:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:1.0:1783952271.459978:0:68591:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049af5500 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.459986:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870605465649152:12345-0@lo:400:kworker.0 Request processed in 56us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952271.459991:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00000040:1.0:1783952271.459993:0:68591:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b176bcc000 : new rpc_count 0 00000020:00000040:1.0:1783952271.460004:0:68591:0:(genops.c:900:class_export_put()) PUTting export ffff97b176bcc000 : new refcount 4 00000100:00100000:1.0:1783952271.460019:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465648256 00000100:00100000:1.0:1783952271.460023:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465648256 00000020:00000040:1.0:1783952271.460025:0:26467:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5faf 00000020:00000040:1.0:1783952271.460027:0:26467:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b1445c5000 refcount=7 00000100:00000040:1.0:1783952271.460039:0:26467:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1783952271.460055:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465648640 00000100:00100000:1.0:1783952271.460057:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465648640 00000020:00000040:1.0:1783952271.460059:0:26467:0:(genops.c:825:class_conn2export()) looking for export cookie 0x22c73c7857bb5fe7 00000020:00000040:1.0:1783952271.460061:0:26467:0:(lustre_handles.c:147:class_handle2object()) GET export ffff97b04965f000 refcount=5 00000100:00100000:1.0:1783952271.460079:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00000040:1.0:1783952271.460082:0:26467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b1445c5000 : new rpc_count 1 00000100:00000040:1.0:1783952271.460086:0:26467:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b174af5c00 x1870605465648256/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.460096:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465648256:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952271.460108:0:26467:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870605465648256 00000100:00000040:1.0:1783952271.460113:0:26467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 67 to 0@lo 00000100:00000040:1.0:1783952271.460116:0:26467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952271.460132:0:26467:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049ee6d80 x1870605465648256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.460144:0:26467:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:1.0:1783952271.460148:0:26467:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174af5c00 x1870605465648256/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.460155:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465648256:12345-0@lo:400:kworker.0 Request processed in 60us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952271.460161:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00000040:1.0:1783952271.460163:0:26467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b1445c5000 : new rpc_count 0 00000020:00000040:1.0:1783952271.460168:0:26467:0:(genops.c:900:class_export_put()) PUTting export ffff97b1445c5000 : new refcount 6 00000100:00100000:1.0:1783952271.460176:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00000040:1.0:1783952271.460184:0:26467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff97b04965f000 : new rpc_count 1 00000100:00000040:1.0:1783952271.460188:0:26467:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff97b049af4380 x1870605465648640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:532/0 lens 224/0 e 0 to 0 dl 1783952282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.460197:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465648640:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783952271.460206:0:26467:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870605465648640 00000100:00000040:1.0:1783952271.460210:0:26467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff97b142e66080 refcount 67 to 0@lo 00000100:00000040:1.0:1783952271.460213:0:26467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783952271.460226:0:26467:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049af7100 x1870605465648640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.460325:0:66236:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff97b049ee4a80 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.460343:0:66236:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 66 to 0@lo 00000100:00000040:0.0:1783952271.460348:0:66236:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b174af6a00 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.460367:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870605465648512:12345-0@lo:400:kworker.0 Request processed in 1165us (2293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952271.460373:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00000040:0.0:1783952271.460375:0:66236:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b0497f7800 : new rpc_count 0 00000020:00000040:0.0:1783952271.460381:0:66236:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f7800 : new refcount 4 00000100:00080000:0.0:1783952271.460428:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1783952271.460432:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff97b167c13380) now 12 - evictor 00000100:00080000:0.0:1783952271.460435:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1783952271.460437:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff97b0468a4d40) now 16 - evictor 00000100:00080000:0.0:1783952271.460440:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1783952271.460443:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff97b0465d0000) now 10 - evictor 00000100:00000040:0.0:1783952271.460479:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1783952271.460485:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049ee6680 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.460494:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee6680 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.460501:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1870605465648000:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.460514:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1783952271.460518:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049ee4a80 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.460525:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee4a80 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.460532:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870605465648512:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.460561:0:3644:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:0.0:1783952271.460566:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049af6680 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783952271.460581:0:3644:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049af6680 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952271.460604:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1870605465649024:0@lo:400:kworker.0 00000100:00000040:0.0:1783952271.460611:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049ee6680 x1870605465648000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952271.460621:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b046b43800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1783952271.460632:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049ee4a80 x1870605465648512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783952271.460642:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b0410da800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1783952271.460647:0:3644:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049af6680 x1870605465649024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.460748:0:26467:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff97b142e66080 refcount 65 to 0@lo 00000100:00000040:1.0:1783952271.460754:0:26467:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049af4380 x1870605465648640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:532/0 lens 224/224 e 0 to 0 dl 1783952282 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.460761:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870605465648640:12345-0@lo:400:kworker.0 Request processed in 566us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952271.460768:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00000040:1.0:1783952271.460770:0:26467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff97b04965f000 : new rpc_count 0 00000020:00000040:1.0:1783952271.460778:0:26467:0:(genops.c:900:class_export_put()) PUTting export ffff97b04965f000 : new refcount 4 00000100:00000040:1.0:1783952271.460808:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1783952271.460813:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049ee5f80 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.460822:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee5f80 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.460829:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1870605465648128:0@lo:400:kworker.0 00000100:00000040:1.0:1783952271.460840:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1783952271.460844:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049af7100 x1870605465648640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.460864:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049af7100 x1870605465648640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.460871:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1870605465648640:0@lo:400:kworker.0 00000100:00000040:1.0:1783952271.460884:0:3645:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:1.0:1783952271.460888:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049af5c00 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.460896:0:3645:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049af5c00 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.460903:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1870605465649152:0@lo:400:kworker.0 00000100:00000040:1.0:1783952271.460909:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049ee5f80 x1870605465648128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952271.460917:0:3645:0:(genops.c:1244:class_import_put()) import ffff97b046a94800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1783952271.460922:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049af7100 x1870605465648640/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952271.460929:0:3645:0:(genops.c:1244:class_import_put()) import ffff97b15036a000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1783952271.460935:0:3645:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049af5c00 x1870605465649152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952271.460942:0:3645:0:(genops.c:1244:class_import_put()) import ffff97b0478e7000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:1.0:1783952271.461207:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:1.0:1783952271.461214:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049ee6d80 x1870605465648256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.461223:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee6d80 x1870605465648256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.461242:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465648256:0@lo:400:kworker.0 00000100:00000040:1.0:1783952271.461264:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968959 00000100:00000040:1.0:1783952271.461269:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049af6300 x1870605465648768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.461277:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049af6300 x1870605465648768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.461283:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465648768:0@lo:400:kworker.0 00000100:00000040:1.0:1783952271.461296:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049ee4e00 x1870605465647872/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.461304:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee4e00 x1870605465647872/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.461311:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3643:1870605465647872:0@lo:400:kworker.0 00000100:00000040:1.0:1783952271.461322:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968945 00000100:00000040:1.0:1783952271.461325:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049ee7800 x1870605465648384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.461333:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049ee7800 x1870605465648384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.461340:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465648384:0@lo:400:kworker.0 00000100:00000040:1.0:1783952271.461351:0:3643:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1783952271.461356:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff97b049af7800 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783952271.461364:0:3643:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff97b049af7800 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952271.461371:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1870605465648896:0@lo:400:kworker.0 00000100:00000040:1.0:1783952271.461384:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049ee6d80 x1870605465648256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952271.461392:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b048caf800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1783952271.461400:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049af6300 x1870605465648768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952271.461407:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b14f00d800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1783952271.461411:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049ee4e00 x1870605465647872/t0(0) o400->MGC192.168.202.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952271.461418:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b1476fa000 refcount=3 obd=MGC192.168.202.148@tcp 00000100:00000040:1.0:1783952271.461422:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049ee7800 x1870605465648384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952271.461429:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b166f50000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783952271.461433:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff97b049af7800 x1870605465648896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783952287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783952271.461440:0:3643:0:(genops.c:1244:class_import_put()) import ffff97b176be7000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000040:0.0:1783952271.461482:0:3644:0:(genops.c:1244:class_import_put()) import ffff97b04e288000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00010000:00010000:0.0:1783952271.906061:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783952271.983036:0:96985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969018 is committed 00000001:00000040:1.0:1783952271.983048:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 39 00000020:00000040:1.0:1783952271.983053:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 43 00000001:00000040:1.0:1783952271.983062:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 38 00000020:00000040:1.0:1783952271.983064:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 42 00000001:00000040:1.0:1783952271.983069:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 37 00000020:00000040:1.0:1783952271.983071:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 41 00000001:00000040:1.0:1783952271.983078:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 36 00000020:00000040:1.0:1783952271.983080:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 40 00000001:00000040:1.0:1783952271.983085:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 35 00000020:00000040:1.0:1783952271.983087:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 39 00000001:00000040:1.0:1783952271.983090:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 34 00000020:00000040:1.0:1783952271.983092:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 38 00000001:00000040:1.0:1783952271.983107:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 33 00000020:00000040:1.0:1783952271.983109:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 37 00000001:00000040:1.0:1783952271.983113:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 32 00000020:00000040:1.0:1783952271.983115:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 36 00000001:00000040:1.0:1783952271.983120:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 31 00000020:00000040:1.0:1783952271.983122:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 35 00000001:00000040:1.0:1783952271.983127:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 30 00000020:00000040:1.0:1783952271.983128:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 34 00000001:00000040:1.0:1783952271.983132:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 29 00000020:00000040:1.0:1783952271.983134:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 33 00000001:00000040:1.0:1783952271.983138:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 28 00000020:00000040:1.0:1783952271.983139:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 32 00000001:00000040:1.0:1783952271.983144:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 27 00000020:00000040:1.0:1783952271.983146:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 31 00000001:00000040:1.0:1783952271.983153:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 26 00000020:00000040:1.0:1783952271.983155:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 30 00000001:00000040:1.0:1783952271.983170:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 25 00000020:00000040:1.0:1783952271.983172:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 29 00000001:00000040:1.0:1783952271.983176:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 24 00000020:00000040:1.0:1783952271.983177:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 28 00000001:00000040:1.0:1783952271.983190:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 23 00000020:00000040:1.0:1783952271.983192:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 27 00000001:00000040:1.0:1783952271.983197:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 22 00000020:00000040:1.0:1783952271.983199:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 26 00000001:00000040:1.0:1783952271.983204:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 21 00000020:00000040:1.0:1783952271.983206:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 25 00000001:00000040:1.0:1783952271.983210:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 20 00000020:00000040:1.0:1783952271.983213:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 24 00000001:00000040:1.0:1783952271.983217:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 19 00000020:00000040:1.0:1783952271.983218:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 23 00000001:00000040:1.0:1783952271.983342:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 18 00000020:00000040:1.0:1783952271.983345:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 22 00000001:00000040:1.0:1783952271.983349:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 17 00000020:00000040:1.0:1783952271.983350:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 21 00000001:00000040:1.0:1783952271.983354:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 16 00000020:00000040:1.0:1783952271.983355:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 20 00000001:00000040:1.0:1783952271.983359:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 15 00000020:00000040:1.0:1783952271.983361:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 19 00000001:00000040:1.0:1783952271.983364:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 14 00000020:00000040:1.0:1783952271.983366:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 18 00000001:00000040:1.0:1783952271.983369:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 13 00000020:00000040:1.0:1783952271.983370:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 17 00000001:00000040:1.0:1783952271.983373:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 12 00000020:00000040:1.0:1783952271.983375:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 16 00000001:00000040:1.0:1783952271.983378:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 11 00000020:00000040:1.0:1783952271.983380:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 15 00000001:00000040:1.0:1783952271.983383:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 10 00000020:00000040:1.0:1783952271.983385:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 14 00000001:00000040:1.0:1783952271.983388:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 9 00000020:00000040:1.0:1783952271.983389:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 13 00000001:00000040:1.0:1783952271.983392:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 8 00000020:00000040:1.0:1783952271.983394:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 12 00000001:00000040:1.0:1783952271.983396:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 7 00000020:00000040:1.0:1783952271.983398:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 11 00000001:00000040:1.0:1783952271.983402:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 6 00000020:00000040:1.0:1783952271.983403:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 10 00000001:00000040:1.0:1783952271.983406:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 5 00000020:00000040:1.0:1783952271.983408:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 9 00000001:00000040:1.0:1783952271.983411:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 4 00000020:00000040:1.0:1783952271.983413:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 8 00000001:00000040:1.0:1783952271.983425:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 3 00000020:00000040:1.0:1783952271.983427:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 7 00000001:00000040:1.0:1783952271.983430:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 2 00000020:00000040:1.0:1783952271.983432:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 6 00000001:00000040:1.0:1783952271.983435:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 1 00000020:00000040:1.0:1783952271.983438:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 5 00000001:00000040:1.0:1783952271.983442:0:96985:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff97b0497f3000 : new cb_count 0 00000020:00000040:1.0:1783952271.983443:0:96985:0:(genops.c:900:class_export_put()) PUTting export ffff97b0497f3000 : new refcount 4 00010000:00010000:3.0:1783952272.928930:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783952273.316021:0:97342:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1783952273.508661:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952273.508668:0:86521:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1783952273.508686:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952273.508689:0:86521:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1783952273.508736:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465649280:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.508808:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.508844:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465649792:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.508869:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.508889:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465650304:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.508913:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.508938:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783952273.508953:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465649408:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.508978:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.508995:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465649920:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509015:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.509031:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465650432:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509053:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.509078:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465649536:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509099:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.509115:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465650048:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.509154:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b1775a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465650560:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509178:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.509194:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783952273.509201:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465649664:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509222:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.509239:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465650176:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509258:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952273.509286:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465649280 00000100:00100000:3.0:1783952273.509292:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465649280 00000100:00100000:3.0:1783952273.509337:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783952273.509346:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465649280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509391:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3642:x1870605465649280:12345-0@lo:400:kworker.0 Request processed in 46us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.509398:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783952273.509427:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465649792 00000100:00100000:3.0:1783952273.509435:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465649792 00000100:00100000:3.0:1783952273.509465:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465650176 00000100:00100000:3.0:1783952273.509467:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465650176 00000100:00100000:3.0:1783952273.509488:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:3.0:1783952273.509494:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465649792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509538:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1870605465649792:12345-0@lo:400:kworker.0 Request processed in 32us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.509544:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:3.0:1783952273.509556:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:3.0:1783952273.509562:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465650176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509611:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465650176:12345-0@lo:400:kworker.0 Request processed in 50us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.509617:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00100000:3.0:1783952273.509634:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465650304 00000100:00100000:3.0:1783952273.509638:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465650304 00000100:00100000:3.0:1783952273.509656:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465649408 00000100:00100000:3.0:1783952273.509658:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465649408 00000100:00100000:3.0:1783952273.509669:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465649920 00000100:00100000:3.0:1783952273.509671:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465649920 00000100:00100000:3.0:1783952273.509679:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465650432 00000100:00100000:3.0:1783952273.509682:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465650432 00000100:00100000:3.0:1783952273.509693:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465649536 00000100:00100000:3.0:1783952273.509696:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465649536 00000100:00100000:3.0:1783952273.509707:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465650560 00000100:00100000:3.0:1783952273.509709:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465650560 00000100:00100000:3.0:1783952273.509722:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1783952273.509727:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465650304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509756:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1870605465650304:12345-0@lo:400:kworker.0 Request processed in 28us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.509771:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1783952273.509782:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1783952273.509788:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465649408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509816:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1870605465649408:12345-0@lo:400:kworker.0 Request processed in 28us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.509820:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1783952273.509830:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:3.0:1783952273.509835:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465649920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509859:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1870605465649920:12345-0@lo:400:kworker.0 Request processed in 24us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.509864:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:3.0:1783952273.509874:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1783952273.509880:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b04b16d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465650432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.509902:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b04b16d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1870605465650432:12345-0@lo:400:kworker.0 Request processed in 23us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.509908:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1783952273.511172:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:3.0:1783952273.511185:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465649536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.511235:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870605465649536:12345-0@lo:400:kworker.0 Request processed in 55us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.511241:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:3.0:1783952273.511255:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:3.0:1783952273.511261:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465650560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.511290:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870605465650560:12345-0@lo:400:kworker.0 Request processed in 28us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.511305:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:3.0:1783952273.511345:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465650048 00000100:00100000:3.0:1783952273.511352:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465650048 00000100:00100000:3.0:1783952273.511380:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465649664 00000100:00100000:3.0:1783952273.511383:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465649664 00000100:00100000:3.0:1783952273.511399:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:3.0:1783952273.511405:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465650048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.511440:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465650048:12345-0@lo:400:kworker.0 Request processed in 34us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.511446:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000100:00100000:3.0:1783952273.511457:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:3.0:1783952273.511463:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b1775a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465649664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.511490:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b1775a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465649664:12345-0@lo:400:kworker.0 Request processed in 27us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.511496:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00000100:00100000:3.0:1783952273.516543:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1870605465649408:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.516564:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1870605465649920:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.516576:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1870605465650432:0@lo:400:kworker.0 00000100:00080000:0.0:1783952273.516656:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783952273.516662:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783952273.516665:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952273.516699:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3642:1870605465649280:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.516715:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1870605465649792:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.516726:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1870605465650304:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.516777:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465649664:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.516806:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465650176:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.516817:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1870605465649536:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.516826:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465650048:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.516836:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b1775a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1870605465650560:0@lo:400:kworker.0 00000100:00100000:3.0:1783952273.837420:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952273.837466:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952273.837508:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952273.837550:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952273.837571:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447849728 00000100:00100000:1.0:1783952273.837571:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447849856 00000100:00100000:3.0:1783952273.837580:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447849728 00000100:00100000:1.0:1783952273.837580:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447849856 00000100:00100000:1.0:1783952273.837646:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447849984 00000100:00100000:1.0:1783952273.837649:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447849984 00000100:00100000:3.0:1783952273.837650:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 218 00000100:00100000:3.0:1783952273.837659:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2399:x1870605447849728:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952273.837669:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1517 00000100:00100000:1.0:1783952273.837676:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2399:x1870605447849856:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952273.837743:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2399:x1870605447849728:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.837763:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 218 00000100:00100000:3.0:1783952273.837800:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1518 00000100:00100000:3.0:1783952273.837808:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447849984:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952273.838985:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447850112 00000100:00100000:2.0:1783952273.838994:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447850112 00000100:00100000:2.0:1783952273.839046:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2943 00000100:00100000:2.0:1783952273.839055:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dedbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447850112:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1783952273.846349:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2399:x1870605447849856:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 8660us (8925us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952273.846365:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1517 00000100:00080000:1.0:1783952273.846413:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783952273.846419:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952273.846422:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783952273.846424:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2399:x1870605447849984:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 8615us (8871us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952273.846433:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1518 00000100:00100000:2.0:1783952273.846615:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dedbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2399:x1870605447850112:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 7559us (9146us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952273.846624:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2943 00010000:00010000:3.0:1783952273.955868:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783952274.365537:0:97395:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783952274.366186:0:97395:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783952274.529008:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952274.529032:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465650688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783952274.529080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952274.529116:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465650688 00000100:00100000:3.0:1783952274.529123:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465650688 00000100:00100000:3.0:1783952274.529163:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:3.0:1783952274.529172:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465650688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952274.529208:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:3.0:1783952274.529245:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465650688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952274.529252:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:3.0:1783952274.529295:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465650688:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783952274.976956:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952275.043716:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783952275.043743:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465650816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783952275.043811:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952275.043861:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465650816 00000100:00100000:2.0:1783952275.043868:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465650816 00000100:00100000:2.0:1783952275.043914:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1783952275.043922:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465650816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952275.043956:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:2.0:1783952275.043999:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465650816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952275.044006:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1783952275.044075:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465650816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952275.045569:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783952275.045674:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465650944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783952275.045733:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952275.045780:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465650944 00000100:00100000:3.0:1783952275.045787:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465650944 00000100:00100000:3.0:1783952275.045840:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293 00000100:00100000:3.0:1783952275.045848:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465650944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952275.045878:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952275.045917:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465650944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952275.045924:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293 00000100:00080000:3.0:1783952275.045941:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952275.045972:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465650944:0@lo:13:osp-pre-1-0.0 00000020:00000004:3.0:1783952275.387734:0:97445:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783952275.387984:0:97445:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783952276.001353:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783952276.068779:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b174af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465651072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783952276.068874:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952276.069092:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465651072 00000100:00100000:0.0:1783952276.069099:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465651072 00000100:00100000:0.0:1783952276.069169:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294 00000100:00100000:0.0:1783952276.069181:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14deda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465651072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952276.069216:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952276.069264:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14deda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465651072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952276.069277:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294 00000100:00100000:0.0:1783952276.069328:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b174af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465651072:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783952276.069541:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783952277.032728:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783952278.051658:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952278.624748:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465651200:0@lo:400:kworker.0 00000100:00100000:1.0:1783952278.624819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952278.627839:0:94415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465651200 00000100:00100000:0.0:1783952278.627855:0:94415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465651200 00000100:00100000:0.0:1783952278.627932:0:94415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783952278.627942:0:94415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465651200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952278.629650:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465651456:0@lo:400:kworker.0 00000100:00100000:2.0:1783952278.629708:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952278.629746:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783952278.629753:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dedad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465651328:0@lo:400:kworker.0 00000100:00100000:2.0:1783952278.629777:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952278.629809:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465651584:0@lo:400:kworker.0 00000100:00100000:2.0:1783952278.630182:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783952278.630325:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952278.630331:0:86521:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1783952278.630357:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465651456 00000100:00100000:3.0:1783952278.630364:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465651456 00000100:00100000:3.0:1783952278.630425:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465651328 00000100:00100000:3.0:1783952278.630429:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465651328 00000100:00100000:3.0:1783952278.630452:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:3.0:1783952278.630461:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465651456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.630530:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1870605465651456:12345-0@lo:400:kworker.0 Request processed in 69us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952278.630536:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00100000:3.0:1783952278.630556:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:3.0:1783952278.630562:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465651328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.630612:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1870605465651328:12345-0@lo:400:kworker.0 Request processed in 50us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952278.630618:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:3.0:1783952278.630639:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465651584 00000100:00100000:3.0:1783952278.630643:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465651584 00000100:00100000:3.0:1783952278.630665:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:3.0:1783952278.630670:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465651584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.630703:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1870605465651584:12345-0@lo:400:kworker.0 Request processed in 33us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952278.630708:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000100:00100000:3.0:1783952278.630757:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465651584:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.630780:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dedad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1870605465651328:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.630789:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1870605465651456:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.630913:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952278.630923:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465651712:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.630954:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952278.631065:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952278.631076:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465651840:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.631102:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783952278.631135:0:86521:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952278.631139:0:86521:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1783952278.631148:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465651968:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.631171:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952278.631198:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465651968 00000100:00100000:3.0:1783952278.631203:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465651968 00000100:00100000:3.0:1783952278.631228:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:3.0:1783952278.631234:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465651968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.631270:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465651968:12345-0@lo:400:kworker.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952278.631275:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:3.0:1783952278.631303:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465651968:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.631333:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465652096:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.631356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952278.631395:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783952278.631409:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465652224:0@lo:400:kworker.0 00000100:00100000:0.0:1783952278.631421:0:94415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3645:x1870605465651200:12345-0@lo:400:kworker.0 Request processed in 3480us (6600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952278.631429:0:94415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783952278.631432:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952278.631454:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465651840 00000100:00100000:3.0:1783952278.631457:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465651840 00000100:00100000:3.0:1783952278.631517:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465652224 00000100:00100000:3.0:1783952278.631520:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465652224 00000100:00100000:3.0:1783952278.631538:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:3.0:1783952278.631543:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465651840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.631576:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1870605465651840:12345-0@lo:400:kworker.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952278.631582:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:3.0:1783952278.631616:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:3.0:1783952278.631622:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465652224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.631651:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465652224:12345-0@lo:400:kworker.0 Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952278.631656:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:3.0:1783952278.631683:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465652224:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.631703:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1870605465651840:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.631734:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783952278.631740:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465652352:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.631762:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952278.631781:0:66236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465652352 00000100:00100000:3.0:1783952278.631784:0:66236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465652352 00000100:00100000:3.0:1783952278.631804:0:66236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:3.0:1783952278.631810:0:66236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14ded9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465652352:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783952278.631943:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783952278.631947:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952278.632106:0:66236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14ded9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1870605465652352:12345-0@lo:400:kworker.0 Request processed in 295us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952278.632121:0:66236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:3.0:1783952278.632176:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783952278.632184:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465652480:0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.632212:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952278.632237:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465652480 00000100:00100000:3.0:1783952278.632240:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465652480 00000100:00100000:3.0:1783952278.632268:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1783952278.632274:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465652480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952278.632306:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465652480:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952278.632311:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1783952278.632334:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465652480:0@lo:400:kworker.0 00000100:00080000:3.0:1783952278.632345:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783952278.632422:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3645:1870605465651200:0@lo:400:kworker.0 00000100:00100000:1.0:1783952278.632453:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465651712 00000100:00100000:1.0:1783952278.632456:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465651712 00000100:00100000:1.0:1783952278.632500:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465652096 00000100:00100000:1.0:1783952278.632504:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465652096 00000100:00100000:1.0:1783952278.632525:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944 00000100:00100000:1.0:1783952278.632540:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465651712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952278.632581:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465651712:12345-0@lo:400:kworker.0 Request processed in 43us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952278.632610:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944 00000100:00100000:0.0:1783952278.632616:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465651712:0@lo:400:kworker.0 00000100:00100000:1.0:1783952278.632622:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945 00000100:00100000:1.0:1783952278.632629:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14dedb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465652096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952278.632671:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14dedb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465652096:12345-0@lo:400:kworker.0 Request processed in 43us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952278.632676:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945 00000100:00080000:1.0:1783952278.632702:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952278.634313:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465652096:0@lo:400:kworker.0 00000100:00100000:2.0:1783952278.635269:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1870605465652352:0@lo:400:kworker.0 00000100:00100000:3.0:1783952279.021080:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952279.021126:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952279.021161:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952279.021200:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952279.021232:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447850624 00000100:00100000:3.0:1783952279.021242:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447850624 00000100:00100000:2.0:1783952279.021272:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447850496 00000100:00100000:2.0:1783952279.021276:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447850496 00000100:00100000:3.0:1783952279.021301:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2946 00000100:00100000:2.0:1783952279.021304:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447850368 00000100:00100000:2.0:1783952279.021306:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447850368 00000100:00100000:3.0:1783952279.021311:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447850624:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952279.021324:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1525 00000100:00100000:2.0:1783952279.021329:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2400:x1870605447850496:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952279.021386:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2400:x1870605447850496:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 56us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952279.021394:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1525 00000100:00100000:2.0:1783952279.021421:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1526 00000100:00100000:0.0:1783952279.021427:0:94410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447850240 00000100:00100000:2.0:1783952279.021428:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b177317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2400:x1870605447850368:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952279.021430:0:94410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447850240 00000100:00080000:1.0:1783952279.021532:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783952279.021537:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783952279.021539:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952279.021879:0:94410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 220 00000100:00100000:0.0:1783952279.021890:0:94410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447850240:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952279.022343:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447850624:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 1032us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952279.022351:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2946 00000100:00100000:2.0:1783952279.029334:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b177317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2400:x1870605447850368:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 6375us (6641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952279.029358:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1526 00000100:00100000:0.0:1783952279.038159:0:94410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b16588d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447850240:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 16259us (17076us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952279.038176:0:94410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 220 00010000:00010000:1.0:1783952279.073109:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952279.648937:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465652608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952279.649059:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952279.649351:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465652608 00000100:00100000:3.0:1783952279.649381:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465652608 00000100:00100000:3.0:1783952279.649466:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:3.0:1783952279.649487:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465652608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952279.649538:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:3.0:1783952279.653130:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465652608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3636us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952279.653145:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:0.0:1783952279.654344:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465652608:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783952280.096951:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783952280.161162:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783952280.161196:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b144730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465652864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952280.161277:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783952280.161300:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952280.161308:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465652736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783952280.161374:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465652864 00000100:00100000:2.0:1783952280.161385:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465652864 00000100:00100000:2.0:1783952280.161570:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:2.0:1783952280.161581:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465652864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952280.161659:0:8444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:2.0:1783952280.169171:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465652864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7576us (7856us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952280.169209:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:3.0:1783952280.172308:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b144730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465652864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783952280.173140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952280.173355:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465652736 00000100:00100000:3.0:1783952280.173369:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465652736 00000100:00100000:3.0:1783952280.173650:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295 00000100:00100000:3.0:1783952280.173664:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465652736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783952280.173714:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783952280.173826:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465652736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952280.173833:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295 00000100:00100000:2.0:1783952280.176559:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465652736:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783952280.180996:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783952281.134698:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952281.193801:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465652992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783952281.193910:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952281.193996:0:11087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465652992 00000100:00100000:0.0:1783952281.194005:0:11087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465652992 00000100:00100000:0.0:1783952281.194085:0:11087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296 00000100:00100000:0.0:1783952281.194096:0:11087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465652992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783952281.194134:0:11087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783952281.194188:0:11087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465652992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952281.194196:0:11087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296 00000100:00080000:0.0:1783952281.194221:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952281.194264:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465652992:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1783952281.706385:0:97638:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg248-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:3.0:1783952282.144948:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783952283.168962:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783952283.351725:0:97686:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00000100:00080000:3.0:1783952283.744895:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952283.744904:0:40998:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1783952283.744927:0:40998:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783952283.744931:0:40998:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1783952283.744989:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14deda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465653504:0@lo:400:kworker.0 00000100:00100000:3.0:1783952283.745086:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952283.745261:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465653376:0@lo:400:kworker.0 00000100:00100000:0.0:1783952283.745300:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952283.745357:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465653504 00000100:00100000:0.0:1783952283.745367:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465653504 00000100:00100000:0.0:1783952283.745445:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:0.0:1783952283.745456:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465653504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952283.745517:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1870605465653504:12345-0@lo:400:kworker.0 Request processed in 63us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952283.745524:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00000100:00100000:2.0:1783952283.745693:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465653120:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.745738:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952283.745784:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14dedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465653248:0@lo:400:kworker.0 00000100:00100000:1.0:1783952283.745825:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952283.745872:0:67035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465653376 00000100:00100000:2.0:1783952283.745874:0:66237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465653248 00000100:00100000:1.0:1783952283.745878:0:67035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465653376 00000100:00100000:2.0:1783952283.745880:0:66237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465653248 00000100:00100000:0.0:1783952283.745936:0:94411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465653120 00000100:00100000:1.0:1783952283.745940:0:67035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:1.0:1783952283.745949:0:67035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465653376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783952283.745957:0:94411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465653120 00000100:00100000:0.0:1783952283.745991:0:94411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1783952283.746002:0:67035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1870605465653376:12345-0@lo:400:kworker.0 Request processed in 52us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952283.746002:0:94411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465653120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952283.746018:0:67035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:0.0:1783952283.746052:0:94411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75da5dc4-aa7e-42cf-a965-1b5f01232c6f+24:3644:x1870605465653120:12345-0@lo:400:kworker.0 Request processed in 54us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952283.746122:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14deda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465653504:0@lo:400:kworker.0 00000100:00100000:3.0:1783952283.746149:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465654016:0@lo:400:kworker.0 00000100:00100000:3.0:1783952283.746182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952283.746234:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465654016 00000100:00100000:3.0:1783952283.746249:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465654016 00000100:00100000:0.0:1783952283.746380:0:94411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783952283.746462:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1870605465653376:0@lo:400:kworker.0 00000100:00100000:0.0:1783952283.746469:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465653888:0@lo:400:kworker.0 00000100:00100000:0.0:1783952283.746496:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952283.746516:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465654400:0@lo:400:kworker.0 00000100:00100000:0.0:1783952283.746540:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783952283.746579:0:68591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465654400 00000100:00100000:0.0:1783952283.746583:0:68591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465654400 00000100:00100000:2.0:1783952283.752311:0:66237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:2.0:1783952283.752342:0:66237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465653248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.752467:0:66237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870605465653248:12345-0@lo:400:kworker.0 Request processed in 134us (6641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952283.752476:0:66237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:2.0:1783952283.752536:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14dedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1870605465653248:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.752563:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465653760:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.752633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952283.752661:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465654272:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.752701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952283.752745:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465653760 00000100:00100000:2.0:1783952283.752752:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465653760 00000100:00100000:2.0:1783952283.752778:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465654272 00000100:00100000:2.0:1783952283.752782:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465654272 00000100:00100000:2.0:1783952283.752806:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1783952283.752812:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465653760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.752848:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870605465653760:12345-0@lo:400:kworker.0 Request processed in 36us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952283.752855:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1783952283.752867:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:2.0:1783952283.752874:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465654272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.752902:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870605465654272:12345-0@lo:400:kworker.0 Request processed in 28us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952283.752908:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:2.0:1783952283.752951:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75da5dc4-aa7e-42cf-a965-1b5f01232c6f:3644:1870605465653120:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.752959:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14ded8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465653632:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.752986:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952283.753006:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465654144:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.753025:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783952283.753055:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465653632 00000100:00100000:2.0:1783952283.753059:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465653632 00000100:00100000:2.0:1783952283.753090:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:2.0:1783952283.753096:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465653632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.753130:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1870605465653632:12345-0@lo:400:kworker.0 Request processed in 35us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952283.753143:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000100:00100000:2.0:1783952283.753163:0:66238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465654144 00000100:00100000:2.0:1783952283.753167:0:66238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465654144 00000100:00100000:2.0:1783952283.753186:0:66238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1783952283.753192:0:66238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465654144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.753221:0:66238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870605465654144:12345-0@lo:400:kworker.0 Request processed in 29us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952283.753226:0:66238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1783952283.753257:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14ded8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1870605465653632:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.753266:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870605465654144:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.753290:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870605465653760:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.753299:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1870605465654272:0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.753337:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465653888 00000100:00100000:2.0:1783952283.753341:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465653888 00000100:00100000:2.0:1783952283.753369:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:2.0:1783952283.753374:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465653888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783952283.753420:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1870605465653888:12345-0@lo:400:kworker.0 Request processed in 46us (6923us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952283.753426:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00000100:00100000:2.0:1783952283.753477:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1870605465653888:0@lo:400:kworker.0 00000100:00080000:1.0:1783952283.754749:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952283.754780:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:3.0:1783952283.754797:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465654016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783952283.754879:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465654016:12345-0@lo:400:kworker.0 Request processed in 89us (8696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952283.754886:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:0.0:1783952283.755673:0:68591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:0.0:1783952283.755689:0:68591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465654400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783952283.755745:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465654016:0@lo:400:kworker.0 00000100:00100000:0.0:1783952283.755764:0:68591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1870605465654400:12345-0@lo:400:kworker.0 Request processed in 79us (9220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952283.755774:0:68591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:0.0:1783952283.755835:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1870605465654400:0@lo:400:kworker.0 00000100:00080000:3.0:1783952283.756024:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783952283.756030:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783952284.174618:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952284.174985:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952284.175018:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952284.175064:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1783952284.175112:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447851136 00000100:00100000:2.0:1783952284.175140:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447851136 00000100:00100000:2.0:1783952284.175221:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2949 00000100:00100000:2.0:1783952284.175235:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447851136:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1783952284.175703:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d33551be-a709-4ba2-a74c-f4d7b53c6817+7:2400:x1870605447851136:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 469us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952284.175713:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2949 00000100:00100000:3.0:1783952284.175768:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447851008 00000100:00100000:3.0:1783952284.175773:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447851008 00000100:00100000:3.0:1783952284.175823:0:83761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447850880 00000100:00100000:3.0:1783952284.175827:0:83761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447850880 00000100:00100000:3.0:1783952284.175851:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1533 00000100:00100000:3.0:1783952284.175858:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2400:x1870605447851008:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952284.175894:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2400:x1870605447851008:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 37us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952284.175901:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1533 00000100:00100000:3.0:1783952284.175915:0:83761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1534 00000100:00100000:3.0:1783952284.175921:0:83761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2400:x1870605447850880:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1783952284.175947:0:83761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d33551be-a709-4ba2-a74c-f4d7b53c6817+51:2400:x1870605447850880:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952284.175953:0:83761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1534 00000100:00080000:3.0:1783952284.175986:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783952284.175991:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783952284.175994:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783952284.177670:0:94412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447850752 00000100:00100000:0.0:1783952284.177809:0:94412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447850752 00000100:00100000:0.0:1783952284.177890:0:94412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 222 00000100:00100000:0.0:1783952284.177902:0:94412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447850752:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1783952284.178008:0:94412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e617e28a-7c0f-459e-8765-f628898cec50+10:2400:x1870605447850752:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 109us (4883us total) trans 0 rc 0/0 00000100:00100000:0.0:1783952284.178036:0:94412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 222 00000100:00100000:2.0:1783952284.196788:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952284.197085:0:11961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447851264 00000100:00100000:3.0:1783952284.197099:0:11961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447851264 00000100:00100000:3.0:1783952284.197182:0:11961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2950 00000100:00100000:3.0:1783952284.197195:0:11961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b144730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447851264:12345-192.168.202.48@tcp:8:ptlrpcd_rcv.0 00010000:02000400:3.0:1783952284.197244:0:11961:0:(ldlm_lib.c:976:target_handle_reconnect()) lustre-OST0000: Client d33551be-a709-4ba2-a74c-f4d7b53c6817 (at 192.168.202.48@tcp) reconnected, waiting for 3 clients in recovery for 1:25 00010000:00010000:0.0:1783952284.200257:0:15262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1783952284.227899:0:11961:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp recovering/t4294968979 exp ffff97b0497f3000 cur 3999 last 1783952284 00002000:00100000:3.0:1783952284.227930:0:11961:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d33551be-a709-4ba2-a74c-f4d7b53c6817/ffff97b0497f3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783952284.227959:0:11961:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.202.48@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1783952284.227996:0:11961:0:(import.c:65:import_set_state_nolock()) ffff97b176f08800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1783952284.228010:0:11961:0:(import.c:65:import_set_state_nolock()) ffff97b176f08800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783952284.228122:0:11961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b144730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447851264:12345-192.168.202.48@tcp:8:ptlrpcd_rcv.0 Request processed in 30927us (31347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952284.228136:0:11961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2950 00000100:00100000:1.0:1783952284.270130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1783952284.270312:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447851392 00000100:00100000:0.0:1783952284.270326:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447851392 00000100:00100000:0.0:1783952284.270455:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5057 00000100:00100000:0.0:1783952284.270468:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447851392:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1783952284.270498:0:26206:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049af5c00 x1870605447851392/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783952284.270531:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d33551be-a709-4ba2-a74c-f4d7b53c6817+5:2397:x1870605447851392:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 66us (415us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783952284.270538:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5057 00010000:00080000:2.0:1783952284.270692:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783952284.270705:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049af5c00 x1870605447851392/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783952284.270715:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1783952284.270728:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1783952284.270814:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952284.270925:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952284.270960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952284.270991:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447851520 00000100:00100000:1.0:1783952284.270992:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952284.270998:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447851520 00000100:00100000:1.0:1783952284.271023:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952284.271035:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447851648 00000100:00100000:3.0:1783952284.271039:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447851648 00000100:00100000:1.0:1783952284.271051:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1783952284.271157:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1783952284.272714:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447851776 00000100:00100000:3.0:1783952284.272729:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447851776 00000100:00100000:1.0:1783952284.272924:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447851904 00000100:00100000:1.0:1783952284.272930:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447851904 00000100:00100000:1.0:1783952284.272961:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447852032 00000100:00100000:1.0:1783952284.272965:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447852032 00000100:00100000:1.0:1783952284.272984:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447852160 00000100:00100000:1.0:1783952284.272987:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447852160 00000100:00100000:1.0:1783952284.273004:0:26196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605447852288 00000100:00100000:1.0:1783952284.273007:0:26196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605447852288 00000100:00100000:1.0:1783952284.273033:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5058 00000100:00100000:1.0:1783952284.273044:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b17738f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447851520:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1783952284.273068:0:26196:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b17738f850 x1870605447851520/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952284.273088:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b17738f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447851520:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 48us (2275us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952284.273095:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5058 00000100:00100000:1.0:1783952284.273106:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5059 00000100:00100000:1.0:1783952284.273112:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447851648:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1783952284.273445:0:26196:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049af7100 x1870605447851648/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952284.273457:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447851648:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 346us (2534us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952284.273463:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5059 00000100:00100000:1.0:1783952284.273474:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5060 00000100:00100000:1.0:1783952284.273482:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447851776:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1783952284.273490:0:26196:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049af5f80 x1870605447851776/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952284.273498:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447851776:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 19us (2539us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952284.273502:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5060 00000100:00100000:1.0:1783952284.273509:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5061 00000100:00100000:1.0:1783952284.273515:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447851904:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1783952284.273522:0:26196:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049af7480 x1870605447851904/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952284.273621:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447851904:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 107us (2630us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952284.273752:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5061 00000100:00100000:1.0:1783952284.273763:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5062 00000100:00100000:1.0:1783952284.273771:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447852032:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1783952284.273780:0:26196:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049af6d80 x1870605447852032/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952284.273800:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447852032:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 31us (2778us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952284.273806:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5062 00000100:00100000:1.0:1783952284.273815:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5063 00000100:00100000:1.0:1783952284.273891:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447852160:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1783952284.273901:0:26196:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049af4e00 x1870605447852160/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952284.273910:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447852160:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 91us (2861us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952284.273916:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5063 00000100:00100000:1.0:1783952284.273925:0:26196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5064 00000100:00100000:1.0:1783952284.273932:0:26196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447852288:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1783952284.273939:0:26196:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff97b049af5880 x1870605447852288/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783952284.273946:0:26196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d33551be-a709-4ba2-a74c-f4d7b53c6817+11:2397:x1870605447852288:12345-192.168.202.48@tcp:101:ldlm_lock_repla.0 Request processed in 16us (2790us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783952284.273951:0:26196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5064 00010000:00080000:1.0:1783952284.274043:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783952284.274053:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b17738f850 x1870605447851520/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783952284.274062:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1783952284.274077:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783952284.274085:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783952284.274090:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049af7100 x1870605447851648/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783952284.274097:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1783952284.274103:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783952284.274104:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783952284.274108:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049af5f80 x1870605447851776/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783952284.274115:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1783952284.274118:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783952284.274120:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783952284.274124:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049af7480 x1870605447851904/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783952284.274129:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1783952284.274134:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783952284.274136:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783952284.274139:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049af6d80 x1870605447852032/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783952284.274247:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1783952284.274262:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783952284.274264:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783952284.274269:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049af4e00 x1870605447852160/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783952284.274275:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1783952284.274279:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783952284.274281:0:97001:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783952284.274284:0:97001:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.48@tcp: req@ffff97b049af5880 x1870605447852288/t0(0) o101->d33551be-a709-4ba2-a74c-f4d7b53c6817@192.168.202.48@tcp:545/0 lens 328/0 e 0 to 0 dl 1783952295 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783952284.274290:0:97001:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1783952284.274301:0:97001:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1783952284.769726:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465654528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783952284.769800:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783952284.769890:0:26467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465654528 00000100:00100000:3.0:1783952284.769898:0:26467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465654528 00000100:00100000:3.0:1783952284.769952:0:26467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:3.0:1783952284.769963:0:26467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465654528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783952284.770000:0:26467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445515264 avail 1299275776 00000100:00100000:3.0:1783952284.770059:0:26467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1870605465654528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783952284.770066:0:26467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000100:00100000:2.0:1783952284.770090:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1870605465654528:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1783952285.047516:0:97734:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00010000:00010000:3.0:1783952285.219730:0:7459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783952285.280975:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465654656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783952285.281058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952285.281285:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465654656 00000100:00100000:1.0:1783952285.281294:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465654656 00000100:00100000:1.0:1783952285.281360:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297 00000100:00100000:1.0:1783952285.281370:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b174af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465654656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783952285.281400:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1783952285.281571:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783952285.281724:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b146f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465654784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783952285.281758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952285.281841:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b174af7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1870605465654656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 473us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952285.281849:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297 00000100:00100000:2.0:1783952285.281912:0:23862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465654784 00000100:00100000:2.0:1783952285.281917:0:23862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465654784 00000100:00100000:2.0:1783952285.281959:0:23862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:2.0:1783952285.281966:0:23862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b14de1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465654784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783952285.281993:0:23862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445208064 avail 1298968576 00000100:00100000:2.0:1783952285.282084:0:23862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b14de1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1870605465654784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783952285.282091:0:23862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00100000:0.0:1783952285.282353:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b14de1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1870605465654656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783952285.282424:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b146f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1870605465654784:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783952286.243674:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783952286.308299:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783952286.308322:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97b049af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465654912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783952286.308390:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783952286.308446:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870605465654912 00000100:00100000:1.0:1783952286.308452:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870605465654912 00000100:00100000:1.0:1783952286.308509:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2298 00000100:00100000:1.0:1783952286.308517:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97b049af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465654912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783952286.308541:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783952286.308584:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97b049af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1870605465654912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783952286.308607:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2298 00000100:00080000:1.0:1783952286.308630:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783952286.308662:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97b049af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1870605465654912:0@lo:13:osp-pre-1-1.0 Debug log: 71877 lines, 71877 kept, 0 dropped, 0 bad.